Skip to content
@Sense-Scape

SenseScape

Sense-Scape

Summary

Primarily a central place to keep all my work relating to acoustics - software, hardware, modelling and system design. It can also be described as an audio streaming platform which receives data from multiple audio sensors, stores the data and forwards it to a pretty Svelte UI which shows time and frequency domain data

System Overview

graph LR; 

AudioSensor1 ---> ProcessingServer
AudioSensor2 ---> ProcessingServer
AudioSimulator1 ---> ProcessingServer

ProcessingServer --->GoTCPWebSocketAdapter
ProcessingServer --> AudioStorage

GoTCPWebSocketAdapter --->SvelteKitUI
Loading
  • AudioSensor - RasperryPi with Respeaker array which transmits multiple channels of audio data
  • AudioSimulator - Windows simullator which can generate multiple channels with a specific tone and phase offset
  • ProcessingServer - Server which hanfles multiple TCP connections from sensors, write their audio data as WAV and forwards it to the websocket converter
  • GoTCPWebSocketAdapter - Forwards data from server to web front end
  • SvelteKitUI - UI that displays sensor data

Getting Started

Contact me (Grant Norrie) on linkedin. I shall provide an RPi 3B + image. Flash this turn on the PI and it will automatically start recording all audio and provide a UI to see what is going on. Below is are examples of the UI:

Live Data View

UI1

View multiple live or simulated data streams from multiple devices. System information is also propogated to the UI.

GPS Position View

UI2

Multiple Sensor positions (set statically or using a live GPS position) may be sent to and displayed on a map.

Stored Audio Files

UI3

Audio files will be generated and written to a user specified location. In this case an external drive.

Feature Development Timeline

timeline
    Milestone 1 : Simulator (Done) : Processing Server (Done) : Live Storage (Done) : Live UI (Done) : Hardware Prototype (Done) : Data Collection (Done)
    Milestone 2 : Full Linux Support (Done) : Playback (Done) : Fixed Installation (Done) : Produce Mic Array (Done)  : GPS (time, pos) (Done) : Handle Multiple HW (Done): Data Collection
    Milestone 3 : Mechanicals (Housing, BMS) : Soak Testing (In Progress) : Live GIS : Live Tracking

Loading

Pinned Loading

  1. Base_Module Base_Module Public

    Base Module on which all other modules are derived

    C++

  2. Generic_Modules Generic_Modules Public

    Cross platform processing modules

    C++

  3. Windows_Modules Windows_Modules Public archive

    Processing modules created for Windows

    C++

  4. Chunk_Types Chunk_Types Public

    Data from processing modules encapsulated by these classes

    C++

  5. ESP32_Modules ESP32_Modules Public archive

    Processing modules created for ESP32 (IDF 5)

    C++

  6. Python_Simulations Python_Simulations Public

    Some simulations on topics of interest that I have put together

    Jupyter Notebook

Repositories

Showing 10 of 20 repositories
  • TCP_Websocket_Adapter Public

    Converts chunks received over TCP connections to web socket data which is forwarded to svelte UI

    Sense-Scape/TCP_Websocket_Adapter’s past year of commit activity
    Go 0 0 0 0 Updated Jul 31, 2024
  • Base_Module Public

    Base Module on which all other modules are derived

    Sense-Scape/Base_Module’s past year of commit activity
    C++ 0 0 1 0 Updated Jul 31, 2024
  • Generic_Modules Public

    Cross platform processing modules

    Sense-Scape/Generic_Modules’s past year of commit activity
    C++ 0 0 3 0 Updated Jul 27, 2024
  • .github Public
    Sense-Scape/.github’s past year of commit activity
    0 0 0 0 Updated Jul 26, 2024
  • Sense-Scape/Linux_Installer’s past year of commit activity
    Python 0 0 0 0 Updated Jul 24, 2024
  • Proc_Serv Public

    SenseScape Processing Sever - Received data from remote audio sensors, stores data as wav files, processes and transmits to user interfaces

    Sense-Scape/Proc_Serv’s past year of commit activity
    C++ 1 0 0 0 Updated Jul 23, 2024
  • Sensor_Sim Public archive

    An audio simulation module which sends is designed to send data to a processing server

    Sense-Scape/Sensor_Sim’s past year of commit activity
    C++ 0 0 0 0 Updated Jul 8, 2024
  • Sense-Scape/Sensor_Viewer’s past year of commit activity
    Svelte 0 0 5 1 Updated Jul 8, 2024
  • Linux_Modules Public archive
    Sense-Scape/Linux_Modules’s past year of commit activity
    C++ 0 0 2 0 Updated May 13, 2024
  • kissfft Public Forked from mborgerding/kissfft

    a Fast Fourier Transform (FFT) library that tries to Keep it Simple, Stupid

    Sense-Scape/kissfft’s past year of commit activity
    C 0 279 0 0 Updated Mar 3, 2024

Top languages

Loading…

Most used topics

Loading…