Skip to content
Cochlear sound spectrum
Haskell Nix HTML Other
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
deps
dist/build/cochleagram
exec
src
static
.gitignore
.gitmodules
LICENSE
README.md
cochleagram.cabal
deploy.sh
init-sandbox.sh
overrides.nix

README.md

Cochleagram

Tools for psychoacoustics

Installation

  1. git clone git@github.com:CBMM/cochleagram && cd cochleagram
  2. Install Haskell
  3. Install ghcjs
  4. git submodule update --init --recursive
  5. ./init-sandbox.sh
  6. cabal configure --ghcjs
  7. cabal install --only-dep
  8. cabal install

Running

cochleagram uses your computer's microphone, so the browser protects you by making sure cochleagram only runs over a secured connection. This makes it a little bit tough to test your changes cochleagram on your local computer - you need an SSL-enabled server.

http-server is a quick way to do this.

You'll need to make a self-signed certificate.

Then point your server to the cert and key files, from the cochleagram compiler output directory:

cd dist/build/cochleagram/cochleagram.jsexe/
http-server -S -K ~/key.pem -C ~/cert.pem

At this point you can reach the files via the browser at https://localhost:8080

If this gives you trouble please feel free to get in touch.

Brainstorming - Hack with us!

Teaching & demos

  • Show basic principles (filters, power spectrum, spectrograms, cochleagrams)

  • Use data from computer mic (real time visualization)

  • Use data from file on the web (zoomable visualization)

  • Tune parameters

  • Demos usable after the talk is over

Researchy demos

  • Template matching in spectrogram

  • Auditory scene / texture / cepstra analysis

  • Sound generation & playback from scene statistics

  • Stereo source localization demos (too ambitious)?

Goals, Themes

  • Separate the sound exploration from grungy coding details

  • Abstract the most common tasks into nice libraries

  • Push science findings toward demo-level teaching tools

Related work & Inspiration

Brainstorming session with McDermott lab

  • Demo walking through mechanism of generating cochleagram and connection to auditory system. Show traveling wave in basalar membrane. (Sam)

  • How hard to specify (how many dimensions) (how many sliders) for parametizing cochleagram.

  • Export figures

  • Javascript NN?

  • Other ways of visualizing sound than spectrograms?

  • Code box to change the signal?

  • Online training in some way or another (reverse correlation?)

  • Provide filters to the thing.

  • Sliding correlation matrix.

You can’t perform that action at this time.