music transcription app & rocksmith cdlc generator (pre alpha WIP)
Combines best features of Capo and Editor on Fire
-
TODO
- cqt
- click to seek
- note hover
- tranpose
- detune/playback rate
- analysis
-
chord, downbeat uses python
- investigate py-to-wasm, pyinstaller, cython, python freeze
-
convert to essentia (cqt, beats, bpm,
key) -
convert essentia c++ to wasm
- break into web workers so we can process them as soon as its done
-
adhoc analysis, disable analysis if section is disabled
-
https://github.com/DavideBusacca/AudioDSP/blob/master/HPSS/HPSS.py
-
https://librosa.github.io/librosa/generated/librosa.decompose.hpss.html
-
https://aubio.org/ (https://news.ycombinator.com/item?id=19681804)
-
https://www.analyticsvidhya.com/blog/2018/01/10-audio-processing-projects-applications/ (whitepapers)
-
- misc
- soundtouch worklet
- chord tip bar info
- cqt
-
NEXT
https://grunfy.com/scaler.html- guitar tab interface (https://github.com/calesce/tab-editor/ https://github.com/CoderLine/alphaTab) (http://www.guitk.com/editor/)
- https://opensheetmusicdisplay.github.io/
- https://wim.vree.org/js/ (vexflow/musicxml)
- export to psarc/cdlc
- guitar tuner
- song playback
- ML based stem isolation
- ML based vocal separation
- ML based melody detection
- guitar tab interface (https://github.com/calesce/tab-editor/ https://github.com/CoderLine/alphaTab) (http://www.guitk.com/editor/)
-
FUTURE
- external input guitar (https://wasabi.i3s.unice.fr/AmpSimFA/)
- external input piano (https://gogul09.github.io/software/deep-drum)
- time signature warp (https://arrow.dit.ie/cgi/viewcontent.cgi?article=1080&context=argcon)
- MIDI GUITAR 2/guitar midi input (https://www.jamorigin.com/products/)
-
MVP
- Basic Scene with simple mp3 spectrogram/freq + guitar/bass/rhythm path
- Save to psarc
-
landing page
-
alternatives
- analysis - capo, transcribe
- transcription - sound slice, editor on fire
-
clone forked wavesurfer
- git clone https://github.com/sandiz/wavesurfer.js
- cd wavesurfer
- switch to (broken-ww) branch (latest master, barWidth broken)
- yarn install
- yarn run build
- yarn link
-
clone rs-designer
- git clone https://github.com/sandiz/rs-designer
- yarn link wavesurfer.js
- yarn install
-
yarn start
-
libraries to check for pr/updates
- madmom
- essentia
- librosa
- wavesurfer