Skip to content

Find patterns in your favorite songs and remix them on the fly!

Notifications You must be signed in to change notification settings

fatsmcgee/MusicMappr

Repository files navigation

MusicMappr

What does it do?

MusicMappr finds chunks of songs that are similar, and clusters them accordingly. You can visualize these clusters and play them back at will. This is for music lovers who are curious about the structures inherent to their favorite songs.

How does it work?

MusicMappr uses a hodge-podge of HTML5 features as well as some clustering and visualization techniques from machine learning. Using the WebAudio API, it extracts raw samples from a song. Then, it divides those samples into chunks and performs a fourier transform on each chunk to extract frequency data (dividing the work into multiple WebWorkers to speed up the process). Then, MusicMappr uses the T-SNE algorithm to visualize differences between the high dimensional fourier features in 2-d space. Finally, it runs K-means clustering to show the clusters that arise from T-SNE. More info is in our NIME paper and YouTube demo.

How do I get it to work?

MusicMappr is a work in progress. Right now it is confirmed to work on Chrome and Firefox, but no other browsers. Make sure you have the latest version of one of these browsers.

Where can I try it? Go to http://fatsmcgee.github.io/MusicMappr/ for a live demo! Not guaranteed to be the latest version.

New features!

Hit us up if you're interested, or just submit pull requests!

  • Recording audio using the WebAudio API. It would be dope to record audio straight into MusicMappr and then see the samples for it!
  • Beat detection (http://tech.beatport.com/2014/web-audio/beat-detection-using-web-audio/). Right now we just chop up a song according to the sampling frequency.
  • Mobile support. Making an app out of this would be awesome!
  • Prettyfying the UI. Going all Material Design on this shit!

Citing this work

E. Benjamin, and J. Altosaar. MusicMapper: Interactive 2D representations of music samples for in-browser remixing and exploration. 15th International Conference on New Interfaces for Musical Expression. (2015). PDF.

About

Find patterns in your favorite songs and remix them on the fly!

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published