Essentia.js is a JavaScript (JS) library for music/audio signal analysis and processing developed at the Music Technology Group, UPF, Barcelona. The core of library is powered by Essentia C++ library back-end using WebAssembly built via Emscripten along with a high-level JS and TypeScript API and add-on utility modules. ie, You can run an extensive collection of music/audio processing and analysis algorithms/models on your web browser or Node.js runtime applications. It supports both real-time and offline audio analysis use-cases.
The packaged add-on modules includes configurable feature extractors for some selected features, interface for feature extraction and inference of a collection of pre-trained audio ML models using Tensorflow.js, some helper classes for visualizing common music processing features directly into your HTML web page using Plotly.js library.
-
License: https://essentia.upf.edu/licensing_information.html
-
Repository: https://github.com/MTG/essentia.js
-
Live demos: https://mtg.github.io/essentia.js/examples
-
Documentation: https://mtg.github.io/essentia.js/docs/api
-
Tutorials: https://mtg.github.io/essentia.js/docs/api/list_tutorial.html
You are also most welcome to contribute to essentia.js.
NOTE: Essentia.js is currently under rapid development. This means that APIs and features will evolve. It is recommended that devs who adopt essentia.js today upgrade their installation as new releases become available, as backwards compatibility is not yet guaranteed. Some of the algorithms are not yet manually tested on the JavaScript front. Please submit the issues at https://github.com/MTG/essentia.js/issues.
Citing Essentia.js
If you want to cite Essentia.js in a scholarly work, please use the following references.
Albin Correya, Jorge Marcos-Fernández, Luis Joglar-Ongay, Pablo Alonso-Jiménez, Xavier Serra, Dmitry Bogdanov. Audio and Music Analysis on the Web using Essentia.js, Transactions of the International Society for Music Information Retrieval (TISMIR). 4(1), pp. 167–181. 2021.
Albin Correya, Dmitry Bogdanov, Luis Joglar-Ongay, Xavier Serra. Essentia.js: A JavaScript Library for Music and Audio Analysis on the Web, 21st International Society for Music Information Retrieval Conference (ISMIR 2020), pp. 605-612. 2020.