NOTE: I-SED was developed in 2017 as a proof-of-concept for a user study of a research paper and built with very shallow knowledge of web-development. There has been no major update since then. Therefore, it is not ready for other purposes and the code is very disorganized. However, you can still run the app (fixed and tested in 2022) and try the demo interface with your own audio file on your local machine. I believe some components of this app would be quite useful to people who want to build a sound event annotator.
I-SED is built with Python Flask and javascript (wavesurfer.js)
I-SED is a human-in-the-loop interface for sound event annotation that helps users search for sound events of interest within a lenghty recording quickly. How a user interects with the interface is following:
- A user selects a sound event of interest in a long recording
- The interface returns a set of regions conaining sound events similar to the initial user selection.
- The user listens to each of them and label them (positve or negative).
- Based on the label information, the interface suggests another set of regions in the recording.
Screenshot:
Demo video: YouTube video
More details about the interaction can be found on the following project pages: https://www.bongjunkim.com/pages/projects/ised.html
When used in academic works, please cite the following paper:
Bongjun Kim and Bryan Pardo, “A Human-in-the-loop System for Sound Event Detection and Annotation,” ACM Transaction on Interactive Intelligent System (TiiS), Vol. 8, Issue 2, Article 13, July 2018.
Run the following command to start the Flask server. Then visit http://127.0.0.1:5000 (or the address printed on your terminal) in your browser.
python run.py