Skip to content
master
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

Pop Music Highlighter

TensorFlow implementation of Pop Music Highlighter: Marking the Emotion Keypoints

  • An attention-based music highlight extraction model to capture the emotion attention score
  • Model: Non-recurrent Neural Attention Modeling by Late Fusion with positional embeddings (NAM-LF (pos))

Please cite this paper if this code/work is helpful:

@article{huang2018highlighter,
  title={Pop music highlighter: Marking the emotion keypoints},
  author={Huang, Yu-Siang and Chou, Szu-Yu and Yang, Yi-Hsuan},
  journal={Transactions of the International Society for Music Information Retrieval},
  year={2018},
  volume={1},
  number={1},
  pages={68--78}
}

Environment

  • Python 3.6
  • TensorFlow 1.2.0
  • NumPy 1.13.0
  • LibROSA 0.5.1

Note: you need to rewrite the main.py for your own purpose and the input audio format to be (mp3 format).

$ git clone https://github.com/remyhuang/pop-music-highlighter.git 	
$ cd pop-music-highlighter
$ python main.py

Outputs

Three default output files

  • audio: short clip of highlight from the original song (.wav format)
  • score: emotion attention score of every second (.npy format)
  • highlight: time interval of highlight (.npy format)

Possible Error

  • The highlight length you set is shorter than the original length of audio.

License

The source code is licensed under GNU General Public License v3.0. However, the pre-trained model (those files under the folder 'model') is licensed under CC BY-NC 4.0. Academia Sinica (Taipei, Taiwan) reserves all the copyrights for the pre-trained model.

Contact

Please feel free to contact Yu-Siang Huang if you have any questions.

About

"Pop Music Highlighter: Marking the Emotion Keypoints", TISMIR vol. 1, no. 1

Topics

Resources

License

Releases

No releases published

Packages

No packages published

Languages

You can’t perform that action at this time.