Skip to content

okio-ai/nendo_plugin_caption_lpmusiccaps

Repository files navigation

Nendo Plugin Caption LP-MusicCaps


nendo core


Website Twitter Discord


An audio captioning plugin based on LP-MusicCaps.

Features

  • Generate captions for all types of audio
  • Caption your audio library and make it searchable by using the other nendo search plugins

Requirements

This plugin requires the manual installation of the LP-MusicCaps repository from git, run:

git clone https://github.com/seungheondoh/lp-music-caps.git
cd lp-music-caps
pip install -e .

For more information, please refer to the LP-MusicCaps repository.

Installation

  1. Install Nendo
  2. pip install nendo-plugin-caption-lpmusiccaps

Usage

Take a look at a basic usage example below. For more detailed information, please refer to the documentation.

>>> from nendo import Nendo
>>> nd = Nendo(plugins=["nendo_plugin_caption_lpmusiccaps"])
>>> track = nd.library.add_track(file_path="path/to/file.mp3")

>>> nd.plugins.caption_lpmusiccaps(track=track)
>>> track.get_plugin_value("caption")

Contributing

Visit our docs to learn all about how to contribute to Nendo: Contributing

License

Nendo: MIT License

LP-MusicCaps: CC-BY-NC 4.0 license.

Pretrained models: The weights are released under the CC-BY-NC 4.0 license

About

Nendo Plugin for audio and music captioning.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages