Skip to content

alanzhu07/NeuralMorph

Repository files navigation

Neural Morph

Neural Morph is an audio instrument plugin which supports using Machine Learning to transform, blend, and play existing samples.

Neural Morph UI

Installation

To install Neural Morph, you should make sure you have CMake 3.15 or higher installed.

Then, you need to install JUCE (you should clone the JUCE directory and then install via CMake, see JUCE CMake documentation) and LibTorch.

In the config file, set TORCH_CMAKE_PATH as the absolute path of your libtorch install, JUCE_CMAKE_PATH as the absolute path of your JUCE install, CMAKE_GENERATOR as the generator for CMake (run cmake -G to see a full list of generators on your platform).

Then, run the following command to build.

sh build.sh

By default it will build Neural Morph as a standalone application, VST3, and AU plugins. The VST3 and AU will be copied to the default install location for audio plugins, and you can find your plugins directly in your DAW. You can find the standalone application in build/NeuralMorph_artefacts/Release/Standalone.

Getting Models

Currently Neural Morph support Dance Diffusion, you can try their model on Replicate.

You can fine-tune Dance Diffusion models with this notebook: Open In Colab

Run Dance Diffusion models and export it as torchscript model for Neural Morph: Open In Colab

You can also try some precompiled models here. To load any models, just select the .pt files after clicking on the "Select model to load".

About

Audio Effects Plugin using Diffusion Model

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published