AI-based.md

🗂️ Voicing - Guitars - Bass - Drums - Effects - MIDI - Mixing/Mastering - Enhancing - Fingerprinting - Separating - Watermarking - Codecs - Transcripting - Misc

Warning

$\color{orange}\textsf{{SORTING: Language (a>z) > License (openness) > Repository (a>z)}}$

Guitars ⌂

Repository	Short description	Language	License	Last commit
AIDA-X	An Amp Model Player intended to provide high fidelity simulations of amplifiers (entire signal chain) leveraging AI.
Neural Cab	A FIR guitar cabinet simulator which generates its transfer functions by means of a Variational Auto-Encoder (VAE) trained with an additional adversarial loss and a very simple Boundary Element Method (BEM) simulation to consider the microphone position.
SmartAmpPro	Guitar plugin made with JUCE that uses neural network models to emulate real world hardware
SmartGuitarAmp	Guitar plugin made with JUCE that uses neural network models to emulate real world hardware
CNN Distortion	Guitar Amp Modeling Plugin and Toolset that combine deep learning and DSP
Deep Guitar Amplifier	A little project to practice Tensorflow/Keras where deep learning for black-box modelling of a guitar amplifier used
Automated-Guitar Amplifier Modelling	Neural network training scripts and trained models of guitar amplifiers and distortion pedals
GuitarLSTM	Deep learning models for guitar amp/pedal emulation using LSTM with Keras
NAM: neural amp modeler	Neural network emulator for guitar amplifiers

Bass ⌂

Repository	Short description	Language	License	Last commit
Beatle-Basslines	Deep Learning model for creation of an instrument track in a performer's style from Other tracks in a MIDI file
Walking Bass Transcription	Algorithm for walking bass transcription in jazz ensemble recordings using Deep Neural Networks (DNN)
BassUNet	U-Net based convolutional neural network for (jazz) bass transcription
bassTranscriber	Automatically transcribing bass lines using neural networks

Drums ⌂

Repository	Short description	Language	License	Last commit
drumsep	A Convolutional Neural Network for drum signal separation from full mixes
Generative Adversarial Networks - Drum Pattern Generation	Generates drum patterns similar to those by Maciej Kowalski
Automatic Drum Transcription	Automatic drum transcription using neural nets
Mix-Wave-U-Net	Implementation of the Mix-Wave-U-Net for automatic mixing of drums
NeuralDrummer	A neural network for generating drum tracks for songs using Python and TensorFlow
Neural-Networks-for-Drum-Music-Generation	Generating realistic drum music using LSTM neural networks trained on rock-style MIDI drum performances
Automatic drums transcription using neural networks	Internship's code for automatic drums transcription with neural networks
Drum Transcription algorithm	AI-based Drums Transcription Algorithm

Effects ⌂

Repository	Short description	Language	License	Last commit
OpenVINO™ AI Plugins for Audacity	A set of AI-enabled effects, generators, and analyzers for Audacity®
GRAND MATRON	An audio neural network plugin modeling a low pass filter built in JUCE
AI Compressor	Implementing an Intelligent Dynamic Range Compressor Using Machine Learning Approaches

MIDI ⌂

Repository	Short description	Language	License	Last commit
AI improviser plugin	A VST plugin that learns from an incoming MIDI stream and improvises with what it has learnt
NeuralNote	Audio Plugin for Audio to MIDI transcription using deep learning
RoboDrummer	Midi drums generator based on deep neural network
AI-Music-Composer	A project that trains a LSTM recurrent neural network over a data-set of MIDI files.
Notochord	A real-time neural network model for MIDI performances
Midi-AI-Melody-Generator	Uses LSTM neural networks to compose new and original melodies by feeding it midi files

Mixing/Mastering ⌂

Repository	Short description	Language	License	Last commit
MasterIA	This project aims to develop an AI that can perform automated audio mixing and mastering based on user-defined preferences or by analyzing reference tracks
MachineLearningDrumGainMixing	Supplementary website with audio examples for A Machine Learning Approach to Multitrack Gain Mixing of Drums paper
AudMIX	A web-based system for processing Audio using Deep Learning
SonicMaster	Towards Controllable All-in-One Music Restoration and Mastering
ZoundZcope	A modular audio analysis and feedback tool that gives automated mixing and mastering suggestions based on extracted audio features
Diff-MST	Multitrack music mixing style transfer given a reference song using differentiable mixing console
MixTastic	Removes barriers to entry for new artists by providing AI-powered tools that assist with basic mixing and mastering tasks
deep-audio-mixer	Deep Learning based system for audio mixing
Evolving artificial neural networks for cross-adaptive audio effects	Analysis of various features of the audio signal is used to adaptively control parameters of audio processing of the same signal
Adaptive Neural Audio Mixing with Human-in-the-Loop Feedback	An AI-powered audio mixing system that utilizes reinforcement learning (RL) to dynamically refine mixes based on user interactions
DJtransGAN	Code for "Automatic DJ Transitions with Differentiable Audio Effects and Generative Adversarial Networks" paper
automix-toolkit	Models and datasets for training deep learning automatic mixing models
MixCNN	Mulitrack mix leveling with convolutional neural nets

Separating ⌂

Repository	Short description	Language	License	Last commit
audioss	Audio source separation tool using a neural network
DeepConvSep	Deep Convolutional Neural Networks for Musical Source Separation
Hyperbolic Audio Source Separation	Source code for training models and using the hyperbolic interface proposed in our ICASSP 2023 paper, "Hyperbolic Audio Source Separation" paper
A Wavenet for Music Source Separation	A neural network for end-to-end music source separation
Audio Source Separation	Deep Neural Network model for Audio source separation
AudioSep	Official implementation of "Separate Anything You Describe" paper
audio-source-separation	PyTorch code for "Monoaural Audio Source Separation Using Deep Convolutional Neural Networks" paper to separate instruments from music using a low-latency neural network
Continual Music Source Separation	Repository dedicated to train models for the task of music source separation in the context of continual learning
GAN_SASS_TF	TensorFlow implementation of "GAN Single Audio Source Separation" paper
Music Source Separation Universal Training Code	Repository for training models for music source separation
Open-Unmix for PyTorch	PyTorch (1.8+) implementation of Open-Unmix, a deep neural network reference implementation for music source separation
Spleeter	Deezer source separation library including pretrained models.
BandIt: Cinematic Audio Source Separation	Code for "A Generalized Bandsplit Neural Network for Cinematic Audio Source Separation" paper
CASS	CASS is a source separation model unifying AE and GAN frameworks
Generative sourceseparation with GANs	Code for Generative Adversarial Source Separation paper
Unmixer	A GUI frontend for LALAL.AI's AI-powered stem-splitting technology

Fingerprinting ⌂

Repository	Short description	Language	License	Last commit
neural-fingerprinting	Neural audio fingerprinting model similar to "Neural audio fingerprint for high-specific audio retrieval based on contrastive learning" but with a more lightweight encoder, simpler nearest neighbor search, and implemented in PyTorch
neural-audio-fp	Neural Audio Fingerprint for High-specific Audio Retrieval based on Contrasive Learning
FingerprintDNN	Fast pitch detection using a deep neural network trained on audio fingerprints
pfann	Unofficial reproduction of "Neural Audio Fingerprint for High-specific Audio Retrieval based on Contrasive Learning" paper

Watermarking ⌂

Repository	Short description	Language	License	Last commit
DNN-audio-watermarking	A robust DNN-based audio watermarking system
WavMark	AI-based Audio Watermarking Tool
IDEAW	Robust Neural Audio Watermarking with Invertible Dual-Embedding

Codecs ⌂

Repository	Short description	Language	License	Last commit
NeuralCodecs	Neural Audio Codecs implemented in C#
hilcodec	High fidelity, lightweight, end-to-end, streaming, convolution-based neural audio codec
AudioDec	An Open-source Streaming High-fidelity Neural Audio Codec
FlowDec	An neural full-band audio codec for general audio sampled at 48 kHz with 7.5 kps or 4.5 kbps.
AudioCodec-Hub	A Python library for encoding and decoding audio data, supporting various neural audio codec models
Descript Audio Codec	A high fidelity general neural audio codec
EnCodec	State-of-the-art deep learning based audio codec
encodec-pytorch	unofficial implementation of the High Fidelity Neural Audio Compression
NDVQ	Official repository for the "NDVQ: Robust Neural Audio Codec with Normal Distribution-Based Vector Quantization" paper
NeuralAudio	Sound compression based on Growing Self-Organizing Maps
Siamese SIREN	Audio Compression with Implicit Neural Representations
SoundStream	An end-to-end neural audio codec
audiolite	A deep learning framework for audio compression and decompression
CorticalCodingCodec	A neural multimedia codec that have comparable performance to current state-of-the-art lossy audio codecs

Transcripting ⌂

Repository	Short description	Language	License	Last commit
audioFlux	A deep learning tool library for audio and music analysis, feature extraction
Guitabify	An AI application that transcribes guitar audio to tabs
AutomaticTranscription-viaDL	Deep learning Japanese instruments - flute and drum - automatic transcription

Misc ⌂

Repository	Short description	Language	License	Last commit
NeuralAudio	C++ library for real-time processing of audio neural network models
Bleeding Removal in Music Signals	Neural networks for removal of bleeding in music signals for the sequential application of Music Source Separation
Musical-Accompaniment-GAN	Deep Learning project to create a model for accompaniment of piano tracks with guitar, strings, bass and drums