Meet AudioMIX and its first test use case, Spotibot - an open-source and intelligent artist-friendly music tool. AudioMIX features AI-powered audio analysis and mood-aware music interaction.
AudioMIX's LED light can match its colors and song or playlist suggestions to the user's mood through the phenomenon of mood detection. Modular, expressive, and built for real-time creative performance.
I update this repo continuously via my local terminal. :)
- Mood detection from audio files
- Spectral + MFCC-based analysis
- Integrated Spotify API for playlist input with room for future extensions
- Spotify integration: import playlists, analyze mood tracks (in development)
- LED output logic for physical interaction
- Modular codebase (using Python + C/C++)
- Live performance engine for real-time interaction and show control (in development)
- CLI-parseable JSON output for mood + BPM classification
- Built with musicians in mind
AudioMIX follows an open-source, emotionally-aware, and artist-first development philosophy.
See ETHICAL_AI_MANIFESTO.md for our creative mission and guiding principles.
GNU General Public License v3 (open-source and free to use for indie artists, please refer to LICENSE.txt)
AudioMIX is modular by design, allowing for rapid extension into a full-scale music AI and production framework. The system will be organized into the following key components:
Purpose: Feature extraction from audio files Current Capabilities:
- Mel-frequency cepstal coefficients (MFCC)
- Spectral contrast
- Tempo + beat tracking Future Expansion:
- Key detection
- Genre classification
- Dynamic range + loudness modeling
Purpose: Analyze extracted features and assign mood tags Current Capabilities:
- Basic SVM model trained on open-label audio sets
- Custom mood categories: happy, calm, energetic, sad, relaxed, angry Future Expansion:
- Neural network mood embedding
- Mood-to-mixtrack recommendation
- Personalized training datasets
Purpose: Real-time audio playback + mood-responsive LED control Current Capabilities:
- C++ PortAudio-based playback
- Shell script to manage audio routing for PortAudio
- GPIO/LED trigger on classification results Future Expansion:
- Reactive visual patterns
- BPM-sync lighting
- Live mode for DJ controller input
Purpose: Spotibot personality/voice layer for interactivity Current Capabilities:
- Early logic for vocalized responses to user mood/input
- Default TTS voice or interaction prompt Future Expansion:
- Integration with a personality engine
Purpose: Audio files, metadata, and ML training targets Current Format:
- Metadata syncing with Spotify API
- Manual labeling for mood, BPM, genre
- JSON parsing logic per track Future Expansion:
- CSV per track
- Open contributor mood tag dataset
- Dataset visualizer UI
Purpose: LED control microservice for live color pattern output based on mood/BPM JSON input
Current Capabilities:
- CLI-parseable JSON endpoint (e.g.
python main.py '{"mood": "hype", "bpm": 135}') - Pattern selection (strobe, pulse, fade)
- Mood → RGB mapping with custom color profiles
Future Expansion: - Socket-based live trigger events
- DMX lighting integration for venue-scale output
AudioScript is a custom domain-specific language (DSL) created for AudioMIX. It allows users to control audio playback, LED behaviors, and mood transitions using expressive, scriptable commands in high-level syntax.
- Human-readable, whitespace-sensitive syntax
- Modular commands:
play(),glow(),pulse(),mood.set(), and more - CLI interpreter support with real-time execution
- Designed for live performance, emotional scripting, and AI augmentation
mood.set("uplifted")
glow("lilac")
play("intro.wav")
pulse("yellow", bpm=120)AudioScript is still evolving. View the full language spec here: AUDIOSCRIPT_SPEC.md
Juniper2.0 is the intelligent assistant inside AudioMIX, designed to:
- Assist with AudioScript generation and debugging
- Suggest mood-optimized track flows
- Recommend LED and emotional mappings
- Guide live performance scripting in real time
Juniper2.0 will be integrated into the CLI and future UI to provide intelligent inline suggestions and personalized creative support for musicians and coders alike.
Juniper doesn’t just automate—she collaborates.
Below is the current system-level architecture of AudioMIX, including modules written in Python, C++, and AudioScript: AudioMIX will rave. Thank you :)
A full snapshot of the current project structure can be found in AudioMIX_project_tree.txt.
- Python 3.10+
- CMake 3.18+
- librosa, scikitlearn, sounddevice (please refer to requirements.txt)
- PortAudio or PulseAudio
git clone https://github.com/alexisvassquez/ai_spotibot_player.git
cd ai_spotibot_player
pip install -r requirements.txt
mkdir build && cd build
cmake ..
make