Skip to content

BinaryBeatSolutions/IntelligentAudio.NET

Repository files navigation

IntelligentAudio.NET

[.NET 10 LTS] | [C# 14] | [License: MIT] | [Ableton] | [FL-Studio] | [LOGIC PRO]

For latest info, visit IntelligentAudio.NET

IntelligentAudio.NET is a high-performance, AI-driven engine designed to bridge the gap between musical intent and DAW execution. Built on the .NET 10 LTS stack, it utilizes state-of-the-art speech-to-chord inference to provide hands-free control for music producers.


The IIntentHandler Contract

The bridge between agnostic audio processing and domain-specific action.

  • Isolation: Handlers are purely reactive. They consume text/intent payloads without knowing the source.
  • Lock-Free Execution: Powered by System.Threading.Channels, ensuring that heavy domain logic (like chord math) never blocks the audio ingestion thread.
  • Extensibility: Adding new capabilities (e.g., VST control, Lighting, AI Logging) only requires a new implementation of IIntentHandler.

Architectural Excellence

This version represents a complete architectural rebuild, moving away from legacy Reflection-based systems to a modern,
decoupled **Event-Driven Architecture**:

- Zero-Allocation Pipeline: Leveraging `Span<float>` and `Memory<T>` for real-time audio cleaning without Garbage Collector spikes.
- Asynchronous Orchestration: Powered by `System.Threading.Channels` for non-blocking communication between the Microphone, AI Engine, and Network layers.
- DAW-Agnostic Design: A Factory-based driver system (`IDawClient`) that currently supports Ableton Live via OSC, with a roadmap for FL Studio (MIDI) and Logic Pro (VST Bridge).
- In-Memory Event Bus: A `DefaultEventAggregator` that decouples AI analysis from hardware delivery, ensuring a "No-Bug" environment.

IntelligentAudio.NET uses a Dynamic Discovery Architecture. 
Instead of hardcoding ports, clients announce themselves via a handshake protocol. 
The server dynamically spins up dedicated UDP transmitters for each instance, ensuring perfect isolation and zero configuration for the end user."

Technical Stack

AI Inference: Whisper.net (Optimized for .NET 10).

Network Layer: BuildSoft.OscCore (High-performance, low-latency OSC).

Audio I/O: NAudio (Windows ASIO/Wasapi) with an abstracted IAudioSource for future macOS support.

Music Theory: DryWetMidi.


Project Structure

  • IntelligentAudio.Contracts: The "Truth" (Interfaces, Events, Models). No external dependencies.
  • IntelligentAudio.Engine: The "Brain" (Audio Processing, AI Orchestration, Event Aggregation).
  • IntelligentAudio.Infrastructure: The "Hands" (OSC Clients, MIDI, Audio Hardware Drivers).
  • IntelligentAudio.Server: The Composition Root (Dependency Injection, Hosting).

Roadmap

.NET 10 Core Engine & Pipeline
Ableton Live OSC Driver
FL Studio MIDI Scripting Driver
VST3 Bridge for Logic Pro/Cubase
macOS CoreAudio Implementation

Getting Started

Requirements

  • .NET 10 SDK (Long Term Support).
  • A Whisper GGML model (e.g., base.bin).

About

IntelligentAudio.NET | Next-gen AI Voice Control for Ableton Live (Soon Fl-Studio, Logic). Built on .NET 10 LTS, this high-performance engine uses Whisper AI and Zero-Allocation Span<T> pipelines to bridge the gap between musical intent and the DAW. Real-time chord detection and transport control via OSC, engineered for zero latency

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors