Live Smith v0.3.0

Live Smith 0.3.0 brings Plugins and MCP Apps, music generation and stem separation, broader file attachments, and an English/Chinese interface.

What's new

• Plugins and interactive tools. Install portable Agent Plugins and compatible Codex or Claude Code packages. Use their Skills, configure persistent parameters, and run MCP tools through forms or interactive MCP Apps. Connect standalone local or remote MCP servers, and insert saved MIDI results into Live.
• Music and audio services. Connect Suno.com, Suno Platform, SunoAPI, Mureka, Google Lyria, ElevenLabs, or LALAL.AI. Available tools include music and sound-effect generation, stem separation, and provider-specific editing. Suno.com adds song extension, Cover, Remaster, audio upload, Add Vocals/Instrumental, section replacement, and lyric writing. Preview results, download or export selected files, and import them into Live. Recover supported interrupted jobs without starting a new generation.
• More reference formats. Drag or paste PDF, DOCX/XLSX/PPTX, OpenDocument, RTF, text/code, MIDI, images, and audio into chat. Document extraction needs no additional runtime. View images directly, play and seek audio, or open files in their default application.
• Larger audio and attachment follow-ups. Attach original WAV/MP3 files up to 128 MiB and 15 minutes each. Add files while the assistant is working, then send them with Steer or Queue. Request-size errors explain when to use fewer files or a shorter excerpt.
• Clearer conversations and edits. Switch between English and Simplified Chinese, copy messages or reuse them as drafts, view provider reasoning summaries, save custom instructions, and see the Session's bound Live context. Supported single-Clip MIDI and parameter edits show a before/after preview.
• Compatibility improvements. Windows system proxy support, Enter-to-send with IME handling, and fixes for attachment and Plugin storage under Ableton's Extension Host. Streaming, cancellation, and audio-result recovery are more reliable.

Requirements and known limits

• Ableton Live 12 Suite Beta 12.4.15b5 or a later build with Extensions support is required. Live Smith remains beta software. See the development guide for source-build requirements.
• Provider access varies. Audio services require their own accounts and may consume credits. Supported operations depend on the provider, model, account, and region. Suno.com uses an unofficial website integration; its in-app human verification requires macOS 14 or later. Windows generation cannot continue when Suno requires a challenge.
• Attachment limits still apply. A Session can hold four pending files, including at most two audio files. Native image, audio, and PDF analysis depends on the selected model and connection. Audio accepts WAV/MP3; other audio formats require export before attaching. Binary model input is limited to 128 MiB of original file bytes across the current request and included history; provider limits may be lower. Legacy DOC/XLS/PPT and video frames are unsupported.
• MIDI import targets one Clip. MIDI attachments can describe multiple tracks, but saved Plugin MIDI results currently combine their notes into one destination Clip.
• Plugin compatibility is partial. Package support covers Skills, MCP tools, and supported configuration/UI extensions. Platform-specific commands, hooks, agents, and other unsupported capabilities are listed during installation. Remote MCP OAuth sign-in is not available. Local MCP servers run with the user's operating-system permissions.

Contributors

Thanks to @MadeByAdi for Enter-to-send (#2), attachment compatibility (#3), and Plugin storage compatibility (#5). The Suno subscription-session fix also credits Sitar118 as a co-author (f66d88f).

Full changelog: v0.2.2...v0.3.0

Download Live-Smith-0.3.0.ablx below.

SHA-256:

b572bda9c48421bb62f7011668d70026ab6ac9ba187f2c98570ebe300629b9de

Live Smith v0.2.2

This release adds native account-subscription connections, explicit proxy routing, Session context commands, and a more focused Inspector and conversation timeline.

Highlights

• Sign in to ChatGPT, Claude, or Google Antigravity inside Live Smith without installing a provider CLI or storing an API key in the Profile. OAuth state, catalogs, refresh, and logout remain isolated to the exact Profile and provider.
• Route Direct API and account-subscription traffic through No proxy, the active macOS System proxy, or one credential-free Manual HTTP, HTTPS, or SOCKS proxy. Loopback model servers remain direct, and failed proxy routes return actionable errors instead of silently falling back.
• Use /compact [instructions] to checkpoint a Session on demand, /clear to open a fresh Session, and /queue or /steer to control follow-up behavior. Models can also define context-window and automatic-compaction thresholds.
• Keep consecutive tool calls and Apply results in one expandable activity group that shows the current or latest step while preserving the complete history on expansion.
• Use the redesigned Inspector: Agent groups Model Profiles with Session Skills, App owns conversation, display, and proxy preferences, and Context presents a wider aligned Live-state card. Explanatory copy, composer chrome, status placement, and conversation scrollbars are quieter and more consistent.
• Strengthen provider request mapping, OAuth/profile concurrency, reconnect synchronization, and ambiguous Clip planning; ambiguous creation now prefers Arrangement instead of guessing Session View.

Upgrade notes

• An Ableton Live build with Extensions support is required. Source builds require Node.js 24.16.0 or newer and the separately obtained Ableton Extensions SDK and CLI 1.0.0-beta.1.
• Existing supported settings migrate automatically. Legacy Codex subscription Profiles become native OpenAI subscription Profiles, but CLI credentials are not imported, so sign in again inside Live Smith. The new network route starts at No proxy until explicitly changed.
• Account subscription remains experimental. ChatGPT uses device authorization, Claude uses browser PKCE with a local callback, and Google Antigravity requires copying its hosted one-time authorization code into Live Smith. Anthropic currently assigns third-party OAuth traffic to Claude Extra Usage when enabled, separate from the plan's base allowance and Console API balance. Hosted Web Search is not exposed through subscription Profiles.
• macOS System proxy mode follows static HTTP, HTTPS, or SOCKS settings. PAC/WPAD configuration is not evaluated; select a Manual proxy URL for that route instead.

Download Live-Smith-0.2.2.ablx below for the packaged extension.

SHA-256:

478e5feda7c2431e797554a4d9b2ee836a49e67a22d2240df5f6cc2cc5b444d6

Full changelog: v0.2.1...v0.2.2

Live Smith v0.2.1

This release adds finer per-Session safety controls, broader Live editing and audio workflows, Gemini compatibility, stronger recovery, and a more compact composer.

Highlights

• Limit each Session to selected MIDI, Audio, Devices, Mixer, and Structure edit scopes, or clear every scope for read-only use. Scope enforcement remains independent of Manual, Low Risk, and Accept Everything approval.
• Inspect and edit supported Return and Main track devices and mixer parameters, create Clips in observed Take Lanes, and work with existing Rack Chains and their mixers.
• Let verified audio-input models read bounded Arrangement Audio Clip ranges for listening or transcription. Audio attached to the current request can also become a Live Clip, Simpler sample, or Drum Rack pad source through a Live-managed project copy.
• Connect Google Gemini through its official OpenAI Chat Completions compatibility endpoint.
• Preserve MIDI note expression fields and expose more complete Live Set observations for safer multi-step work.
• Recover interrupted agent work more reliably, keep Session state coherent across reconnects and background activity, and restore subscription capabilities without blocking Session navigation or Send.
• Keep untouched empty Sessions out of persistent history while preserving active drafts and used conversations. Submitted messages now appear immediately.
• Refine the compact composer with Session model and reasoning controls, optional context usage, stable single-row layout, and responsive permission controls.

Upgrade notes

• An Ableton Live build with Extensions support is required. Source builds require Node.js 24.16.0 or newer and the separately obtained Ableton Extensions SDK and CLI 1.0.0-beta.1.
• Existing supported settings migrate automatically. Sessions without historical Edit Scope metadata continue to allow all scopes until a scope selection is saved.
• Gemini compatibility uses Google's beta OpenAI-compatible endpoint. It does not add Gemini File API uploads or Google Search grounding.
• Arrangement audio reads are temporary, pre-effects model input for the current request. They do not include Session View Clips or the track device chain.
• Audio imported from a request attachment is copied into the Live Project. Deleting the Session later removes its private attachment but not Live's project copy.

Download Live-Smith-0.2.1.ablx below for the packaged extension.

SHA-256:

040ffa47d2cac6f897866c251ef5d41f5d71b1b7120e160cc808e47ce7199815

Full changelog: v0.2.0...v0.2.1

Live Smith v0.2.0

This release adds per-Session model controls, built-in arrangement Skills, and an experimental ChatGPT subscription connection, alongside smoother conversation workflows and connection recovery.

Highlights

• Save multiple models in one Profile and switch models or supported reasoning levels directly in the composer. A context meter shows reported usage when available.
• Use three built-in arrangement Skills covering section energy, musical variation, and instrument roles. Read their instructions before enabling them per Session, alongside your imported Skills.
• Queue follow-ups for the next turn, steer an in-progress request, or stop the active turn.
• Connect an eligible ChatGPT account through an isolated official Codex CLI login, without changing your regular Codex login or falling back to API-key billing.
• Transpose, quantize, scale velocity, and shift MIDI notes, plus measure isolated Arrangement audio ranges before effects.
• Streamlined Settings, a collapsible Sessions panel, improved Session selection and management, and more consistent keyboard focus.
• Added bounded recovery for interrupted Direct API responses, restored active conversation state after reconnects, and restored missing subscription capabilities when reopening the window.

Upgrade notes

• An Ableton Live build with Extensions support is required. Source builds require Node.js 24.16.0 or newer and the separately obtained Ableton Extensions SDK and CLI 1.0.0-beta.1.
• Existing supported Profile settings migrate to the multi-model format, retaining their saved model as the default.
• The experimental subscription connection requires globally installed @openai/codex@0.148.x. It does not support hosted Web Search or workspace-managed accounts. Claude subscription login is not supported; use an Anthropic Direct API Profile instead.
• Queued follow-ups belong to the open window. Stop ends the current turn; it does not cancel queued follow-ups.

Download Live-Smith-0.2.0.ablx below for the packaged extension.

SHA-256:

b368487aaef0e5df83cf3f528d7c2daf460548dee7a80a87a8a63046f62c7725

Full changelog: v0.1.1...v0.2.0

Live Smith v0.1.1

This release updates Live Smith to the Ableton Extensions SDK 1.0.0-beta.1 and includes several reliability and UX improvements.

Highlights

• Updated the Ableton Extensions SDK and CLI to 1.0.0-beta.1.
• Added support for keyless local model providers.
• Scoped Apply approval modes to individual Sessions.
• Hardened hosted Web Search handling and failure recovery.
• Fixed a settings disclosure border flash.

Upgrade notes

• Node.js 24.16.0 or newer is required.
• Obtain the Ableton SDK beta packages through Ableton's official developer channel.
• Place the SDK archives in extensions-sdk-1/, then reinstall dependencies:

npm ci

Live Smith v0.1.0 — Initial Beta

Live Smith is a context-aware AI production agent for Ableton Live. It adds Ask Live Smith to supported Live context menus and provides a persistent chat workspace for inspecting, editing, and developing a Live Set.

Highlights

• Inspect and modify Tracks, mixer settings, MIDI and audio Clips, Scenes, Cue Points, Devices, Racks, samples, and Take Lanes.
• Connect through named Profiles using:
  • OpenAI Responses
  • OpenAI Chat Completions
  • Anthropic Messages
  • Compatible OpenAI endpoints
• Review proposed Set changes before execution with Manual, Low Risk, and Accept Everything approval modes.
• Keep scoped Sessions with conversation history, Live context, tool activity, errors, and recovery state.
• Attach PNG, JPEG, WebP, PDF, DOCX, XLSX, PPTX, WAV, and MP3 content by paste or drag-and-drop.
• Use selected Live Audio Clips, Samples, or Simpler sources as model input.
• Install local SKILL.md workflow guides and enable up to four Skills per Session.
• Enable provider-hosted Web Search for supported OpenAI Responses and Anthropic Profiles, with live search activity, source pages, and answer citations.
• Render sanitized Markdown, tables, code blocks, links, tool results, and Apply activity directly in the timeline.

Safety and reliability

Live Smith validates every model-generated action against a bounded schema. Set mutations remain subject to Live observation, preflight validation, cancellation, serialized execution, and state-drift checks—even when automatic approval is enabled.

Partial operations, interrupted requests, concurrent dialogs, and uncertain persistence outcomes are reconciled against authoritative Session state instead of being silently retried.

API credentials, attachment bytes, Skill bodies, and Session data remain in local extension storage and are not written into source files or chat-state payloads.

Requirements

• An Ableton Live build with Extensions support
• Ableton Extensions SDK 1.0.0-beta.0
• A configured model-provider API key and compatible model

This release targets a beta Ableton API. Back up important projects and review proposed changes before applying them.

Installation

1. Download Live-Smith-0.1.0.ablx from the assets below.
2. Install it using Ableton Live’s Extensions workflow.
3. Open Ask Live Smith from a supported Live object’s context menu.
4. Create a Model Profile, connect to the provider, choose a model, and select Save & Use.

Current boundaries

• Live’s current Extensions API does not expose the Browser, preset search, or an installed-device catalog.
• Native Live devices can be inserted by exact name; VST plug-ins cannot be inserted by plug-in identifier.
• File attachments use paste and drag-and-drop because the current Live WebView does not provide a native file chooser.
• Provider-hosted Web Search depends on endpoint support and is unavailable in OpenAI Chat Completions mode.

Package checksum

Live-Smith-0.1.0.ablx

SHA-256:

659e5b256faed176c91debfe3cbacc0710c79bda3c789f06b7b8ed4a0009515a