An Update before Revamp!

[shimmyshimmer]

Hey guys, we're doing one more-ish update before a major revamp which is likely coming this week or next week. Our revamp will change a lot of things, especially with new major features and a lot of design changes.

• NEW: API calling support now with image generation + editing, proper web search, code execution, auto prompt caching. Connect OpenAI, Anthropic and more.
• unsloth studio update should now work properly for Mac users
• Proper support for non-English languages e.g. Japanese, Chinese, Indian etc.

Many of you may have missed our previous release which only lasted for one day. We introduced:

• Connect to external inference backends: vLLM, Ollama, llama-server
• Security improvements

• Auto MTP speculative decoding for MTP GGUFs; get the best settings customized for your hardware.

API provider calling & external connections

• You can now connect Unsloth to any API cloud provider (OpenAI, Anthropic, OpenRouter etc.)
• Built-in web search for OpenAI, Anthropic, OpenRouter and Kimi
• Built-in code execution for OpenAI and Anthropic (Anthropic containers persist and are reused across turns)
• Prompt caching is enabled for OpenAI and Anthropic models saving 50 to 90% of costs.
• Image generation + editing
• API key now optional for local providers (llama.cpp / vLLM / Ollama)
• Auto-load models when adding a cloud provider

Other Unsloth Studio updates

• OpenDocument chat attachments
• o3 reasoning summary payload
• Sending/prompting non-English languages (e.g. Japanese, Chinese) now works properly
• IME composer hardening, RTL dir="auto", long log-line truncation fix
• Tool reasoning trace rendering in UI
• Fully offline support: cached GGUF discovery and offline DNS auto-detect for both inference and training

Unsloth Studio security improvements

• Authentication rate-limiting, proxy-aware so reverse proxies don't bypass it
• Sandboxed worker with a tightened blocklist (bash, hf upload, NOFILE)
• Path containment so workers can't escape their in-flight tmp dirs
• Strict schema validation across the Studio API
• Tightened CSP / security headers (only legitimate favicon hosts allowed)
• Removed the torch.load fallback on training_args.bin so untrusted pickles can never execute on model load
• Hardened Tauri desktop release flow
• Frontend auth: singleflight token refresh, current-password input on changes, working logout, shared 422 helper
• Cancel cleanup now scoped strictly to in-flight tmp dirs so it can never delete user state

What's Changed

• install: bump unsloth floor to >=2026.5.5 by @danielhanchen in install: bump unsloth floor to >=2026.5.5 #5621
• Studio: persist chat toggles and preserve custom sampling by @Imagineer99 in Studio: persist chat toggles and preserve custom sampling #5587
• Studio: add connections toggle and order hosted providers by @Imagineer99 in Studio: add connections toggle and order hosted providers #5588
• studio/ci: harden three pre-existing CI flakes by @danielhanchen in studio/ci: harden three pre-existing CI flakes #5627
• Studio: expand Connections model picker for local inference server by @Imagineer99 in Studio: expand Connections model picker for local inference server #5643
• Move uninstall scripts into scripts/ and fix references by @danielhanchen in Move uninstall scripts into scripts/ and fix references #5644
• Studio: provider model loading controls by @Imagineer99 in Studio: provider model loading controls #5645
• Studio: unify connection copy by @Imagineer99 in Studio: unify connection copy #5654
• Remove dead chat suggestions wiring by @alkinun in Remove dead chat suggestions wiring #5665
• Studio: Claude Code Anthropic API tool compatibility by @Imagineer99 in Studio: Claude Code Anthropic API tool compatibility #5390
• studio/frontend: friendlier 404 fallback for unknown routes by @danielhanchen in studio/frontend: friendlier 404 fallback for unknown routes #5664
• chore(deps): bump the npm-oxc-validator group across 1 directory with 2 updates by @dependabot[bot] in chore(deps): bump the npm-oxc-validator group across 1 directory with 2 updates #5667
• studio/chat: Disable send button for empty composer by @harryfrzz in studio/chat: Disable send button for empty composer #5647
• studio/frontend: correct Think pill aria-label before model loads by @danielhanchen in studio/frontend: correct Think pill aria-label before model loads #5655
• studio/frontend: fix onboarding CSP violations by @danielhanchen in studio/frontend: fix onboarding CSP violations #5658
• studio/frontend: set per-route document.title by @danielhanchen in studio/frontend: set per-route document.title #5660
• Fix Windows Tauri build and signing by @wasimysaid in Fix Windows Tauri build and signing #5694
• Respect GC for GRPO by @Datta0 in Respect GC for GRPO #5269
• studio: unblock /load event loop on detect_audio_type ([Bug] Win10 Unsloth Studio Run Model failed but llama.cpp run success. #5642, [Bug] [Windows11] unsloth studio run: server did not become healthy within 30 seconds when loading large GGUF model #5635) by @danielhanchen in studio: unblock /load event loop on detect_audio_type (#5642, #5635) #5669
• studio: settle GPU VRAM after killing llama-server before the next reload by @danielhanchen in studio: settle GPU VRAM after killing llama-server before the next reload #5693
• Studio: surface prompt-cache token counts in /v1/chat/completions usage chunk by @danielhanchen in Studio: surface prompt-cache token counts in /v1/chat/completions usage chunk #5670
• Studio: per-model Anthropic server-side tool versions by @danielhanchen in Studio: per-model Anthropic server-side tool versions #5679
• Studio: support Anthropic 1h cache TTL via prompt_cache_ttl by @danielhanchen in Studio: support Anthropic 1h cache TTL via prompt_cache_ttl #5685
• Studio: wire OpenAI image_generation tool by @danielhanchen in Studio: wire OpenAI image_generation tool #5688
• Studio: per-session cost calculator + /api/providers/pricing endpoint by @danielhanchen in Studio: per-session cost calculator + /api/providers/pricing endpoint #5690
• Studio: wire Anthropic web_fetch server-side tool by @danielhanchen in Studio: wire Anthropic web_fetch server-side tool #5671
• Studio: persist chat history in backend storage by @Imagineer99 in Studio: persist chat history in backend storage #5272
• Studio: wire Anthropic server-side context compaction by @danielhanchen in Studio: wire Anthropic server-side context compaction #5686
• Studio: wire OpenAI Responses server-side context compaction by @danielhanchen in Studio: wire OpenAI Responses server-side context compaction #5687
• Studio: PDF / document attachments for Anthropic + OpenAI by @danielhanchen in Studio: PDF / document attachments for Anthropic + OpenAI #5689
• Studio: reconcile external providers across browsers after delete by @danielhanchen in Studio: reconcile external providers across browsers after delete #5698
• Studio: persist external provider selection across page refresh by @danielhanchen in Studio: persist external provider selection across page refresh #5697
• Studio: add Anthropic and OpenAI prompt guards for disabled tools by @Imagineer99 in Studio: add Anthropic and OpenAI prompt guards for disabled tools #5674
• Studio: persist external checkpoint when picker uses setParams by @danielhanchen in Studio: persist external checkpoint when picker uses setParams #5700
• Studio: surface OpenAI image_generation as composer Images pill by @danielhanchen in Studio: surface OpenAI image_generation as composer Images pill #5699
• Studio: expose Anthropic 5m vs 1h prompt cache TTL in Configuration by @danielhanchen in Studio: expose Anthropic 5m vs 1h prompt cache TTL in Configuration #5703
• Fix connected chat model selection after refresh by @wasimysaid in Fix connected chat model selection after refresh #5702
• Studio: render OpenAI image_generation results inline in chat by @danielhanchen in Studio: render OpenAI image_generation results inline in chat #5705
• Truncate long code execution tool output by @wasimysaid in Truncate long code execution tool output #5708
• fix(gpt-oss): prefer flex attention over sdpa by @Datta0 in fix(gpt-oss): prefer flex attention over sdpa #5701
• Bump install.sh / install.ps1 pin to unsloth>=2026.5.6 by @danielhanchen in Bump install.sh / install.ps1 pin to unsloth>=2026.5.6 #5716
• ci: unblock Studio Windows + Linux + Mac smoke (supersedes Studio install: deterministic pydantic install on no-torch path #5733, ci: drop redundant pydantic/typer patch step from Windows smoke jobs #5734, Studio: gate change-password submit on current_password length #5738) by @danielhanchen in ci: unblock Studio Windows + Linux + Mac smoke (supersedes #5733, #5734, #5738) #5741
• ci: broaden Linux + narrow Windows llama.cpp runtime patterns + trim ci: unblock Studio Windows + Linux + Mac smoke (supersedes #5733, #5734, #5738) #5741 comments by @danielhanchen in ci: broaden Linux + narrow Windows llama.cpp runtime patterns + trim #5741 comments #5746
• Lower default RL weight_decay from 0.01 to 0.001 for LoRA by @danielhanchen in Lower default RL weight_decay from 0.01 to 0.001 for LoRA #5747
• Studio: strip orphan tool_call XML leaking into visible content by @danielhanchen in Studio: strip orphan tool_call XML leaking into visible content #5735
• Bump install.sh / install.ps1 pin to unsloth>=2026.5.7 by @danielhanchen in Bump install.sh / install.ps1 pin to unsloth>=2026.5.7 #5753
• Fix MLX Studio base model export save method by @Lyxot in Fix MLX Studio base model export save method #5727
• fix(chat_templates): check find() return value before slicing on placeholders by @Ricardo-M-L in fix(chat_templates): check find() return value before slicing on placeholders #5763
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in [pre-commit.ci] pre-commit autoupdate #5773
• Studio: stop seeded admin to cross-origin callers by @danielhanchen in Studio: stop seeded admin to cross-origin callers #5739
• Studio: surface external-provider cache hits and writes in context bar by @danielhanchen in Studio: surface external-provider cache hits and writes in context bar #5736
• Studio: Anthropic fast_mode toggle and streaming refusal handling by @danielhanchen in Studio: Anthropic fast_mode toggle and streaming refusal handling #5715
• Studio: rewrite OpenAI Responses citation markers to markdown links by @danielhanchen in Studio: rewrite OpenAI Responses citation markers to markdown links #5713
• Studio: standalone Fetch pill for Anthropic web_fetch by @danielhanchen in Studio: standalone Fetch pill for Anthropic web_fetch #5742
• Studio: surface Anthropic document citations inline + in Sources panel by @danielhanchen in Studio: surface Anthropic document citations inline + in Sources panel #5718
• Studio: pricing follow-up to Studio: per-session cost calculator + /api/providers/pricing endpoint #5690 (longest-prefix match + chat-style usage keys) by @danielhanchen in Studio: pricing follow-up to #5690 (longest-prefix match + chat-style usage keys) #5722
• Support follow-up edits for generated images by @wasimysaid in Support follow-up edits for generated images #5712
• Recipe Studio local model selector by @wasimysaid in Recipe Studio local model selector #5769
• Improve image generation UI by @wasimysaid in Improve image generation UI #5784
• Studio: per-card web_search result + shell_call output fallback (OpenAI) by @danielhanchen in Studio: per-card web_search result + shell_call output fallback (OpenAI) #5785
• Keep generated image loading dots animated by @wasimysaid in Keep generated image loading dots animated #5786
• Studio: auto-recover when shadowed 'unsloth' on PATH hides the frontend dist by @danielhanchen in Studio: auto-recover when shadowed 'unsloth' on PATH hides the frontend dist #5782
• studio/frontend: show "1 second" instead of "1 seconds" in thinking blocks by @oobabooga in studio/frontend: show "1 second" instead of "1 seconds" in thinking blocks #5777
• Studio: stop the model from replying twice when it refuses by @oobabooga in Studio: stop the model from replying twice when it refuses #5775
• studio/frontend: add space above the scroll-to-bottom arrow in chat by @oobabooga in studio/frontend: add space above the scroll-to-bottom arrow in chat #5776
• Fix unsloth studio update silently downgrading on macOS arm64 by @danielhanchen in Fix unsloth studio update silently downgrading on macOS arm64 #5767

New Contributors

• @harryfrzz made their first contribution in studio/chat: Disable send button for empty composer #5647
• @Lyxot made their first contribution in Fix MLX Studio base model export save method #5727
• @oobabooga made their first contribution in studio/frontend: show "1 second" instead of "1 seconds" in thinking blocks #5777

Full Changelog: v0.1.41-beta...0.1.417-beta

---

This discussion was created from the release An Update before Revamp!.