Repository navigation
Highlights
🤖 A local AI agent
Chat with an LLM that runs entirely on your machine through llama.cpp. The new model library suggests GGUF models that fit your VRAM and shows how well each one handles tool calling. Prefer the cloud? Plug in your own OpenAI, Anthropic, Mistral, Groq or OpenRouter key. (#365)
🟥 AMD ROCm support
Modly now runs on AMD GPUs with ROCm, on Linux and Windows. See docs/running-on-amd-rocm.md. (#267)
💡 Point lights in the viewer
Add colored point lights to your scene, push their intensity up to 16×, and place them with move / rotate / scale gizmos. (#229)
🖨️ Open in OrcaSlicer
One click converts the mesh to STL and opens it straight in OrcaSlicer, imported meshes included. (#347)
🔗 Smarter workflows
Scene model artifacts flow between nodes, the new Preview Image node shows an image without running the workflow, and bounded float parameters get sliders. (#357, #205, #363)
⚙️ Model weights & stability
- Install and remove weight variants per node, shared weight groups across an extension, multiple Hugging Face sources per node. (#353, #348, #275)
- The LLM's VRAM is freed after a workflow runs, the process runner recovers from dead workers, and moving the workspace no longer loses output.
- Desktop notifications when a generation or workflow fails. (#294)
What's Changed
- fix(agent): surface HTTP errors from the unload_models tool by @kevin9327 in #286
- fix(agent): free the LLM's VRAM on the normal path after a workflow runs by @kevin9327 in #289
- feat(workflows): add a single-image preview node, fix text-only detection for multi-input models by @iammojogo-sudo in #205
- fix(extensions): recover worker after failed texture setup by @Souptik96 in #259
- feat(models): support multiple Hugging Face sources per node by @DrHepa in #275
- docs: add CONTRIBUTING.md and /assign command bot by @lightningpixel in #326
- feat: sync project board status with /assign and linked PRs by @lightningpixel in #330
- feat: add AMD ROCm support (Linux + Windows) by @lionrayonnant in #267
- fix(generate): read WORKSPACE_DIR dynamically so relocated output isn't lost by @kevin9327 in #287
- fix(workflow-runs): take part in the job TTL purge so the headless API doesn't leak by @kevin9327 in #288
- feat(mesh): add unified mesh operations registry by @DrHepa in #329
- feat(viewer): point lights with color, intensity and gizmos by @iammojogo-sudo in #229
- feat: add "Open in OrcaSlicer" export action by @wenghaishi in #347
- fix(generate): accept image drops from Explorer by @Yi-111-a in #360
- fix(workflows): multi-input nodes drop their audio slot by @sckid1108 in #359
- feat(ui): range sliders for bounded float parameters by @iammojogo-sudo in #363
- feat: notify with a desktop toast when a generation or workflow errors out by @iammojogo-sudo in #294
- feat(workflows): support scene model artifacts by @DrHepa in #357
- feat(models): support extension-scoped shared weight groups by @DrHepa in #348
- feat(models): install and remove weight variants per node by @Lorchie in #353
- fix(process-runner): settle a JS process run when its worker dies by @kevin9327 in #342
- fix(export,optimize): read WORKSPACE_DIR dynamically so edits work after the workspace moves by @kevin9327 in #340
- fix(process-runner): rebuild a cached runner when its workspace moves by @kevin9327 in #338
- feat(agent): llama.cpp engine, model library and cloud providers by @Lorchie in #365
New Contributors
- @lionrayonnant made their first contribution in #267
- @wenghaishi made their first contribution in #347
- @Yi-111-a made their first contribution in #360
- @sckid1108 made their first contribution in #359
Full Changelog: v0.4.2...v0.4.3
❤️ Support Modly
Modly is free, open source, and built in the open with a growing community of contributors. If it saves you time or you'd like to see it grow, you can support its development on GitHub Sponsors. Sponsorship directly funds the time spent building, testing and shipping releases like this one.
Not in a position to donate? A ⭐ on the repo, a bug report or sharing Modly with a friend helps just as much.
