Introducing Unsloth Desktop

[danielhanchen]

---

This discussion was created from the release Introducing Unsloth Desktop.

[NoMansPC]

My only gripe with it is that it defaults to 4k context when it thinks it might exceed my VRAM. I'd rather the default behavior was it using RAM too instead of limiting the context. Other than that, it's excellent. It makes it way more convenient.

[shimmyshimmer]

Thank you, would it be possible to make a github isue? Thanks!

[NoMansPC]

Thank you, would it be possible to make a github isue? Thanks!

Done.

[jiriteach]

This is awesome. I have two severs with GPU's running Unsloth Studio. Those run well but having Unsloth Desktop on my Macbook as a client would be awesome. I've connected them as custom connections from Unsloth Desktop - this works but many things are greyed out like code or search etc.
Wanting to use Unsloth desktop interface to code directly to local folders using models coming from my servers running Unsloth Studio. Would this be possible?

Thanks