Local Run?

[wenger9]

Hi, thanks for putting this neat library together!

Is there a way to run this locally? (Using a model from HF?)

[ibestvina]

Hi, thanks!

Sadly, it does not, and I'm no longer maintaining the library. But I'd be happy to accept a PR with local model support! I think switching to a library like Guidance [1] or Haystack [2] which support most of these models through the same interface would solve this easily.

[1] https://github.com/microsoft/guidance
[2] https://haystack.deepset.ai/

[wenger9]

Thank you very much! These resources are very helpful. I'd be happy to contribute when I learn more.