Skip to content
This repository has been archived by the owner on Sep 30, 2023. It is now read-only.

[Feature request] Add refact model #71

Open
bonswouar opened this issue Sep 12, 2023 · 0 comments
Open

[Feature request] Add refact model #71

bonswouar opened this issue Sep 12, 2023 · 0 comments

Comments

@bonswouar
Copy link

Would it be possible to add support for Refact model (released on September 4th)? https://huggingface.co/smallcloudai/Refact-1_6B-fim

Apparently it has much better results than StableCode, and as far as I understand it might even be lower on ram (1.6B vs 3B model)

Thanks for this great project btw! It's impressive how each month there are new models with even better results and (sometimes) lower hardware requirements, I hope at some point we'll be able to have some as good as GPT-4 models self-hosted on "normal" hardware :)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant