Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Supported models #1

Open
veeral-patel opened this issue May 28, 2023 · 6 comments
Open

Supported models #1

veeral-patel opened this issue May 28, 2023 · 6 comments

Comments

@veeral-patel
Copy link

Thanks for this project! Which models are supported? Is it just GPT4 or others too?

@paolorechia
Copy link
Collaborator

Hi, @veeral-patel, this was built with local LLMs, using either text-generation-webui (https://github.com/oobabooga/text-generation-webui) or a HTTP server I wrote a while ago, that serves models from Hugging Face (https://github.com/paolorechia/learn-langchain).

That being said, it's not complex to write a new client.

For instance, see the client for the text-generation-webui:
https://github.com/paolorechia/code-it/blob/40b9ed946019bb24fa0e172edb679df73abb62ba/code_it/models.py#LL89C1-L116C6

If you want to use with OpenAI, you'd have to write a similar client here in this module.

@veeral-patel
Copy link
Author

Thanks! How's the performance with these models for code writing? Just curious, I've only used OpenAI

@paolorechia
Copy link
Collaborator

For simple examples, WizardLM performs quite ok: https://huggingface.co/TheBloke/wizardLM-7B-HF

Of course, it’s not as good as OpenAI gpt3.5-turbo.

This guy here has a nice table comparing them:
https://github.com/the-crypt-keeper/can-ai-code/tree/main

@veeral-patel
Copy link
Author

Cool! If it's not working I can write a plug-in for GPT3.5

Also, how well does this project integrate code into a repository?

Can it modify the relevant files itself for a feature or do we need to do it by hand

@paolorechia
Copy link
Collaborator

Not yet - that's one of my long term goals too, but I still haven't figured out how I would tackle this feature.

@veeral-patel
Copy link
Author

Take a look at AutoPR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants