Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible Open Source models? #4

Open
karanravindra opened this issue Nov 30, 2023 · 1 comment
Open

Possible Open Source models? #4

karanravindra opened this issue Nov 30, 2023 · 1 comment

Comments

@karanravindra
Copy link

This would, in theory, work with non OpenAI Models as well right? It would be cool to use a model like LLAMA for it.

@tempdeltavalue
Copy link

tempdeltavalue commented Nov 30, 2023

you can check evaluate_email function and replace this

  completion = client.chat.completions.create(
      model="gpt-4", # switch to gpt-3.5-turbo for faster/ cheaper results (might be slightly less accurate)
      messages=[system_message, user_message],
      max_tokens=1,
      temperature=0.0,
  )

with your things, but completion should have same type and if you will run locally (сonsidering that giving away such personal data to OpenAI or anywhere else just seems strange.) maybe you need to think about batches and multiprocessing , etc ..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants