Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add framework for interfacing with arbitrary LLM #93

Open
caufieldjh opened this issue May 11, 2023 · 4 comments
Open

Add framework for interfacing with arbitrary LLM #93

caufieldjh opened this issue May 11, 2023 · 4 comments
Labels
enhancement New feature or request

Comments

@caufieldjh
Copy link
Member

Current dependency on OpenAI API means OntoGPT is set up to assume that it will make API calls to a that resource, but to use other APIs and local resources we will need to generalize our API calls.
Perhaps a modular implementation system a la OAK is appropriate.

@cmungall
Copy link
Member

or maybe just reuse an existing modular abstraction layer. Langchain?

@caufieldjh
Copy link
Member Author

Oh neat. I'm going to try that first.

@caufieldjh
Copy link
Member Author

caufieldjh commented May 30, 2023

Next steps:

  • Retrieve remote models if necessary - use process like OAK
  • Apply GPT4All models through Langchain
  • Apply other local models through Langchain
  • Tests for local models
  • Support non-OpenAI APIs
  • Tests for non-OpenAI APIs

@caufieldjh
Copy link
Member Author

Extra bonus step:

  • Add support for Huggingface Hub models through Langchain (note this needs to store another API key)

@caufieldjh caufieldjh added the enhancement New feature or request label Jul 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants