Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Apibench] Needs to be easy to query for which API and version fully supported #32

Open
yosun opened this issue Jun 2, 2023 · 1 comment
Labels
apibench-data APIBench data

Comments

@yosun
Copy link

yosun commented Jun 2, 2023

Needs to be easy to query for which API and version fully supported

@yosun yosun added the apibench-data APIBench data label Jun 2, 2023
@ShishirPatil
Copy link
Owner

@yosun Agree this would be a great value add to the users. If you have suggestions on this, and would like to raise a PR - happy to have you as a contributor!

ShishirPatil added a commit that referenced this issue Jul 18, 2023
Gorilla introduces Retriever Aware Training (RAT). Here we include the
code for retrievers. Note that while you can use {prompt + retrieved
API} with the 0-shot trained Gorilla LLMs for inference, for optimal
performance, we recommend you use {prompt + retrieved API} with RAT
trained Gorilla LLM for inference.

More precisely, BM25 refers to `BM25Okapi` and GPT refers to
`text-embedding-ada-002-v2`

Directly relevant to #58 and might be useful for #32 

+ Removing unused legacy code from `ast_eval_*.py`
+ Updating Apache 2.0 license for all of Gorilla code

---------

Co-authored-by: Tianjun <tianjunz@berkeley.edu>
devanshamin pushed a commit to devanshamin/gorilla that referenced this issue Jul 9, 2024
Gorilla introduces Retriever Aware Training (RAT). Here we include the
code for retrievers. Note that while you can use {prompt + retrieved
API} with the 0-shot trained Gorilla LLMs for inference, for optimal
performance, we recommend you use {prompt + retrieved API} with RAT
trained Gorilla LLM for inference.

More precisely, BM25 refers to `BM25Okapi` and GPT refers to
`text-embedding-ada-002-v2`

Directly relevant to ShishirPatil#58 and might be useful for ShishirPatil#32 

+ Removing unused legacy code from `ast_eval_*.py`
+ Updating Apache 2.0 license for all of Gorilla code

---------

Co-authored-by: Tianjun <tianjunz@berkeley.edu>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
apibench-data APIBench data
Projects
None yet
Development

No branches or pull requests

2 participants