Skip to content

Beating the GAIA benchmark with Transformers Agents. ๐Ÿš€

License

Notifications You must be signed in to change notification settings

aymeric-roucher/GAIA

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

6 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

Beating GAIA with Transformers Agents ๐Ÿš€

This is the exact code used for our submission that scores #2 on the test set, #1 on the validation set.

GAIA leaderboard screenshot

Check out the current leaderboard here.

How to run tests?

First, install requirements:

pip install -r requirements.txt

Setup your secrets in a .envfile:

HUGGINGFACEHUB_API_TOKEN
SERPAPI_API_KEY
OPENAI_API_KEY
ANTHROPIC_API_KEY

And optionally if you want to use Anthropic models via AWS bedrock:

AWS_BEDROCK_ID
AWS_BEDROCK_KEY

Then run gaia.py to launch tests!

About

Beating the GAIA benchmark with Transformers Agents. ๐Ÿš€

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published