ail-benchmarks

a repo designed to test ail against SWEBench pro

git clone https://github.com/AlexChesser/ail-benchmarks.git
cd ail-benchmarks
cp .env.example .env
# fill in two API keys & ollama server
./bootstrap.sh
./run.sh --smoke

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
docker		docker
runners		runners
submodules		submodules
.env.example		.env.example
.gitignore		.gitignore
.gitmodules		.gitmodules
LICENSE		LICENSE
README.md		README.md
bootstrap.sh		bootstrap.sh
check_datasets.py		check_datasets.py
download_dataset.py		download_dataset.py
make_dataset_csv.py		make_dataset_csv.py
make_dataset_parquet.py		make_dataset_parquet.py
run.sh		run.sh
running-a-smoke-test.md		running-a-smoke-test.md

Navigation Menu

Repository files navigation

ail-benchmarks

About

Releases

Packages

Contributors

Languages

Folders and files

Latest commit

History

Repository files navigation

ail-benchmarks

About

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages