Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.
-
Updated
Apr 30, 2025 - Python
#
ai-benchmark
Here are 7 public repositories matching this topic...
An agent benchmark with tasks in a simulated software company.
-
Updated
Jun 13, 2025 - Python
GTA (Guess The Algorithm) Benchmark - A tool for testing AI reasoning capabilities
python docker flask benchmark machine-learning puzzle reverse-engineering educational pattern-recognition ctf binary-analysis algorithm-analysis computational-thinking algorithmic-reasoning ai-benchmark
-
Updated
Mar 23, 2025
GTA (Guess The Algorithm) Benchmark - A tool for testing AI reasoning capabilities
python docker flask benchmark machine-learning puzzle reverse-engineering educational pattern-recognition ctf binary-analysis algorithm-analysis computational-thinking algorithmic-reasoning ai-benchmark
-
Updated
Jan 12, 2025 - Python
🤖 A curated list of resources for testing AI agents - frameworks, methodologies, benchmarks, tools, and best practices for ensuring reliable, safe, and effective autonomous AI systems
testing qa benchmark machine-learning evaluation chaos artificial-intelligence chaos-monkey testing-tools awesome-list quality-assurance ai-safety ai-agents chaos-engineering llm llm-evaluation agentic-ai ai-benchmark agent-evaluation
-
Updated
May 28, 2025
PlayBench is a platform that evaluates AI models by having them compete in various games and creative tasks. Unlike traditional benchmarks that focus on text generation quality or factual knowledge, PlayBench tests models on skills like strategic thinking, pattern recognition, and creative problem-solving.
-
Updated
Jun 16, 2025 - Blade
MindTrial: Evaluate and compare AI language models (LLMs) on text-based tasks with optional file/image attachments. Supports multiple providers (OpenAI, Google, Anthropic, DeepSeek), custom tasks in YAML, and HTML/CSV reports.
nlp opensource openai customizable yaml-configuration golang-cli artificial-intelligence-projects html-reports csv-reports anthropic ai-tool deepseek llm-evaluation-framework google-gemini-ai llm-benchmarking language-models-ai llm-comparison ai-benchmark ai-evaluation-tools ai-model-comparison
-
Updated
Jun 18, 2025 - Go
Improve this page
Add a description, image, and links to the ai-benchmark topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-benchmark topic, visit your repo's landing page and select "manage topics."