Skip to content

benchflow-ai/smolclaw

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

[WIP] smolclaw

Mock environments for AI agent testing. Start with a fully seeded Gmail API — deterministic, resettable, and spec-compatible.

We are actively restructuring the repo to support more environments (Calendar, Drive, Slack) and adding reliability tests to existing ones.

Install

pip install smolclaws

Quick Start

Seed a Gmail environment with test data, then start the API server:

smolclaw seed --scenario default
smolclaw serve --port 8001 --no-mcp

The server exposes a Gmail-compatible REST API at http://localhost:8001/gmail/v1/.

Try it:

curl http://localhost:8001/gmail/v1/users/me/profile
curl http://localhost:8001/gmail/v1/users/me/messages

Interactive API docs are at http://localhost:8001/docs.

What's included

54 Gmail API endpoints — messages, threads, labels, drafts, settings, send-as, forwarding, delegates, vacation, filters, contacts, attachments.

Seedable scenariosdefault (~57 emails across realistic threads), long_context (~3000 emails), or per-task scenarios.

State management — snapshot, diff, and restore. Every API call is logged for evaluation.

smolclaw seed --scenario default    # seed + take initial snapshot
smolclaw reset                      # restore to initial state

Admin API — inspect state, view action logs, compute diffs via /_admin/ endpoints.

Scenarios

Scenario Emails Description
default ~57 Standard inbox with threads, labels, attachments
long_context ~3000 Stress test with high-volume realistic email

Configuration

smolclaw --db mydata.db seed         # custom database path
smolclaw serve --host 0.0.0.0        # bind to all interfaces
smolclaw serve --port 9000           # custom port

Development

git clone https://github.com/benchflow-ai/smolclaw.git
cd smolclaw
pip install -e ".[dev]"
pytest tests/

License

MIT

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors