Share your --measure or benchmark results #3
sravan27
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Show us your measured savings.
After running:
curl -fsSL https://raw.githubusercontent.com/sravan27/context-os/main/setup.sh | bash -s -- --measurePaste the output below along with:
If you want to go further, run the real benchmark:
git clone https://github.com/sravan27/context-os cd context-os scripts/benchmark.sh /path/to/your/repo --model sonnetIt parses real
claude --print --output-format jsonusage and reports input/output/cache/cost delta. Paste the JSON report from/tmp/cos-last-benchmark.jsonand we will add it to the README benchmark list (with your permission).My fixture (starting point)
On a trivial 2-file fixture:
On real repos with actual
node_modules, the savings get bigger, not smaller.Beta Was this translation helpful? Give feedback.
All reactions