Skip to content

Conversation

@dannykopping
Copy link
Collaborator

@dannykopping dannykopping commented Nov 11, 2025

The order of the injected MCP tools was always changing, which busted the cache.

Before:

  ⎿ Total cost:            $0.58                                   
    Total code changes:    357 lines added, 0 lines removed        
    Usage by model:                                                      
           claude-sonnet:  39 input, 5.0k output, 109.3k cache     
    read, 125.2k cache write ($0.58)    <-- note the high cache writes

After:

  ⎿  Total cost:            $0.1691
     Total code changes:    336 lines added, 0 lines removed
     Usage by model:
            claude-sonnet:  21 input, 4.4k output, 130.9k cache
     read, 15.0k cache write ($0.1616)

Signed-off-by: Danny Kopping <danny@coder.com>
@dannykopping dannykopping requested a review from pawbana November 11, 2025 14:53
@dannykopping dannykopping self-assigned this Nov 11, 2025
Signed-off-by: Danny Kopping <danny@coder.com>
Signed-off-by: Danny Kopping <danny@coder.com>
Signed-off-by: Danny Kopping <danny@coder.com>
@dannykopping dannykopping merged commit cc9fa29 into main Nov 12, 2025
dannykopping added a commit that referenced this pull request Nov 12, 2025
Signed-off-by: Danny Kopping <danny@coder.com>
dannykopping added a commit to coder/coder that referenced this pull request Nov 12, 2025
coder/aibridge#49 fixed an issue with tool
ordering which was busting the cache and leading to increased costs

Signed-off-by: Danny Kopping <danny@coder.com>
dannykopping added a commit to coder/coder that referenced this pull request Nov 12, 2025
coder/aibridge#49 fixed an issue with tool
ordering which was busting the cache and leading to increased costs

Signed-off-by: Danny Kopping <danny@coder.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants