Repository navigation
[mcp-analysis] MCP Structural Analysis - 2026-10-06 #66120
Closed
Replies: 1 comment
|
This discussion has been marked as outdated by GitHub MCP Structural Analysis. A newer discussion is available at Discussion #66550. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Tested 10 representative GitHub MCP tool calls across 9 toolsets today. Average usefulness for agentic work was 3.2/5. The standout finding:
list_code_scanning_alertsblew past the 25,000-token MCP response limit (134,672 chars / ~33.7K tokens) even with the requiredstate=open, severity=critical,highfilters applied — this toolset currently has no safe way to query a repo with many alerts. A second recurring pattern: nearly every single-item response (get_label,list_discussions,search_users,search_code) pads its payload with ~1.7KB of duplicated base64 server-icon metadata in_meta, unrelated to the actual data.Key Metrics
github_context: 5/5list_code_scanning_alerts: 1/5Recommendations
github_context(zero-overhead identity),get_file_contents(with directory-listing-first guard),list_pull_requests,list_workflows(mcpscripts wrapper),search_code.list_code_scanning_alerts(no pagination/head_limit escape hatch for large result sets — needs a wrapper like thelist_workflowsone),get_labelandsearch_users(thin fields, high relative icon-metadata overhead).github_context(100 tok),list_workflowsvia mcpscripts (172 tok),list_pull_requests(70 tok).list_code_scanning_alerts(33,668 tok, failed outright),get_file_contents(1,500 tok across the two-step directory-listing + file-fetch pattern).Full Structural Analysis Report
Executive Summary
github_context: 5/5list_code_scanning_alerts: 1/5Usefulness Ratings for Agentic Work
Schema Analysis
Response Size Analysis
Tool-by-Tool Analysis
30-Day Trend Summary
Visualizations
Response Size by Toolset
Usefulness Ratings
Daily Token Trend
Size vs Usefulness
References: §37459714970
All reactions