[mcp-analysis] MCP Structural Analysis - 2026-09-22 #62636
Closed
Replies: 1 comment
|
This discussion has been marked as outdated by GitHub MCP Structural Analysis. A newer discussion is available at Discussion #62941. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Overview
Tested 10 representative GitHub MCP tools across 9 toolsets plus the injected workflow-context block. Average usefulness today: 3.4/5. Response sizes ranged from 46 tokens (
list_pull_requests) to 36,602 tokens forlist_code_scanning_alerts, which again exceeded the MCP 25k-token hard limit and had to be read from a saved file rather than inline.Best rated:
github_context/list_workflows(5/5) — zero-cost identity block and the clean mcpscripts wrapper.Worst rated:
list_issues/list_code_scanning_alerts(2/5) — the former blocked by an integrity-policy redaction that recurs every single day (16/16); the latter now a stable steady-state condition, not a one-off spike (matches the 2026-09-15 measurement almost exactly: same 3 rule IDs, same ~30-alert scale).Full Structural Analysis Report
Executive Summary
github_context/list_workflows: 5/5list_issues/list_code_scanning_alerts: 2/5Usefulness Ratings for Agentic Work (Today)
github_contextlist_workflows(mcpscripts)search_codelist_pull_requestsget_file_contentslist_discussionsget_labelsearch_userslist_code_scanning_alertslist_issuesSchema Analysis
github_contextlist_workflowssearch_codelist_pull_requestsget_file_contentslist_discussionsget_labelsearch_userslist_code_scanning_alertslist_issuesResponse Size Analysis
Tool-by-Tool Analysis (Today)
github_contextlist_workflowslist_pull_requestssearch_codeget_labelsearch_userslist_discussionsget_file_contentslist_issueslist_code_scanning_alerts30-Day Trend Summary
code_securityandissueschronically low;actions/workflow_context/pull_requestschronically highRecommendations
github_context(free),list_workflowsvia the mcpscripts wrapper,list_pull_requestswith field selection,search_code(when not rate-limited).list_code_scanning_alerts— needs rule-level deduplication instead of repeating fullrule.full_description/helptext per instance (would cut ~36.6k tokens dramatically);list_issues— integrity-policy redaction has blocked one item on all 16 measured days and should be revisited.list_workflows,list_pull_requests,github_context.list_code_scanning_alerts(6,889 avg, up to 36.6k),get_file_contentswhen targeting growing files like README.md (peaked at 11,900 tokens on 2026-09-14).Visualizations
Response Size by Toolset
Usefulness Ratings
Daily Token Trend
Size vs Usefulness
References: §35724109792
Warning
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
api.anthropic.comTo allow these domains, add them to the
network.allowedlist in your workflow frontmatter:See Network Configuration for more information.
All reactions