You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Tested 9 representative tools across the available GitHub MCP toolsets, measuring response size (tokens), schema structure, and usefulness for agentic work (1–5). Today's run consumed ≈8,400 tokens at an average usefulness of 3.33/5.
Headlines today:
🥇 Best (5/5):search_repositories and get_file_contents — flat, signal-dense, immediately actionable schemas.
🥉 Worst (1/5):get_me (403 "Resource not accessible by integration" — integration token lacks /user scope) and actions_list (permission denied — actions toolset not in this workflow's allow-list).
📈 Notable size shift:get_file_contents jumped to ~3,400 tokens (vs 340–700 recently) — not tool bloat, but because README.md itself ballooned with an auto-generated ~140-person "Community Contributions" block. Cost is 100% file-dependent.
🔁 Persistent structural bloat:list_code_scanning_alerts still inlines the full educational rule.help CWE markdown per alert (~70% of its payload). Tolerable at 1 alert (~1,300t), prohibitive at scale.
High-value but heavy (page/scope carefully):list_issues (~2,300t) and list_pull_requests (~1,000t) carry full bodies + redundant nested repo objects — request narrower fields or fewer items when only triaging.
Needs upstream improvement:list_code_scanning_alerts should move rule.help/full_description to an on-demand lookup rather than inlining per result.
File-dependent, not tool-dependent:get_file_contents cost tracks the file — prefer ranged/path-targeted reads on large docs like README.md.
Unavailable in this context:get_me (403) and actions_list (not granted) — agents should fall back to the injected github-context for identity rather than get_me.
Full Structural Analysis Report
Executive Summary
Metric
Value
Tools Analyzed
9
Total Tokens (Today)
≈8,400
Average Usefulness Rating
3.33/5
Best Rated Tool
get_file_contents / search_repositories: 5/5
Worst Rated Tool
get_me / actions_list: 1/5
Usefulness Ratings for Agentic Work
Tool
Toolset
Rating
Assessment
get_file_contents
repos
⭐⭐⭐⭐⭐
Clean envelope (sha-pinned uri + raw text); cost is file-driven
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
GitHub MCP Structural Analysis — 2026-06-16
Tested 9 representative tools across the available GitHub MCP toolsets, measuring response size (tokens), schema structure, and usefulness for agentic work (1–5). Today's run consumed ≈8,400 tokens at an average usefulness of 3.33/5.
Headlines today:
search_repositoriesandget_file_contents— flat, signal-dense, immediately actionable schemas.get_me(403 "Resource not accessible by integration" — integration token lacks/userscope) andactions_list(permission denied — actions toolset not in this workflow's allow-list).get_file_contentsjumped to ~3,400 tokens (vs 340–700 recently) — not tool bloat, but becauseREADME.mditself ballooned with an auto-generated ~140-person "Community Contributions" block. Cost is 100% file-dependent.list_code_scanning_alertsstill inlines the full educationalrule.helpCWE markdown per alert (~70% of its payload). Tolerable at 1 alert (~1,300t), prohibitive at scale.Key Metrics
search_repositories,get_file_contents— 5/5get_me,actions_list— 1/5Recommendations
search_repositories(~160t, 5/5),list_discussions(~180t, 4/5),get_label(~40t, 3/5) — minimal payloads with proper pagination envelopes.list_issues(~2,300t) andlist_pull_requests(~1,000t) carry full bodies + redundant nested repo objects — request narrower fields or fewer items when only triaging.list_code_scanning_alertsshould moverule.help/full_descriptionto an on-demand lookup rather than inlining per result.get_file_contentscost tracks the file — prefer ranged/path-targeted reads on large docs likeREADME.md.get_me(403) andactions_list(not granted) — agents should fall back to the injectedgithub-contextfor identity rather thanget_me.Full Structural Analysis Report
Executive Summary
get_file_contents/search_repositories: 5/5get_me/actions_list: 1/5Usefulness Ratings for Agentic Work
get_file_contentssearch_repositorieslist_issueslist_pull_requestslist_discussionslist_code_scanning_alertsget_labelget_meactions_listSchema Analysis
get_meget_file_contentslist_issueslist_pull_requestsactions_listlist_code_scanning_alertslist_discussionsget_labelsearch_repositoriesResponse Size Analysis (30-day avg by toolset)
Tool-by-Tool Analysis (today)
30-Day Trend Summary
Visualizations
Response Size by Toolset
Usefulness Ratings
Daily Token Trend
Size vs Usefulness
References: §27620807014
Beta Was this translation helpful? Give feedback.
All reactions