Skip to content

Add comprehensive tool coverage for Serena MCP tests across all languages#364

Merged
lpcox merged 4 commits intomainfrom
copilot/test-serena-tool-calls
Jan 19, 2026
Merged

Add comprehensive tool coverage for Serena MCP tests across all languages#364
lpcox merged 4 commits intomainfrom
copilot/test-serena-tool-calls

Conversation

Copy link
Contributor

Copilot AI commented Jan 19, 2026

The Serena test suite only tested 2 of 23 available MCP tools. Extended coverage to test all tools across all supported languages (Go, Java, JavaScript, Python).

Changes

test_serena.sh

  • Added test_tool_for_language() helper for consistent MCP protocol testing
  • Added 22 test cases covering:
    • File operations: list_dir, find_file, search_for_pattern
    • Symbol operations: find_referencing_symbols, replace_symbol_body, insert_after_symbol, insert_before_symbol, rename_symbol
    • Memory: write_memory, read_memory, list_memories, edit_memory, delete_memory
    • Configuration: activate_project, get_current_config
    • Onboarding: check_onboarding_performed, onboarding
    • Thinking: think_about_collected_information, think_about_task_adherence, think_about_whether_you_are_done
    • Instructions: initial_instructions
  • Language-specific tools (11 tools) tested for all 4 languages; others tested language-independently
  • Test count: 13 → 35

README.md

  • Updated tool categorization and response file documentation

Example

Helper function generates proper MCP JSON-RPC requests:

test_tool_for_language "Go" "list_dir" \
  ',"arguments":{"relative_path":"go_project"}' \
  "go_project" 1001 "Go_list_dir_response.json"

Generates:

{"jsonrpc":"2.0","id":1001,"method":"tools/call",
 "params":{"name":"list_dir","arguments":{"relative_path":"go_project"}}}

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Copilot AI and others added 3 commits January 19, 2026 18:04
…guages

Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>
Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>
Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>
Copilot AI changed the title [WIP] Add tests for serena tool calls across supported languages Add comprehensive tool coverage for Serena MCP tests across all languages Jan 19, 2026
Copilot AI requested a review from lpcox January 19, 2026 18:12
@lpcox lpcox marked this pull request as ready for review January 19, 2026 18:23
@lpcox lpcox merged commit 6a300ec into main Jan 19, 2026
@lpcox lpcox deleted the copilot/test-serena-tool-calls branch January 19, 2026 18:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants