feat: compact search default + brain_expand tool + entity dedup

[EtanHey]

Summary

• Compact search by default: brain_search now returns 150-char snippets + chunk_id pointers instead of full content (~60% token savings). Use detail="full" for verbose output.
• New brain_expand tool: First-class MCP tool to drill into specific search results — takes chunk_id and returns full content + surrounding context.
• Entity dedup in digest: _dedup_entities() deduplicates by (normalized_name, entity_type) before resolution — fixes duplicate entity references when content mentions the same entity multiple times.
• Vector similarity fallback: resolve_entity() now accepts optional embed_fn for cosine similarity matching (threshold 0.92 auto-match, 0.75 fuzzy match) when exact/alias/FTS fails.

Changes

File	Change
mcp/__init__.py	Register brain_expand tool (8 tools now), rename format → detail param, update server instructions
mcp/_shared.py	_build_compact_result() returns snippet (150 chars) + chunk_id instead of content (500 chars)
mcp/search_handler.py	Default detail="compact", backward compat for old format kwarg
pipeline/batch_extraction.py	New _dedup_entities() function, dedup before resolution
pipeline/digest.py	Response uses deduped entity list
pipeline/entity_resolution.py	resolve_entity() accepts embed_fn, vector similarity cascade (0.92/0.75 thresholds)

Test plan

• 17 new tests in tests/test_smart_search_entity_dedup.py
• Updated test_phase6_critical.py and test_search_routing.py for new compact format
• 642 tests pass, 0 failures

🤖 Generated with Claude Code

[coderabbitai]

Warning

Rate limit exceeded

@EtanHey has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 20 minutes and 42 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

📥 Commits

Reviewing files that changed from the base of the PR and between 26e4c5f and 2a66178.

📒 Files selected for processing (10)

• src/brainlayer/mcp/__init__.py
• src/brainlayer/mcp/_shared.py
• src/brainlayer/mcp/search_handler.py
• src/brainlayer/pipeline/batch_extraction.py
• src/brainlayer/pipeline/digest.py
• src/brainlayer/pipeline/entity_resolution.py
• tests/test_phase6_critical.py
• tests/test_search_routing.py
• tests/test_smart_search_entity_dedup.py
• tests/test_think_recall_integration.py

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch fix/smart-search-entity-dedup

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[greptile-apps]

Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.