Skip to content

Intent switch detection false switch fix#433

Merged
Thirunayan22 merged 87 commits into
buerokratt:wipfrom
rootcodelabs:llm-432
May 21, 2026
Merged

Intent switch detection false switch fix#433
Thirunayan22 merged 87 commits into
buerokratt:wipfrom
rootcodelabs:llm-432

Conversation

@nuwangeek
Copy link
Copy Markdown
Collaborator

This pull request introduces a configurable minimum cosine similarity threshold for API tool classification, allowing more flexible and context-sensitive matching. It also updates the API tool endpoint test data and removes an obsolete import YAML file. The most important changes are grouped below:

Semantic Search & Classification Logic

  • Added a min_cosine_override parameter to the semantic search (APISemanticSearcher.search) and classification (_try_api_tool_classification) methods, allowing callers to specify a custom minimum cosine threshold for matching. This enables more precise or relaxed matching depending on the context. The effective threshold is now always used for confidence evaluation and match filtering. [1] [2] [3] [4] [5] [6] [7]
  • Introduced the constant API_TOOL_INTENT_SWITCH_THRESHOLD (set to 0.50) to require a higher cosine similarity when abandoning an active session and switching user intent. The classifier now uses this stricter threshold during intent switching. [1] [2] [3]

Test Data Updates

  • Updated the get_vehicle_tax_info endpoint in test-endpoints.json with a new URL, method (GET), and expanded parameter list to reflect the latest API contract.
  • Added a new endpoint, check_legal_eligibility, to the test endpoints for broader test coverage.

Cleanup

  • Removed the obsolete DSL/Ruuter.private/rag-search/POST/ckb/agency_data_import.yml file, which is no longer needed.

nuwangeek and others added 30 commits February 20, 2026 16:06
Get update from wip into llm-316
get update from wip into llm-304
Service layer validation in tool classifier (buerokratt#321)
Pulling changes from BYK wip to LLM-Module WIP
Get update from wip into optimization/data-enrichment
Get update from optimization/data-enrichment into optimization/vector-indexer
nuwangeek and others added 26 commits April 17, 2026 13:12
Get  update from llm-394 into llm-345-dev
Get update from llm-394 into llm-403
Get update from llm-345-dev into llm-403
Get update from llm-403 into llm-408
Get update from llm-408 into llm-348
Integrate agentic loop with semantic searcher and streaming (buerokratt#420)
Implemented the API caller module (buerokratt#421)
CKB API integration for agency data sync (buerokratt#392)
Integrate CKB and RAG changelogs with schema updates for RAG (buerokratt#422)
@nuwangeek nuwangeek requested a review from Thirunayan22 May 11, 2026 09:53
@nuwangeek nuwangeek linked an issue May 14, 2026 that may be closed by this pull request
@Thirunayan22 Thirunayan22 merged commit a77ce99 into buerokratt:wip May 21, 2026
6 of 9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Intent switch detection false switch fix

3 participants