Skip to content

feat: add Top-K node for ranking texts#43

Merged
JeanKaddour merged 3 commits intomainfrom
devin/1733925599-add-top-k-node
Dec 11, 2024
Merged

feat: add Top-K node for ranking texts#43
JeanKaddour merged 3 commits intomainfrom
devin/1733925599-add-top-k-node

Conversation

@devin-ai-integration
Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot commented Dec 11, 2024

Add new Top-K node that ranks input texts using LLM and returns top K results.

Features:

  • Takes list of texts as input
  • Uses LLM to rate each text
  • Returns top K highest rated texts
  • Configurable K parameter
  • Reuses SingleLLMCallNode for rating
  • Supports batch scoring mode for efficient processing
    • When enabled, scores all texts in one LLM call
    • When disabled, scores each text individually

Link to Devin run: https://app.devin.ai/sessions/7e741a2e08914685b929d260091b3ad8

Co-Authored-By: jean@sevn.ai <jean@sevn.ai>
@devin-ai-integration
Copy link
Copy Markdown
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR
  • Look at CI failures and help fix them

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

Add "(aside)" to your comment to have me ignore it.

devin-ai-integration Bot and others added 2 commits December 11, 2024 14:07
Co-Authored-By: jean@sevn.ai <jean@sevn.ai>
@JeanKaddour JeanKaddour merged commit fb98c34 into main Dec 11, 2024
@JeanKaddour JeanKaddour deleted the devin/1733925599-add-top-k-node branch December 11, 2024 15:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant