Skip to content

Conversation

@peter-gy
Copy link
Contributor

@peter-gy peter-gy commented Nov 20, 2025

Currently, arguments passed to the LiteLLM-based text projector such as api_key, api_base and sync invalidate the cache, even though they are not supposed to alter the embeddings returned by the request.

This PR addresses the issue by excluding these args from the hash computation.

Follow-up of #76.

Copy link
Collaborator

@donghaoren donghaoren left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Just one comment.

@donghaoren donghaoren merged commit 534ca9a into apple:main Nov 20, 2025
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants