Sweep: turn this into a warning

[sweep-nightly]

Description

This pull request modifies the behavior of the openai_call_embedding function within the vector_db.py file of the sweepai/core module. Specifically, it changes the logging level from error to warning when the token count exceeds the maximum allowed by the model during batch processing.

Summary

• Changed logging level from error to warning in vector_db.py when the token count exceeds the model's maximum context length.
• This modification ensures that exceeding the token limit is treated as a warning rather than an error, reflecting its non-critical nature.
• Affected file: sweepai/core/vector_db.py.

Fixes #3820.

---

💡 To get Sweep to edit this pull request, you can:

• Comment below, and Sweep can edit the entire PR
• Comment on a file, Sweep will only modify the commented file
• Edit the original issue to get Sweep to recreate the PR from scratch

This is an automated message generated by Sweep AI.

[sweep-nightly]

Rollback Files For Sweep

• Rollback changes to sweepai/core/vector_db.py

This is an automated message generated by Sweep AI.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
sweep-chat	🔄 Building (Inspect)	Visit Preview	💬 Add feedback	May 20, 2024 9:15pm
sweep-chat-demo	🔄 Building (Inspect)	Visit Preview	💬 Add feedback	May 20, 2024 9:15pm
sweep-docs	🔄 Building (Inspect)	Visit Preview	💬 Add feedback	May 20, 2024 9:15pm

[sweep-nightly]

Sweep: PR Review

sweepai/core/vector_db.py

The logging level for a specific token count exceeded message has been changed from error to warning.

Sweep Found These Issues

• Changing the log level from error to warning for the message about token count exceeding the model's maximum context length may reduce the visibility of this issue in production logs, potentially leading to delayed responses to this problem.

sweep/sweepai/core/vector_db.py

Line 190 in 9b2679e

logger.warning(f"Token count exceeded for batch: {max([tiktoken_client.count(text) for text in batch])} truncating down to 8192 tokens.")


View Diff

---