Batch Translation Support for DeepSeek #433
rtalmaci
started this conversation in
Ideas & Feature requests
Replies: 2 comments 1 reply
|
The thing is, the DeepSeek docs indicate that the feature isn't reliable, it suffers from empty content, truncation, etc. The feature I'm waiting for to add batching is structured output, like the other services offer. Otherwise you're shipping a feature that looks like an optimization but introduces reliability regressions that are hard to trace back to their root cause. |
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Feature Request: Batch Translation Support for DeepSeek
Summary
Add support for batch translation in
DeepSeekServiceby implementing theIBatchTranslationServiceinterface.Proposed Implementation
DeepSeekServiceto implementIBatchTranslationService.InitializeAsyncto load retry settings (MaxRetries, RetryDelay, RetryDelayMultiplier) from configuration.TranslateBatchAsyncwith a retry loop handlingTooManyRequests(429) andServiceUnavailable(503) status codes.TranslateBatchWithDeepSeekApiusing DeepSeek's JSON mode (response_format: { type: "json_object" }).StructuredBatchResponseand merge using the baseMergeByPositionhelper.Benefits
I can open PR with the changes
All reactions