Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Conversation

@vansangpfiev
Copy link
Contributor

This pull request introduces several changes to the remote-engine component, focusing on enhancing the handling of streaming requests, improving status management, and adding new test cases. The most important changes include modifications to the StreamWriteCallback function, updates to the RemoteEngine::MakeStreamingChatCompletionRequest and RemoteEngine::HandleChatCompletion methods, and the addition of new test cases for the RemoteEngineTest suite.

Enhancements to streaming request handling:

Improved status management:

Template rendering improvements:

New test cases:

  • engine/test/components/test_remote_engine.cc: Added new test cases CohereRequest and CohereResponse to verify the correct handling of Cohere-specific requests and responses, including both streaming and non-streaming scenarios.## Describe Your Changes

Fixes Issues

  • Closes #
  • Closes #

Self Checklist

  • Added relevant comments, esp in complex areas
  • Updated docs (for bug fixes / features)
  • Created issues for follow-up changes or refactoring needed

@vansangpfiev vansangpfiev changed the base branch from dev to main January 14, 2025 04:14
Copy link
Contributor

@nguyenhoangthuan99 nguyenhoangthuan99 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@vansangpfiev vansangpfiev merged commit ccece16 into main Jan 15, 2025
6 checks passed
@vansangpfiev vansangpfiev deleted the chore/cohere branch January 15, 2025 04:15
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants