【CI】Add test cases for n parameter and streaming validation #4503
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thanks for your contribution! |
EmmonsCurse
approved these changes
Oct 21, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation
当前 FastDeploy 在大模型推理接口中对 n 参数（多样本生成数量）和 stream 模式的行为未覆盖完整测试。
本 PR 旨在补充针对 n 参数的功能性验证与流式输出的正确性验证，以完善 API 层面测试覆盖度。
主要目标：
• 验证非流式场景下 n 参数输出条数与内容一致性
• 验证流式输出 (stream=True) 模式下多路输出的完整性与正确解码
• 保障接口在不同参数组合下的行为一致性与可回归性
Accuracy Tests
该 PR 仅补充测试用例，不涉及模型前向逻辑或算子实现，无需额外精度验证。