Open
Description
Hermetic test is a fast way to verify functionality without requiring a real cluster.
We should test the traffic splitting between target models. A potential approach is to send a large number of requests (say 10000), and verify the traffic split ratio within a certain threshold.
Metadata
Metadata
Assignees
Labels
No labels