-
Notifications
You must be signed in to change notification settings - Fork 296
Closed
Labels
area/test-and-releaseenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededpriority/P2Nice-to-Have / ExploratoryNice-to-Have / Exploratory
Description
Description
Add a new aibrix profile to the E2E testing framework to test Semantic Router integration with vLLM AIBrix.
Background
The E2E testing framework introduced in #655 provides an extensible profile-based architecture. We need to add an aibrix profile to test Semantic Router deployment and functionality with vLLM AIBrix platform.
Tasks
- Create
e2e/profiles/aibrix/directory structure - Implement
Profileinterface for aibrix- Setup: Deploy vLLM AIBrix components
- Setup: Deploy Semantic Router with AIBrix integration
- Setup: Configure AIBrix-specific settings
- Teardown: Clean up AIBrix resources
- Implement test cases:
- Basic health check with AIBrix
- AIBrix-specific feature verification
- Request routing through AIBrix
- Integration with AIBrix services
- Performance and scalability testing
- Add documentation for aibrix profile usage
- Update CI workflow to run aibrix tests
Implementation Details
Profile Structure
type Profile struct {
verbose bool
}
func (p *Profile) Setup(ctx context.Context, opts *framework.SetupOptions) error {
// 1. Deploy vLLM AIBrix platform
// 2. Deploy Semantic Router with AIBrix backend
// 3. Configure AIBrix-specific features
// 4. Configure integration settings
}Test Cases
- AIBrix Health Check: Verify AIBrix platform is healthy
- Feature Verification: Test AIBrix-specific features
- Request Routing: Verify routing through AIBrix
- Service Integration: Test integration with AIBrix services
- Performance: Measure performance with AIBrix
Acceptance Criteria
- AIBrix profile can be run with
make e2e-test PROFILE=aibrix - All test cases pass successfully
- Documentation is complete and clear
- CI integration works correctly
References
- E2E Framework PR: [Feat] Add automate e2e test framework for extensible integration tests #655
- vLLM AIBrix Documentation: (add link)
- E2E Framework README:
e2e/README.md
Related Issues
Part of the E2E testing framework expansion effort.
- Related to [E2E] Add Istio profile for E2E testing framework #656 (Istio profile)
- Related to [E2E] Add production-stack profile for E2E testing framework #657 (production-stack profile)
- Related to [E2E] Add llm-d profile for E2E testing framework #658 (llm-d profile)
- Related to [E2E] Add dynamo profile for E2E testing framework #659 (dynamo profile)
Metadata
Metadata
Assignees
Labels
area/test-and-releaseenhancementNew feature or requestNew feature or requesthelp wantedExtra attention is neededExtra attention is neededpriority/P2Nice-to-Have / ExploratoryNice-to-Have / Exploratory