Skip to content

[E2E] Add aibrix profile for E2E testing framework #660

@Xunzhuo

Description

@Xunzhuo

Description

Add a new aibrix profile to the E2E testing framework to test Semantic Router integration with vLLM AIBrix.

Background

The E2E testing framework introduced in #655 provides an extensible profile-based architecture. We need to add an aibrix profile to test Semantic Router deployment and functionality with vLLM AIBrix platform.

Tasks

  • Create e2e/profiles/aibrix/ directory structure
  • Implement Profile interface for aibrix
    • Setup: Deploy vLLM AIBrix components
    • Setup: Deploy Semantic Router with AIBrix integration
    • Setup: Configure AIBrix-specific settings
    • Teardown: Clean up AIBrix resources
  • Implement test cases:
    • Basic health check with AIBrix
    • AIBrix-specific feature verification
    • Request routing through AIBrix
    • Integration with AIBrix services
    • Performance and scalability testing
  • Add documentation for aibrix profile usage
  • Update CI workflow to run aibrix tests

Implementation Details

Profile Structure

type Profile struct {
    verbose bool
}

func (p *Profile) Setup(ctx context.Context, opts *framework.SetupOptions) error {
    // 1. Deploy vLLM AIBrix platform
    // 2. Deploy Semantic Router with AIBrix backend
    // 3. Configure AIBrix-specific features
    // 4. Configure integration settings
}

Test Cases

  1. AIBrix Health Check: Verify AIBrix platform is healthy
  2. Feature Verification: Test AIBrix-specific features
  3. Request Routing: Verify routing through AIBrix
  4. Service Integration: Test integration with AIBrix services
  5. Performance: Measure performance with AIBrix

Acceptance Criteria

  • AIBrix profile can be run with make e2e-test PROFILE=aibrix
  • All test cases pass successfully
  • Documentation is complete and clear
  • CI integration works correctly

References

Related Issues

Part of the E2E testing framework expansion effort.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions