Skip to content

Conversation

@paulorsousa
Copy link
Collaborator

This PR introduces comprehensive benchmark test suites for Redis Streams functionality, covering both simple stream reading and consumer group-based distributed processing scenarios with large-scale datasets.


Tests Added

1. memtier_benchmark-stream-10M-entries-xread-count-100.yml

  • Purpose: Tests XREAD performance with batch reading on large datasets
  • Dataset: Pre-loads 10M stream entries using XADD (100-byte messages)
  • Test: XREAD COUNT 100 operations reading from stream beginning
  • Use Case: Large-scale simple stream consumption without consumer groups

2. memtier_benchmark-stream-10M-entries-xreadgroup-count-100.yml

  • Purpose: Tests XREADGROUP performance with consumer groups on large datasets
  • Dataset: Pre-loads 10M stream entries, creates consumer group test-group
  • Test: XREADGROUP operations with COUNT 100 for distributed processing
  • Use Case: Large-scale consumer group-based stream processing

3. memtier_benchmark-stream-concurrent-xadd-xreadgroup-70-30.yml

  • Purpose: Tests concurrent producer/consumer workloads in real-time scenarios
  • Dataset: Starts with 500K pre-loaded stream entries
  • Test: Mixed workload with 70% XADD (producers) and 30% XREADGROUP (consumers)
  • Consumer Setup: Dual consumers (consumer1 / consumer2) with 15% ratio each for load distribution
  • Use Case: Real-world streaming applications with continuous production and consumption

Adds test coverage for Redis Streams operations including:
- XREAD with COUNT 100 on 200K pre-loaded entries
- XREADGROUP consumer group testing with COUNT 100
- Concurrent XADD/XREADGROUP workloads (70/30 ratio) with dual consumers
Copy link
Collaborator

@fcostaoliveira fcostaoliveira left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you @paulorsousa !

@fcostaoliveira fcostaoliveira merged commit 262325c into main Oct 20, 2025
0 of 8 checks passed
@fcostaoliveira fcostaoliveira deleted the feature/add-stream-xadd-xreadgroup-performance-test-suites branch October 20, 2025 15:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants