Skip to content

bench: expand memory benchmarks to all data types#148

Merged
kacy merged 1 commit intomainfrom
bench/expand-memory-benchmarks
Feb 15, 2026
Merged

bench: expand memory benchmarks to all data types#148
kacy merged 1 commit intomainfrom
bench/expand-memory-benchmarks

Conversation

@kacy
Copy link
Copy Markdown
Owner

@kacy kacy commented Feb 15, 2026

summary

  • rewrites bench-memory.sh to test both ember modes (concurrent + sharded) and three data types (string, hash, sorted set)
  • adds optional --vector flag for vector memory measurement (ember only, uses python helper for VADD)
  • prints summary table with per-key bytes and saves CSV to bench/results/
  • complex type counts at 100k to keep runtime reasonable; strings at 1M (same as before)

what was tested

  • reviewed script logic for correct RSS measurement (before/after per type)
  • verified redis-cli --pipe approach for hash and sorted set bulk loading
  • confirmed vector helper script generates normalized vectors and uses VADD correctly

design considerations

  • each server instance is started fresh per data type to isolate memory measurements
  • vector test uses sharded mode only since concurrent mode only supports string ops
  • redis is skipped for vector (no VADD equivalent)

rewrites bench-memory.sh to cover:
- both ember modes (concurrent + sharded)
- string keys (1M, existing)
- hash keys (100k, 5 fields each)
- sorted set (100k members)
- vector (100k 128-dim, ember only, gated by --vector flag)
- summary table with per-key bytes for each type
- CSV output to bench/results/

complex type counts kept at 100k to keep runtime reasonable.
redis included for string/hash/zset comparisons but not vector.
@kacy kacy merged commit 69f29d9 into main Feb 15, 2026
7 checks passed
@kacy kacy deleted the bench/expand-memory-benchmarks branch February 15, 2026 13:11
kacy added a commit that referenced this pull request Feb 19, 2026
rewrites bench-memory.sh to cover:
- both ember modes (concurrent + sharded)
- string keys (1M, existing)
- hash keys (100k, 5 fields each)
- sorted set (100k members)
- vector (100k 128-dim, ember only, gated by --vector flag)
- summary table with per-key bytes for each type
- CSV output to bench/results/

complex type counts kept at 100k to keep runtime reasonable.
redis included for string/hash/zset comparisons but not vector.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant