Skip to content

v1.4.1

Choose a tag to compare

@wzdavid wzdavid released this 27 Sep 04:18
· 11 commits to main since this release

Productized multi-GPU and multi-worker deployment. Operators set card count and workers per card; Compose service blocks no longer need to be copied by hand.

Highlights

  • Add docker/gpu-up.sh and docker/render-gpu-workers.py to generate docker-compose.gpus.yml from MINERU_GPU_COUNT and MINERU_WORKERS_PER_GPU
  • Start all generated workers with profile mineru-multi-gpu; use MINERU_GPU_WORKER_ONLY=1 on dedicated GPU hosts
  • Keep GPU_WORKER_CONCURRENCY=1; scale by adding containers on the same card
  • Stop stale GPU workers (legacy names and extra slots) after Compose validation, before starting the new set
  • Validate the renderer in CI

Upgrade notes

  • Multi-GPU hosts: set MINERU_GPU_COUNT / MINERU_WORKERS_PER_GPU in docker/.env, then cd docker && sh gpu-up.sh
  • Do not also enable profile mineru-gpu alongside the generated workers
  • docker-compose.multi-gpu.yml remains as the legacy one-container-per-card template; do not run it beside gpu-up.sh
  • ThinkExtract: set INGESTION_MINERU_MAX_INFLIGHT ≈ worker total (or slightly higher) and keep backfill replicas above that limit
  • /health/deep now reports version 1.4.1

See CHANGELOG.md and docker/README.md for details.