Skip to content

v1.3.0

Choose a tag to compare

@wzdavid wzdavid released this 02 Sep 11:28

Production stability and observability upgrade with MinerU 3.4.5, native long-document processing, cancellable engine isolation, and layered health diagnostics.

Highlights

  • Upgrade the parsing engine to MinerU 3.4.5
  • Reuse MinerU models in a persistent isolated process while keeping active parses cancellable
  • Use MinerU's native bounded processing windows for long PDFs by default
  • Add liveness, readiness, and detailed operational health endpoints
  • Report Redis queue depth, Worker heartbeats, task runtime, GPU utilization, memory, temperature, and engine state
  • Add engine timeout recovery and a Worker watchdog for stalled tasks
  • Default to one active MinerU task per GPU for safer production operation
  • Refresh the English and Chinese READMEs with a clearer quick start and deployment guidance

Reliability and compatibility

  • Move blocking Celery waits and inspections off the FastAPI event loop
  • Persist cancellation requests in Redis and safely terminate the isolated parsing engine
  • Restart the engine automatically after cancellation, timeout, crash, or parse failure
  • Probe configured S3 buckets during readiness checks with bounded waits
  • Keep existing task submission and result response shapes compatible
  • Retain physical PDF splitting only as a deprecated compatibility fallback

Upgrade notes

  • Compare your existing .env with .env.example; repository updates do not modify existing environment files
  • Rebuild the MinerU base and Worker images: cd docker && sh build.sh --worker-gpu --rebuild-base
  • Restart API, Worker, and cleanup containers so every service runs the new version
  • Keep WORKER_CONCURRENCY=1 per GPU and scale by adding GPU workers
  • Ensure WORKER_WATCHDOG_TIMEOUT_SECONDS is greater than MINERU_ENGINE_TIMEOUT_SECONDS, and BROKER_VISIBILITY_TIMEOUT_SECONDS is greater than the watchdog timeout
  • Cancellation now returns cancel_requested; poll until the task reaches cancelled or another terminal state
  • Restrict /api/v1/health/deep to trusted operators because it exposes detailed deployment diagnostics

See CHANGELOG.md for the complete change history.