Repository navigation
v1.3.0
Production stability and observability upgrade with MinerU 3.4.5, native long-document processing, cancellable engine isolation, and layered health diagnostics.
Highlights
- Upgrade the parsing engine to MinerU 3.4.5
- Reuse MinerU models in a persistent isolated process while keeping active parses cancellable
- Use MinerU's native bounded processing windows for long PDFs by default
- Add liveness, readiness, and detailed operational health endpoints
- Report Redis queue depth, Worker heartbeats, task runtime, GPU utilization, memory, temperature, and engine state
- Add engine timeout recovery and a Worker watchdog for stalled tasks
- Default to one active MinerU task per GPU for safer production operation
- Refresh the English and Chinese READMEs with a clearer quick start and deployment guidance
Reliability and compatibility
- Move blocking Celery waits and inspections off the FastAPI event loop
- Persist cancellation requests in Redis and safely terminate the isolated parsing engine
- Restart the engine automatically after cancellation, timeout, crash, or parse failure
- Probe configured S3 buckets during readiness checks with bounded waits
- Keep existing task submission and result response shapes compatible
- Retain physical PDF splitting only as a deprecated compatibility fallback
Upgrade notes
- Compare your existing
.envwith.env.example; repository updates do not modify existing environment files - Rebuild the MinerU base and Worker images:
cd docker && sh build.sh --worker-gpu --rebuild-base - Restart API, Worker, and cleanup containers so every service runs the new version
- Keep
WORKER_CONCURRENCY=1per GPU and scale by adding GPU workers - Ensure
WORKER_WATCHDOG_TIMEOUT_SECONDSis greater thanMINERU_ENGINE_TIMEOUT_SECONDS, andBROKER_VISIBILITY_TIMEOUT_SECONDSis greater than the watchdog timeout - Cancellation now returns
cancel_requested; poll until the task reachescancelledor another terminal state - Restrict
/api/v1/health/deepto trusted operators because it exposes detailed deployment diagnostics
See CHANGELOG.md for the complete change history.