NextRec v0.5.10
NextRec v0.5.10 — Release Notes
New Features & Improvements
Features
- Added ONNX model export and inference support via
nextrec.utils.onnx_utils, enabling production deployment with ONNX Runtime. New tutorialexample_onnx.pydemonstrates the workflow. - Introduced NextRec Studio: a Vue3-based frontend application for visually configuring CLI YAML files (training, feature, model, predict configs). Supports Docker and script deployment.
- Added CLI evaluate mode (
--mode=evaluate) for standalone model evaluation with confusion matrix output and metric reporting. - Added multiprocessing prediction support (
predict_onnx_streaming) for high-throughput batch inference with configurable worker count. - Added
nextrec.utils.timingmodule for pipeline stage profiling, enabling detailed inference time cost analysis. - Improved numerical stability in ONNX export by replacing
+ epswithclampoperations.
Performance
- Significantly accelerated data preprocessing (up to 9x speedup) in streaming mode and batch prediction pipelines.
- Optimized inference speed through batching improvements and ONNX Runtime integration.
- Added
prefetch_factorconfiguration option for dataloader tuning.
CLI
- Extended CLI with
evaluatemode andevaluate_config.yamlpreset template. - Fixed multiple CLI bugs including multiprocessing/threads issues, path resolution errors, extra params handling, and streaming predict edge cases.
Models
- Minor alignment updates across ranking and multi-task models for improved ONNX compatibility.
- Enhanced base model export logic for consistent input/output handling.
Fixes
- Fixed CLI multi-processing/threads bug causing worker initialization failures.
- Fixed CLI predict path resolution and configuration errors.
- Fixed streaming predict corner cases with small batch sizes.
- Improved error messages and validation in ONNX export utilities.
Tests
- Added comprehensive ONNX model tests (
test_onnx_models.py,test_onnx_predict_streaming.py) covering export, inference, and result validation. - Updated existing test suites for compatibility with new preprocessing flow.
Docs
- Added NextRec Studio documentation (
nextrec_studio/README.md,README_en.md) with deployment instructions. - Updated README to reflect v0.5.11, added ONNX tutorial reference.
- Added
evaluate_config.yamlpreset with inline documentation. - Updated CLI docs (
NextRec-CLI.md,NextRec-CLI_zh.md) with evaluate mode and multiprocessing options.