Skip to content

NextRec v0.5.10

Choose a tag to compare

@zerolovesea zerolovesea released this 08 Feb 13:47
· 77 commits to main since this release
4d1cccf

NextRec v0.5.10 — Release Notes

New Features & Improvements

Features

  • Added ONNX model export and inference support via nextrec.utils.onnx_utils, enabling production deployment with ONNX Runtime. New tutorial example_onnx.py demonstrates the workflow.
  • Introduced NextRec Studio: a Vue3-based frontend application for visually configuring CLI YAML files (training, feature, model, predict configs). Supports Docker and script deployment.
  • Added CLI evaluate mode (--mode=evaluate) for standalone model evaluation with confusion matrix output and metric reporting.
  • Added multiprocessing prediction support (predict_onnx_streaming) for high-throughput batch inference with configurable worker count.
  • Added nextrec.utils.timing module for pipeline stage profiling, enabling detailed inference time cost analysis.
  • Improved numerical stability in ONNX export by replacing + eps with clamp operations.

Performance

  • Significantly accelerated data preprocessing (up to 9x speedup) in streaming mode and batch prediction pipelines.
  • Optimized inference speed through batching improvements and ONNX Runtime integration.
  • Added prefetch_factor configuration option for dataloader tuning.

CLI

  • Extended CLI with evaluate mode and evaluate_config.yaml preset template.
  • Fixed multiple CLI bugs including multiprocessing/threads issues, path resolution errors, extra params handling, and streaming predict edge cases.

Models

  • Minor alignment updates across ranking and multi-task models for improved ONNX compatibility.
  • Enhanced base model export logic for consistent input/output handling.

Fixes

  • Fixed CLI multi-processing/threads bug causing worker initialization failures.
  • Fixed CLI predict path resolution and configuration errors.
  • Fixed streaming predict corner cases with small batch sizes.
  • Improved error messages and validation in ONNX export utilities.

Tests

  • Added comprehensive ONNX model tests (test_onnx_models.py, test_onnx_predict_streaming.py) covering export, inference, and result validation.
  • Updated existing test suites for compatibility with new preprocessing flow.

Docs

  • Added NextRec Studio documentation (nextrec_studio/README.md, README_en.md) with deployment instructions.
  • Updated README to reflect v0.5.11, added ONNX tutorial reference.
  • Added evaluate_config.yaml preset with inline documentation.
  • Updated CLI docs (NextRec-CLI.md, NextRec-CLI_zh.md) with evaluate mode and multiprocessing options.