Skip to content

Release v1.2.0

Latest

Choose a tag to compare

@github-actions github-actions released this 23 Jul 11:20

We are excited to announce the release of RecIS v1.2.0. This version brings offline server support, MFU/MFU metrics monitoring, sparse Adagrad optimizer, trace writer v2, and syncs column-io 0.3.0 with comprehensive open-source cleanup.

🌟 Key Highlights

Category Description
🏆 Framework Offline Server support; Trace Writer v2; Sparse Adagrad optimizer; MFU metrics monitoring.
⚡ Performance Optimized checkpoint save latency; Removed useless unique in grad worker mean.
🔧 Open-Source Synced column-io 0.3.0; Fixed INTERNAL_VERSION conditional compilation; Removed internal submodule dependencies; Fixed from_list_string empty array bug.
🌐 Compatibility Support build on multiple Python 3.x versions; Python 3.13 compatibility fixes.

📝 Detailed Changelog

Features

  • ci: parallelize twine upload (xargs -P 8) and fail-fast in yuque docs (ad19034)
  • ci: recis ppu whl rename from [ppu] to [cuppu], same with column-io (f002e2a)
  • embedding: add custom combiner registry (9013818)
  • embedding: embedding engine add insert api (43162fa)
  • embedding: EmbeddingEngine no_reduce returns post-a2a embedding (c366219)
  • embedding: enable pinned memory for cpu hashtable (b2de2e7)
  • embedding: support fp16 & bf16 in constant generator. (944967a)
  • feature_engine,ops,framework,embedding: add topk & ragged index functions. (d2f751b)
  • framework: add flops_metric in monitor by profiler (dfeae8b)
  • framework: add mos metric report and mean metric ops (899e0c0)
  • framework: add stateful point type metric_sticky (6f4b940)
  • framework: Align checkpoint management with openlm_hub standards (6b58e46)
  • framework: enable export without sparse (925b8ac)
  • framework: impl sparse adagrad optimizer (223db4f)
  • framework: model bank load tf convert dense pkl (7aa8420)
  • framework: offline_server支持更多的返回类型 (a5d3101)
  • framework: python3.13移除cgi修复及微调metric采集逻辑 (a9824e2)
  • framework: support build logic on multiple py3.x version (2198e1a)
  • framework: support offline server in recis (df9f3b3)
  • framework: supports MFU metrics (either auto-calc or manually configured) (b626ef0)
  • framework: trace_writer v2 (28436ca)
  • framework: 统一管理版本名称 & ⚠️(breaking) 切换fslib模块的默认编译标准为abi=1 (8a14629)
  • framework: update cmake to gt 3.28 (c15d1cf)
  • framework: upgrade fslib & open alog. (94d0ad5)
  • framework: upgrade fslib to singleton version (144de86)
  • io: add compress flag for _indicator handling (bc98afb)
  • io: adapted to old column_io version (20cd8b3)
  • io: ComboOdpsDataset (744ea95)
  • io: create trace partition via tunnel when supported (7c1b63d)
  • io: support user-defined tensor modules in dataset base (ec7b902)
  • io: Trace hook compatibility with multi-cloud clusters (cf4702a)
  • io: Trace hook compatibility with specical clusters (d7dd61b)
  • ops: add compute real length op (4e73932)
  • ops: add fused djb2hash and sdbmhash op (083cfdc)
  • ops: add multi hash ops for feature engine (8db9ae8)
  • ops: add weight decay for adagrad, enable grad norm tool (f3c06a1)
  • ops: support ppu170 sdk. (7fddf05)
  • ops,framework: add mask op, update fg for search (9747f81)
  • serialize: support save and load model without sparse (6d428b8)

Bug Fixes

  • checkpoint: add storage prefix while update mos uri with xpfs. (4bf4cb1)
  • checkpoint: fix bug about load optim when use accelerate (752953d)
  • checkpoint: fix bug of checkpointreader slowly (63520cc)
  • embedding: prevent CG probe index wraparound (fde78f7)
  • embedding: remove duplicate ids & keep first while loading. (a529bc8)
  • embedding,serialize: fix nan values during checkpoint loading (d7c35f3)
  • framework: accelerator will warp named_optimizer to accelearte_optimizer (0d4a189)
  • framework: correct file system checks for checkpoint retrieval (faa7f6c)
  • framework: create new version for model_export (3bbdebd)
  • framework: fix bug of grad accumulate (c739522)
  • framework: fix bug when path not exists (770990e)
  • framework: fix peak FLOPS for gpu cards (c4b0d80)
  • framework: fix RTP torch_fx_tool typo bug (bff6a4e)
  • framework: log_writer compile error in higher gcc version (30bb000)
  • framework: refine logger hook and fix mos import (8b2bdf3)
  • framework: sync after save (474cb15)
  • framework: update search RTP export_torch_fx_tool (94faa8b)
  • io: do not save io state for odps window io (6daf86d)
  • io: fix bug of cannot append to ec file (ae97a1a)
  • io: io_state is saved along with the checkpoint (0592db9)
  • io: remove lock and mp (442e854)
  • io: return lake window end state (3db246c)
  • ops: fix 3D cutoff bounds check (f632547)
  • ops: fix build issue in rocm (fe82734)
  • ops: fix launch failure of cutoff (25f44ec)
  • ops: fix runtime dispatch in segment_reduce forward/backward, segment_mean, ragged_tile_backward for FP16/BFloat16 support (9c536ea)
  • serialize: fix issue of slow loading (efd2bcb)
  • serialize: read json file after writing done (5cf10b8)
  • framework: do not report MOS metrics for checkpoints that have already been deleted (13297df)

Performance Improvements

  • framework,serialize: optimize checkpoint save latency (05046f5)
  • ops,embedding: rm grad worker mean useless unique && useless item in gen_segment_ids (b79d61b)

Documentation

  • docs: add note abput using output_dir in model_bank (ac5239f)
  • docs: add notable work based on RecIS (b9a9e36)

Build

  • build: update middle version (bcac5ec)
  • ci: fix package version for amd (a8f10cb)

Open-Source Cleanup

  • column-io: Sync column-io 0.3.0 from internal master with open-source cleanup
  • column-io: Fix INTERNAL_VERSION conditional compilation (py_interface, dataset_impl, arrow_reader links)
  • column-io: Fix cmake URLs to use GitHub public links (rapidjson, protobuf, googletest, zlib)
  • column-io: Clean up internal references (ODPS endpoints, internal paths, kmonitor dependencies)
  • column-io: Fix from_list_string empty array bug (prevent all([]) returning True)
  • column-io: Remove hardcoded Alibaba Cloud AccessKey from integration tests
  • column-io: Replace hardcoded ODPS paths with environment variables
  • framework: Remove internal submodule torch_fx_tool and conditionalize import
  • framework: Conditionalize openlm_hub import in mos.py
  • ci: Remove .aoneci/ directory