Releases
v1.2.0
Compare
Sorry, something went wrong.
No results found
We are excited to announce the release of RecIS v1.2.0 . This version brings offline server support, MFU/MFU metrics monitoring, sparse Adagrad optimizer, trace writer v2 , and syncs column-io 0.3.0 with comprehensive open-source cleanup.
🌟 Key Highlights
Category
Description
🏆 Framework
Offline Server support; Trace Writer v2 ; Sparse Adagrad optimizer; MFU metrics monitoring.
⚡ Performance
Optimized checkpoint save latency; Removed useless unique in grad worker mean.
🔧 Open-Source
Synced column-io 0.3.0 ; Fixed INTERNAL_VERSION conditional compilation; Removed internal submodule dependencies; Fixed from_list_string empty array bug.
🌐 Compatibility
Support build on multiple Python 3.x versions; Python 3.13 compatibility fixes.
📝 Detailed Changelog
Features
ci: parallelize twine upload (xargs -P 8) and fail-fast in yuque docs (ad19034 )
ci: recis ppu whl rename from [ppu] to [cuppu], same with column-io (f002e2a )
embedding: add custom combiner registry (9013818 )
embedding: embedding engine add insert api (43162fa )
embedding: EmbeddingEngine no_reduce returns post-a2a embedding (c366219 )
embedding: enable pinned memory for cpu hashtable (b2de2e7 )
embedding: support fp16 & bf16 in constant generator. (944967a )
feature_engine,ops,framework,embedding: add topk & ragged index functions. (d2f751b )
framework: add flops_metric in monitor by profiler (dfeae8b )
framework: add mos metric report and mean metric ops (899e0c0 )
framework: add stateful point type metric_sticky (6f4b940 )
framework: Align checkpoint management with openlm_hub standards (6b58e46 )
framework: enable export without sparse (925b8ac )
framework: impl sparse adagrad optimizer (223db4f )
framework: model bank load tf convert dense pkl (7aa8420 )
framework: offline_server支持更多的返回类型 (a5d3101 )
framework: python3.13移除cgi修复及微调metric采集逻辑 (a9824e2 )
framework: support build logic on multiple py3.x version (2198e1a )
framework: support offline server in recis (df9f3b3 )
framework: supports MFU metrics (either auto-calc or manually configured) (b626ef0 )
framework: trace_writer v2 (28436ca )
framework: 统一管理版本名称 & ⚠️ (breaking) 切换fslib模块的默认编译标准为abi=1 (8a14629 )
framework: update cmake to gt 3.28 (c15d1cf )
framework: upgrade fslib & open alog. (94d0ad5 )
framework: upgrade fslib to singleton version (144de86 )
io: add compress flag for _indicator handling (bc98afb )
io: adapted to old column_io version (20cd8b3 )
io: ComboOdpsDataset (744ea95 )
io: create trace partition via tunnel when supported (7c1b63d )
io: support user-defined tensor modules in dataset base (ec7b902 )
io: Trace hook compatibility with multi-cloud clusters (cf4702a )
io: Trace hook compatibility with specical clusters (d7dd61b )
ops: add compute real length op (4e73932 )
ops: add fused djb2hash and sdbmhash op (083cfdc )
ops: add multi hash ops for feature engine (8db9ae8 )
ops: add weight decay for adagrad, enable grad norm tool (f3c06a1 )
ops: support ppu170 sdk. (7fddf05 )
ops,framework: add mask op, update fg for search (9747f81 )
serialize: support save and load model without sparse (6d428b8 )
Bug Fixes
checkpoint: add storage prefix while update mos uri with xpfs. (4bf4cb1 )
checkpoint: fix bug about load optim when use accelerate (752953d )
checkpoint: fix bug of checkpointreader slowly (63520cc )
embedding: prevent CG probe index wraparound (fde78f7 )
embedding: remove duplicate ids & keep first while loading. (a529bc8 )
embedding,serialize: fix nan values during checkpoint loading (d7c35f3 )
framework: accelerator will warp named_optimizer to accelearte_optimizer (0d4a189 )
framework: correct file system checks for checkpoint retrieval (faa7f6c )
framework: create new version for model_export (3bbdebd )
framework: fix bug of grad accumulate (c739522 )
framework: fix bug when path not exists (770990e )
framework: fix peak FLOPS for gpu cards (c4b0d80 )
framework: fix RTP torch_fx_tool typo bug (bff6a4e )
framework: log_writer compile error in higher gcc version (30bb000 )
framework: refine logger hook and fix mos import (8b2bdf3 )
framework: sync after save (474cb15 )
framework: update search RTP export_torch_fx_tool (94faa8b )
io: do not save io state for odps window io (6daf86d )
io: fix bug of cannot append to ec file (ae97a1a )
io: io_state is saved along with the checkpoint (0592db9 )
io: remove lock and mp (442e854 )
io: return lake window end state (3db246c )
ops: fix 3D cutoff bounds check (f632547 )
ops: fix build issue in rocm (fe82734 )
ops: fix launch failure of cutoff (25f44ec )
ops: fix runtime dispatch in segment_reduce forward/backward, segment_mean, ragged_tile_backward for FP16/BFloat16 support (9c536ea )
serialize: fix issue of slow loading (efd2bcb )
serialize: read json file after writing done (5cf10b8 )
framework: do not report MOS metrics for checkpoints that have already been deleted (13297df )
Performance Improvements
framework,serialize: optimize checkpoint save latency (05046f5 )
ops,embedding: rm grad worker mean useless unique && useless item in gen_segment_ids (b79d61b )
Documentation
docs: add note abput using output_dir in model_bank (ac5239f )
docs: add notable work based on RecIS (b9a9e36 )
Build
build: update middle version (bcac5ec )
ci: fix package version for amd (a8f10cb )
Open-Source Cleanup
column-io: Sync column-io 0.3.0 from internal master with open-source cleanup
column-io: Fix INTERNAL_VERSION conditional compilation (py_interface, dataset_impl, arrow_reader links)
column-io: Fix cmake URLs to use GitHub public links (rapidjson, protobuf, googletest, zlib)
column-io: Clean up internal references (ODPS endpoints, internal paths, kmonitor dependencies)
column-io: Fix from_list_string empty array bug (prevent all([]) returning True)
column-io: Remove hardcoded Alibaba Cloud AccessKey from integration tests
column-io: Replace hardcoded ODPS paths with environment variables
framework: Remove internal submodule torch_fx_tool and conditionalize import
framework: Conditionalize openlm_hub import in mos.py
ci: Remove .aoneci/ directory
You can’t perform that action at this time.