Pipelime 1.9.0
What's Changed
🎉 New Features!
- 🚸 last
pipelimecall (with no--ckptoption) is saved and can be replayed withpipelime resume(❗TUI partial inputs included❗)- 👉 actually, last 3 calls are cached: try this
pipelime resume +ckpt 2to replay the second-last
- 👉 actually, last 3 calls are cached: try this
- ✨
cat(both pipe and command) accepts multiple sequences with optionalinterleaveflag - ✨
batched/unbatchedpipes to group/ungroup multiple samples - ✨ InputDatasetInterface and OutputDatasetInterface accept a custom pipe; now you can:
- ⚙️ add a custom processing on input/output dataset
- 🔀 completely replace the data source with your own
- ✏️ skip the default output underfolder
🪛 Many Fixes And UX Improvements!
*🪄 interactive context filling when, eg, some $vars are missing
*🧵 multiprocessing should now eat almost everything, lambda functions included
- 🧑💻 better error reporting in case of malformed
@commandor failing imports - 📝
pipelime lclists DAG commands in a separate section - 🚸 when
pipelime helpfinds a pydanticFieldwithexpand_help=True, such field will be expanded if the type is aBaseModel - 🐛 fixed
splitcommand with size1
Full Changelog: v1.8.1...v1.9.0