Skip to content

Pipelime 1.9.0

Choose a tag to compare

@nfioraio-ec nfioraio-ec released this 27 Nov 11:57
· 75 commits to main since this release
cdd9a3c

What's Changed

🎉 New Features!

  • 🚸 last pipelime call (with no --ckpt option) is saved and can be replayed with pipelime resume (❗TUI partial inputs included❗)
    • 👉 actually, last 3 calls are cached: try this pipelime resume +ckpt 2 to replay the second-last
  • ✨ cat (both pipe and command) accepts multiple sequences with optional interleave flag
  • ✨ batched/unbatched pipes to group/ungroup multiple samples
  • ✨ InputDatasetInterface and OutputDatasetInterface accept a custom pipe; now you can:
    • ⚙️ add a custom processing on input/output dataset
    • 🔀 completely replace the data source with your own
    • ✏️ skip the default output underfolder

🪛 Many Fixes And UX Improvements!
*🪄 interactive context filling when, eg, some $vars are missing
*🧵 multiprocessing should now eat almost everything, lambda functions included

  • 🧑‍💻 better error reporting in case of malformed @command or failing imports
  • 📝 pipelime lc lists DAG commands in a separate section
  • 🚸 when pipelime help finds a pydantic Field with expand_help=True, such field will be expanded if the type is a BaseModel
  • 🐛 fixed split command with size 1

Full Changelog: v1.8.1...v1.9.0