Skip to content

Pipelime 1.8.0

Choose a tag to compare

@nfioraio-ec nfioraio-ec released this 20 Sep 08:38
· 141 commits to main since this release
a21c274

What's Changed

  • πŸŽ‰ Big news:
    • πŸ›Έ Resume from checkpoint! -> especially when you run a DAG
    • πŸ§‘β€πŸ’» When you import a python symbol, eg, $symbol, CallableDef etc, now you can even use plain python code or lambda -> and it is fully compatible with a multi-process grabber!
    • πŸ§‘β€πŸ’» CLI: no need to repeat a +/@ option when you want to append a value -> see the docs
  • πŸ•ΈοΈ DAG news:
    • πŸ›Έ Resume/Replay a DAG
    • ✏️ Advanced node selection -> see the docs
    • 🐍 Python DAGs:
      • πŸ“ Checkout the docs
      • πŸ§‘β€πŸ’» create_graph can return a list of (lazy) PipelimeCommands: node names will be auto-generated
      • πŸ—‘οΈ Temp folder is not automatically delete if you use --keep-tmp
  • ✨ Commands, stages and pipes:
    • stage-time command to measure the average time spent by each stage of a pipeline
    • resume command to load and run a Pipelime checkpoint
    • map-if command to apply a stage only on a subset of samples
    • repeat now accepts floating point values to repeat a sequence a fractional number of times
  • 🚢 General improvements:
    • πŸ§‘β€πŸ’» PipelimeTmp.make_session_dir() now always returns a subfolder of the Pipelime session temp folder
    • πŸ› @command now correctly manages submodel parameters
    • ✨ Input/Output interface now have a default piper port
    • ✨ The pydantic type NewPath can check or set the extension for you

Full Changelog: v1.7.0...v1.8.0