v1.5

Fragua v1.5

Overview

New Features and Improvements

1. Declarative Pipelines with Macro Support

   • Users can now define pipelines declaratively using JSON/YAML-like definitions.
   • Added support for macros (e.g., transform_chain) that expand into multiple FraguaStep objects automatically.
   • Macros can chain multiple steps, set save_as for the final step, and integrate seamlessly into pipelines.

2. Enhanced compile_pipeline()

   • Pipeline compilation now detects macros and expands them before normalization and validation.
   • Step dependencies are automatically handled.
   • Maintains backward compatibility with standard step definitions.

3. StepIndex Integration Improvements

   • Automatic creation of FraguaStepBuilder when registering functions in a set.
   • Utility sets (tagered sets) can now be created to prevent automatic step builder generation.

4. PipelineBuilder Enhancements

   • Added support for adding multiple steps at once.
   • Pipelines can now be defined fully declaratively and compiled in one step.
   • Maintains compatibility with the Agent execution flow.

5. Macro Output Handling

   • Macros can define a save_as for the last step, allowing downstream steps to reference it naturally.
   • Avoids runtime dependency issues with macro names.

Bug Fixes & Optimizations

• Minor improvements in validation and error messages during pipeline compilation.
• Streamlined internal handling of FraguaStep and FraguaStepBuilder to reduce copying overhead.

---

This release continues the focus on flexible, declarative ETL pipelines while keeping the core minimal and stable.