Namespace an Input Dataset

[thomasdurkin]

Is there a way for me to namespace the input dataset (policies_raw) so I dynamically choose which one to load? For example I want to use policies_raw in Product1 folder for one pipeline run and then use policies_raw in Product2 folder.

process_pipes = []
     for product, sponsors in settings.DYNAMIC_PIPELINES_MAPPING.items():
          for sponsor in sponsors.keys():
               process_pipes.append(
                    pipeline(
                         pipe_processing,
                         inputs=["policies_raw"],
                         namespace=f"{product}.{sponsor}",
                         tags=settings.DYNAMIC_PIPELINES_MAPPING[product][sponsor],
                    )
               )