Add optional additional_query_params
config to provider DAGs
#3533
Labels
💻 aspect: code
Concerns the software code in the repository
🌟 goal: addition
Addition of new feature
🟩 priority: low
Low priority and doesn't need to be rushed
🧱 stack: catalog
Related to the catalog and Airflow DAGs
Problem
It would be nice to add a conf option to the provider DAGs called
additional_query_params
, which would be merged with the results ofget_next_query_params
for each batch.Description
An example use case for this option would be to run a provider DAG but restrict the search to a single user by adding a
user_id
query param to all requests.Additional context
This would be handy, for instance, when backfilling records for a single user, as we wanted to do in #3490.
The text was updated successfully, but these errors were encountered: