Course
data-engineering-zoomcamp
Question
Why are dataset row counts computed in PostgreSQL instead of within the Kestra workflow?
Answer
Kestra is designed to orchestrate tasks rather than perform analytical computations. Row counts represent dataset-level analytics that are best computed in the database layer after ingestion, ensuring correctness and separation of responsibilities.
Checklist