Output bhr hangs for child processes #400
Conversation
|
( @BenWu ) |
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #400 +/- ##
==========================================
- Coverage 32.48% 32.47% -0.01%
==========================================
Files 36 36
Lines 3876 3877 +1
==========================================
Hits 1259 1259
- Misses 2617 2618 +1 ☔ View full report in Codecov by Sentry. |
BenWu
left a comment
BenWu
left a comment
There was a problem hiding this comment.
The changes make sense to me. I started running it on my computer but it's taking a long time so it hasn't finished yet. I'm happy to just merge it
| "use_s3": not use_gcs, | ||
| }, | ||
| ) | ||
| etl_job_daily( |
There was a problem hiding this comment.
I would say it's better to change the etl_job_daily function to reuse the intermediate results instead of running this twice but I doubt it's worth the effort. The job currently takes ~1.5 hours to run and this would double it
|
Updated job should run tomorrow. Status can be found in airflow https://workflow.telemetry.mozilla.org/dags/bhr_collection/grid |
3 participants
This PR just outputs an additional file containing hangs in child processes by piping through a config variable with the process name to filter on instead of hard-coding "Gecko."