-
Notifications
You must be signed in to change notification settings - Fork 4.5k
Open
Description
Native engine metrics are updated on finishBundle by DoFnRunners. Spark uses SimpleDoFnRunner that is in runner-core and thus contains nothing spark native. It might be good to extend SimpleDoFnRunner to add native metrics support just like it was done in Flink with DoFnRunnerWithMetrics class.
Imported from Jira BEAM-5212. Original Jira may contain additional context.
Reported by: echauchot.
Reactions are currently unavailable