Like BEAM-4176, but 1) for Python; 2) there is no baseline; 3) the set of ValidatesRunner tests for Python is currently very small and needs to be expanded (BEAM-4214).
Imported from Jira BEAM-4213. Original Jira may contain additional context.
Reported by: jkff.