You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Sometimes a worker fails to build a test. This can occur due to a fault on the part of the test writer; a fault in the engine support mechanism in OpenBench; or possibly other means.
The result is a worker will often continually attempt and fail to build the same test, throwing errors to the client console and to the framework errors endpoints, and also wasting CPU time.
The remedy: Clients should keep a list of test ids that they failed to build, in config.blacklist. This black list can be sent alongside the machine_id and secret in the clientGetWorkload endpoint. As a "super" preliminary step, the server should filter out matching ids.
In safe_download_engine(), when catching OpenBenchBuildFailedException, add the test id to the config's blacklist.
Pass the configs blacklist in server_request_workload().
Pass the request object to get_workload in views.py's client_get_workload
Pass this through select_workload and filter_valid_workloads
In the very first step here, filter anything in request.POST['blacklist']
The text was updated successfully, but these errors were encountered:
Sometimes a worker fails to build a test. This can occur due to a fault on the part of the test writer; a fault in the engine support mechanism in OpenBench; or possibly other means.
The result is a worker will often continually attempt and fail to build the same test, throwing errors to the client console and to the framework errors endpoints, and also wasting CPU time.
The remedy: Clients should keep a list of test ids that they failed to build, in config.blacklist. This black list can be sent alongside the machine_id and secret in the clientGetWorkload endpoint. As a "super" preliminary step, the server should filter out matching ids.
safe_download_engine()
, when catchingOpenBenchBuildFailedException
, add the test id to the config's blacklist.server_request_workload()
.client_get_workload
The text was updated successfully, but these errors were encountered: