Make workers' errors derive from WorkerError

[albertvillanova]

Make workers' errors derive from WorkerError, instead of parent CustomError.

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.

[severo]

Thanks! It was incoherent

[albertvillanova]

Apparently there is (again) a connectivity issue with http://azure.archive.ubuntu.com mirrors...
I will relaunch the CI failed jobs later.

[severo]

OK, Azure seems to work again. And there is an issue with the types: the signatures are not exactly the same

[albertvillanova]

@severo, I have created GeneralWorkerError(WorkerError) and make errors in worker.py derive from it, while all workers' errors (inside workers dir) continue to derive from WorkerError.

Alternatively I could have renamed WorkerError to BaseWorkerError, create new WorkerError(BaseWorkerError) and make errors in worker.py derive from it, while all workers' errors (inside workers dir) now derive from BaseWorkerError.

What do you think is more clear?

[albertvillanova]

The CI error is unrelated to this PR: https://github.com/huggingface/datasets-server/actions/runs/4105164627/jobs/7081642597

src/datasets_based/worker_loop.py:100: error: "WorkerFactory" has no attribute "app_config"

See:

• Fix CI mypy error: "WorkerFactory" has no attribute "app_config" #778

[severo]

I think it's ok, now