This package solves the problem of managing a loosely coupled taskfarm where there are many tasks and the workers are entitrly independent of each other. Instead of using a farmer process a database is used to hand out new tasks to the workers. The workers contact a web application via http(s) to get a new task.
You can use the taskfarm-worker to connect to the taskfarm service.
See the documentation for installation instructions.
Hagdorn, M. and Gourmelen, N., 2023. Taskfarm: A Client/Server Framework for Supporting Massive Embarrassingly Parallel Workloads. Journal of Open Research Software, 11(1), p.1. DOI: 10.5334/jors.393
