Workers

Workers

What are HySDS jobs?

HySDS jobs are essentially celery tasks. More specifically, they are celery tasks that encapsulate the execution of some executable within a docker image. The celery task callable (hysds.job_worker.run_job) is responsible for setup, execution, and tear down of the job's work environment. Specifically, it ensures:

there is enough free space on the root work directory (threshold defaults to 10% free)

if there isn't, it cleans out old work directories until the threshold is met