python - Job orchestration -

python - Job orchestration -

i redoing our database orchestration jobs (etl, backups, daily tasks, study compilation, etc.)

to that, need task/job orchestrator can define tasks dependency, time based tasks, async tasks, etc.

i looking @ celery , flow based programming technologies not sure these utilize case.

i looking more @ framework back upwards these things out of box. suggestions?

probably late, wanted mention job runner perchance other people arriving @ question.

from github repository readme.rst:

job-runner crontab tool, nice web-frontend administration , (live) monitoring current status.

features:

schedule recurring jobs chaining of jobs load-balance workers putting them in pool schedule jobs run on workers within pool live dashboard (with alternative kill runs , ad-hoc scheduling) multiple projects , per-project permission management

python scheduled-tasks orchestration