Workflow orchestration

workflow-orchestration · Data engineering and storage · skill

Also known as: workflow orchestration, job orchestration, pipeline orchestration, orchestration, experiment orchestration, orchestration layer.

Narrower concepts

• Airflow
• Dagster
• Flyte
• Kubeflow
• Metaflow
• Prefect
• Temporal

Also covered in

• Agent orchestration and durable execution
• Orchestrating ML pipelines with Airflow

Pathways that reach it

• AI forward deployed engineer
• MLOps / ML platform engineer