Flows

Flows in cnvrg are production-ready machine learning pipelines that allow you to build complex DAG (directed acyclic graph) pipelines and run your ML components (tasks) with just drag-n-drop.

Each task in a flow is an ML component that is fully customizable and can run on different computes with different docker images.

For example, you can have feature engineering running on a Spark cluster, followed by a training task running on a GPU instance on AWS. Each run of the DAG will produce an experiment for fully tracked and reproducible machine learning.