Reasons to use Kubeflow
Data collection
Metadata Tracking & Lineage
Kubeflow Metadata tracks:
-
Parameters passed to pipeline steps
-
Input and output artifacts (e.g. datasets, models)
-
Pipeline run context (who ran it, when, with what)
-
Execution lineage (which step produced which artifact)