Build the pipeline without running

Pipeline builds are usually done implicitly when you run a pipeline on a docker-based orchestrator. But you are also able to just build a pipeline without running this. To do this you simply do this:

from zenml import pipeline

@pipeline

def my_pipeline(...):

...

my_pipeline.build()

You can see all pipeline builds with the command:

This will register the build output in the ZenML database and allow you to use the built images when running a pipeline later.

zenml pipeline builds list

To reuse a registered build when running a pipeline, pass it as an argument in Python

my_pipeline = my_pipeline.with_options(build=<BUILD_ID>)

or when running a pipeline from the CLI

zenml pipeline run <PIPELINE_NAME> --build=<BUILD_ID>

PreviousUse code repositories to automate Docker build reuse

NextDefine where an image is built

Last updated 19 days ago