services, some of these operators are:

AWS LambdaAWS SageMaker

AWS EC2

Google Cloud Run

Google Compute Engine

Azure Container Instances

Heroku

To deploy your BentoML bundle to the cloud, you need to install the bentoctl CLI and the operator plugin for the cloud service you want to deploy to.

# Install bentoctl CLI

pip install bentoctl

# Install a choose operator

bentoctl operator install $OPERATOR # example: aws-lambda

Once you have the bentoctl CLI and the operator plugin installed, you can use the bentoctl CLI to deploy your BentoML bundle to the cloud.

# Let's get the name of the BentoML bundle we want to deploy

bentoml list

# Generate deployment configuration file

bentoctl init

# Build and push the Docker image to the cloud

bentoctl build -b $BENTO_TAG -f deployment_config.yaml

# Deploy to the cloud

bentoctl apply -f deployment_config.yaml

For more information and a full list of configurable attributes of the BentoML Model Deployer, check out the SDK Docs .

PreviousSeldon

NextHugging Face

Last updated 15 days ago