eline_step_name="huggingface_model_deployer_step",model_name="LLAMA-7B",

model_uri="s3://zenprojects/huggingface_model_deployer_step/output/884/huggingface",

revision="main",

task="text-classification",

region="us-east-1",

vendor="aws",

token="huggingface_token",

namespace="zenml-workloads",

endpoint_type="public",

print(f"Model server {service.config['model_name']} is deployed at {service.status['prediction_url']}")

How to Interact with a model deployer after deployment?

When a Model Deployer is part of the active ZenML Stack, it is also possible to interact with it from the CLI to list, start, stop, or delete the model servers that is managed:

$ zenml model-deployer models list

┏━━━━━━━━┯━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┯━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┯━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓

┃ STATUS │ UUID                                 │ PIPELINE_NAME                  │ PIPELINE_STEP_NAME         ┃

┠────────┼──────────────────────────────────────┼────────────────────────────────┼────────────────────────────┨

┃   ✅   │ 8cbe671b-9fce-4394-a051-68e001f92765 │ seldon_deployment_pipeline     │ seldon_model_deployer_step ┃

┗━━━━━━━━┷━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┷━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┷━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛

$ zenml model-deployer models describe 8cbe671b-9fce-4394-a051-68e001f92765

Properties of Served Model 8cbe671b-9fce-4394-a051-68e001f92765

┏━━━━━━━━━━━━━━━━━━━━━━━━┯━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓

┃ MODEL SERVICE PROPERTY │ VALUE                                                                                  ┃

┠────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────┨

┃ MODEL_NAME             │ mnist                                                                                  ┃

┠────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────┨