llama-4-maverick-17b-128e-instruct-fp8 / serving_input_example.json
MLProductionization's picture
Upload folder using huggingface_hub
4a70849 verified
{
"messages": [
{
"role": "user",
"content": "Hello!"
},
{
"role": "assistant",
"content": "Hello! How can I assist you today?"
},
{
"role": "user",
"content": "What is Databricks?"
}
],
"max_tokens": 128
}