Max Tokens reached for initial discussion

#3
by knight7561 - opened

This is the response for hi to the chat agent:

Step 1

๐Ÿ’ฅ Error
Error in generating model output:
422 Client Error: Unprocessable Entity for url: https://api-inference.huggingface.co/models/Qwen/Qwen2.5-Coder-32B-Instruct/v1/chat/completions
Screenshot 2025-03-10 at 00.36.22.png

Input validation error: inputs tokens + max_new_tokens must be <= 16000. Given: 20453 inputs tokens and 2096 max_new_tokens
Make sure 'text-generation' task is supported by the model.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment