Context Length Set to 8K?

#4
by Mazyod - opened

As far as I can tell, context length is set to 8K on Ollama and in the config.json. Is this intended? The readme states context length should be 128K.

Cohere For AI org

Apologies for the duplicate, didn’t realize closed issues are hidden. Thank you.

Mazyod changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment