Getting an error on LM Studio + Parameters are not optimized also for LM Studio, please add a parameters file

#1
by alberkheijn - opened

Getting an error on LM Studio + Parameters are not optimized also for LM Studio, please add a parameters file
Screenshot 2025-03-18 at 04.46.11.png

LG AI Research org

Hello @alberkheijn , thank you for asking.

We have updated the guide for LM-Studio users in our GitHub README. Please refer to this section for instructions.

If you encounter any issues while following the guide, please let us know.

Hello @alberkheijn , thank you for asking.

We have updated the guide for LM-Studio users in our GitHub README. Please refer to this section for instructions.

If you encounter any issues while following the guide, please let us know.

And what about the rest of the parameters?

Screenshot 2025-03-18 at 05.24.57.png

LG AI Research org

According to our Usage Guideline, we use temperature=0.6 and top_p=0.95, and for GGUF models, we recommend repeat_penalty<=1.0 which matches your settings.
While we don't have specific guidelines for the top_k parameter, we haven't encountered any critical issues related to this parameter yet.

I believe your current settings should work well with EXAONE-Deep models.

This comment has been hidden (marked as Off-Topic)
This comment has been hidden (marked as Off-Topic)
This comment has been hidden (marked as Off-Topic)
This comment has been hidden (marked as Off-Topic)
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment