Disable Think text

#11
by rjsng0904 - opened

Hi, I am trying to use this model for a special case, is there any way to disable "Think" text generation, and will it result in faster inference. Thanks

i dont think its possible to disable thinking generation as its the way that the model work, they spit out first and then from there it will output the actual respond that you use

Sign up or log in to comment