Add support for selfhost models like ChatGLM or transformer models
Is there any chance to add support for selfhost models like ChatGLM or transformer models.
Tried to use runhouse with model “ChatGLM-6B”, but not working.