Is there a way to create a mini model for MLX-LM implementation?

#29

by Goekdeniz-Guelmez - opened 11 days ago

11 days ago

Hello MiniMaxAI team,

I would love to implement this into MLX-LM but cant runn this model on my small 32GB M4, is there a way to create a small dummy model to test the MLX implementation?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment