Update README.md

README.md

@@ -1,3 +1,36 @@
----
-license: apache-2.0
----
+---
+license: apache-2.0
+base_model:
+- TIGER-Lab/VL-Rethinker-7B
+base_model_relation: quantized
+pipeline_tag: visual-question-answering
+tags:
+- chat
+- mlx
+- apple
+- 8bit
+- multimodal
+language:
+- en
+library_name: mlx
+---
+# VL-Rethinker-7B 8-bit MLX
+
+This model was converted to MLX format from [`TIGER-Lab/VL-Rethinker-7B`](https://huggingface.co/TIGER-Lab/VL-Rethinker-7B) using mlx-vlm version **0.1.23**.
+
+Refer to the [original model card](https://huggingface.co/TIGER-Lab/VL-Rethinker-7B) for more details on the model.
+
+### Important!
+If you use LM Studio, do not update the MLX runtime to the latest version. The latest MLX runtime (0.13.1) has a bug, and the model crashes when you send images to it.
+Use previous mlx runtime **0.12.1**.
+
+
+## Use with mlx
+
+```bash
+pip install -U mlx-vlm
+```
+
+```bash
+python -m mlx_vlm.generate --model TheCluster/VL-Rethinker-7B-mlx-8bit --max-tokens 512 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
+```