tc-mb
commited on
Commit
Β·
7fee240
1
Parent(s):
bee21bd
update readme
Browse filesSigned-off-by: tc-mb <[email protected]>
README.md
CHANGED
@@ -161,6 +161,25 @@ We deploy MiniCPM-V 4.5 on iPad M4 with [iOS demo](https://github.com/tc-mb/Mini
|
|
161 |
<img src="https://raw.githubusercontent.com/openbmb/MiniCPM-o/main/assets/minicpmv4_5/v45_cn_travel.gif" width="45%" style="display: inline-block; margin: 0 10px;"/>
|
162 |
</div>
|
163 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
164 |
|
165 |
## Usage
|
166 |
|
|
|
161 |
<img src="https://raw.githubusercontent.com/openbmb/MiniCPM-o/main/assets/minicpmv4_5/v45_cn_travel.gif" width="45%" style="display: inline-block; margin: 0 10px;"/>
|
162 |
</div>
|
163 |
|
164 |
+
## Framework Support Matrix
|
165 |
+
| Category | Framework | Cookbook Link | Upstream PR | Supported since (branch) | Supported since (release) |
|
166 |
+
|---|---|---|---|---|---|
|
167 |
+
| **Edge (On-device)** | | | | | |
|
168 |
+
| | Llama.cpp | [Llama.cpp Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/llama.cpp/minicpm-v4_5_llamacpp.md) | [#15575](https://github.com/ggml-org/llama.cpp/pull/15575) (2025-08-26) | master (2025-08-26) | [b6282](https://github.com/ggml-org/llama.cpp/releases/tag/b6282) |
|
169 |
+
| | Ollama | [Ollama Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/ollama/minicpm-v4_5_ollama.md) | [#12078](https://github.com/ollama/ollama/pull/12078) (2025-08-26) | Merging | Waiting for official release |
|
170 |
+
| **Serving (Cloud)** | | | | | |
|
171 |
+
| | vLLM | [vLLM Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/vllm/minicpm-v4_5_vllm.md) | [#23586](https://github.com/vllm-project/vllm/pull/23586) (2025-08-26) | main (2025-08-27) | Waiting for official release |
|
172 |
+
| | SGLang | [SGLang Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/sglang/MiniCPM-v4_5_sglang.md) | [#9610](https://github.com/sgl-project/sglang/pull/9610) (2025-08-26) | Merging | Waiting for official release |
|
173 |
+
| **Finetuning** | | | | | |
|
174 |
+
| | LLaMA-Factory | [LLaMA-Factory Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/finetune/finetune_llamafactory.md) | [#9022](https://github.com/hiyouga/LLaMA-Factory/pull/9022) (2025-08-26) | main (2025-08-26) | Waiting for official release |
|
175 |
+
| **Quantization** | | | | | |
|
176 |
+
| | GGUF | [GGUF Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/gguf/minicpm-v4_5_gguf_quantize.md) | β | β | β |
|
177 |
+
| | BNB | [BNB Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/bnb/minicpm-v4_5_bnb_quantize.md) | β | β | β |
|
178 |
+
| | AWQ | [AWQ Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/awq/minicpm-v4_5_awq_quantize.md) | β | β | β |
|
179 |
+
| **Demos** | | | | | |
|
180 |
+
| | Gradio Demo | [Gradio Demo Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/demo/web_demo/gradio/README.md) | β | β | β |
|
181 |
+
|
182 |
+
> Note: If you'd like us to prioritize support for another open-source framework, please let us know via this [short form](https://docs.google.com/forms/d/e/1FAIpQLSdyTUrOPBgWqPexs3ORrg47ZcZ1r4vFQaA4ve2iA7L9sMfMWw/viewform).
|
183 |
|
184 |
## Usage
|
185 |
|