tc-mb commited on
Commit
7fee240
Β·
1 Parent(s): bee21bd

update readme

Browse files

Signed-off-by: tc-mb <[email protected]>

Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -161,6 +161,25 @@ We deploy MiniCPM-V 4.5 on iPad M4 with [iOS demo](https://github.com/tc-mb/Mini
161
  <img src="https://raw.githubusercontent.com/openbmb/MiniCPM-o/main/assets/minicpmv4_5/v45_cn_travel.gif" width="45%" style="display: inline-block; margin: 0 10px;"/>
162
  </div>
163
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
164
 
165
  ## Usage
166
 
 
161
  <img src="https://raw.githubusercontent.com/openbmb/MiniCPM-o/main/assets/minicpmv4_5/v45_cn_travel.gif" width="45%" style="display: inline-block; margin: 0 10px;"/>
162
  </div>
163
 
164
+ ## Framework Support Matrix
165
+ | Category | Framework | Cookbook Link | Upstream PR | Supported since (branch) | Supported since (release) |
166
+ |---|---|---|---|---|---|
167
+ | **Edge (On-device)** | | | | | |
168
+ | | Llama.cpp | [Llama.cpp Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/llama.cpp/minicpm-v4_5_llamacpp.md) | [#15575](https://github.com/ggml-org/llama.cpp/pull/15575) (2025-08-26) | master (2025-08-26) | [b6282](https://github.com/ggml-org/llama.cpp/releases/tag/b6282) |
169
+ | | Ollama | [Ollama Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/ollama/minicpm-v4_5_ollama.md) | [#12078](https://github.com/ollama/ollama/pull/12078) (2025-08-26) | Merging | Waiting for official release |
170
+ | **Serving (Cloud)** | | | | | |
171
+ | | vLLM | [vLLM Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/vllm/minicpm-v4_5_vllm.md) | [#23586](https://github.com/vllm-project/vllm/pull/23586) (2025-08-26) | main (2025-08-27) | Waiting for official release |
172
+ | | SGLang | [SGLang Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/sglang/MiniCPM-v4_5_sglang.md) | [#9610](https://github.com/sgl-project/sglang/pull/9610) (2025-08-26) | Merging | Waiting for official release |
173
+ | **Finetuning** | | | | | |
174
+ | | LLaMA-Factory | [LLaMA-Factory Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/finetune/finetune_llamafactory.md) | [#9022](https://github.com/hiyouga/LLaMA-Factory/pull/9022) (2025-08-26) | main (2025-08-26) | Waiting for official release |
175
+ | **Quantization** | | | | | |
176
+ | | GGUF | [GGUF Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/gguf/minicpm-v4_5_gguf_quantize.md) | β€” | β€” | β€” |
177
+ | | BNB | [BNB Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/bnb/minicpm-v4_5_bnb_quantize.md) | β€” | β€” | β€” |
178
+ | | AWQ | [AWQ Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/awq/minicpm-v4_5_awq_quantize.md) | β€” | β€” | β€” |
179
+ | **Demos** | | | | | |
180
+ | | Gradio Demo | [Gradio Demo Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/demo/web_demo/gradio/README.md) | β€” | β€” | β€” |
181
+
182
+ > Note: If you'd like us to prioritize support for another open-source framework, please let us know via this [short form](https://docs.google.com/forms/d/e/1FAIpQLSdyTUrOPBgWqPexs3ORrg47ZcZ1r4vFQaA4ve2iA7L9sMfMWw/viewform).
183
 
184
  ## Usage
185