Update README.md (#1)
Browse files- Update README.md (bcb7c17edb14a49e66af896a07db4145236e0070)
Co-authored-by: Eric Hartford <[email protected]>
README.md
CHANGED
|
@@ -3,6 +3,8 @@ license: apache-2.0
|
|
| 3 |
---
|
| 4 |
I used AutoAWQ to quantize Kimi K2
|
| 5 |
|
|
|
|
|
|
|
| 6 |
```
|
| 7 |
$ docker run -it --rm \
|
| 8 |
--gpus all \
|
|
|
|
| 3 |
---
|
| 4 |
I used AutoAWQ to quantize Kimi K2
|
| 5 |
|
| 6 |
+
The base model is [here](https://huggingface.co/QuixiAI/Kimi-K2-Base-AWQ)
|
| 7 |
+
|
| 8 |
```
|
| 9 |
$ docker run -it --rm \
|
| 10 |
--gpus all \
|