File size: 410 Bytes
e06b914 1d7f661 e06b914 1d7f661 e06b914 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
---
base_model:
- anthracite-org/magnum-v3-34b
pipeline_tag: text-generation
tags:
- awq
- text-generation-inference
---
## Model Details
This is a AWQ GEMV quant of magnum-v3-34b: https://huggingface.co/anthracite-org/magnum-v3-34b
### Model Description
Model has been quantized on 6xRTX4090, here are quantization parameters:
"zero_point": True,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMV"
|