LLMs quantized with GPTQ
Irina Proskurina
iproskurina
AI & ML interests
LLMs: quantization, pre-training
Recent Activity
liked
a dataset
about 10 hours ago
manueltonneau/french-hate-speech-superset
updated
a model
about 11 hours ago
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-G2S0
published
a model
about 11 hours ago
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-G2S0
Organizations
Collections
4
models
45
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-G2S0
Text Generation
•
Updated
iproskurina/Mistral-7B-v0.3-GPTQ-4bit-G3S0
Text Generation
•
Updated
iproskurina/Mistral-7B-v0.3-GPTQ2-4bit-g3
Text Generation
•
Updated
•
20
iproskurina/Mistral-7B-v0.3-GPTQ2-4bit-g2
Text Generation
•
Updated
•
3
iproskurina/Mistral-7B-v0.3-GPTQ2-4bit-g1
Text Generation
•
Updated
•
2
iproskurina/opt-125m-gptq2
Text Generation
•
Updated
•
4
iproskurina/distilbert-base-alternate-layers
Updated
•
1
iproskurina/en_grammar_checker
Updated
•
3
•
4
iproskurina/Mistral-7B-v0.3-gptq-3bit
Text Generation
•
Updated
•
5
iproskurina/Mistral-7B-v0.3-GPTQ-8bit-g128
Text Generation
•
Updated
•
3