RedHatAI/granite-3.0-8b-instruct-GGUF
8B
•
Updated
•
1
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation
•
3B
•
Updated
•
2.56k
•
10
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
766
•
4
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation
•
71B
•
Updated
•
2.95k
•
7
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation
•
406B
•
Updated
•
2.62k
•
15
RedHatAI/Qwen2.5-32B-Instruct-quantized.w4a16
6B
•
Updated
•
50
RedHatAI/Qwen2.5-32B-quantized.w4a16
6B
•
Updated
•
22
RedHatAI/Qwen2.5-72B-quantized.w4a16
12B
•
Updated
•
4
RedHatAI/Qwen2.5-72B-Instruct-quantized.w4a16
12B
•
Updated
•
6
RedHatAI/Qwen2.5-72B-Instruct-quantized.w8a16
20B
•
Updated
•
5
RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a16
0.8B
•
Updated
•
5
RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a16
1B
•
Updated
•
5
RedHatAI/Llama-3.2-3B-Instruct-FP8
Text Generation
•
4B
•
Updated
•
3.56k
•
6
RedHatAI/Llama-3.2-1B-Instruct-FP8
Text Generation
•
1B
•
Updated
•
34.4k
•
3
RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8
Text Generation
•
1B
•
Updated
•
46.9k
•
7
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16
Text Generation
•
58B
•
Updated
•
136
•
12
RedHatAI/Llama-3.2-3B-quantized.w8a8
4B
•
Updated
•
2.53k
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation
•
2B
•
Updated
•
10
•
1
RedHatAI/SmolLM-135M-Instruct-quantized.w8a8
Text Generation
•
0.2B
•
Updated
•
7
•
1
RedHatAI/SmolLM-360M-Instruct-quantized.w8a8
Text Generation
•
0.4B
•
Updated
•
6
RedHatAI/SmolLM-135M-Instruct-quantized.w8a16
Text Generation
•
0.1B
•
Updated
•
239
RedHatAI/gemma-2-27b-it-quantized.w8a16
Text Generation
•
9B
•
Updated
•
5
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16
Text Generation
•
105B
•
Updated
•
11
•
1
RedHatAI/gemma-2-2b-it-quantized.w8a8
Text Generation
•
3B
•
Updated
•
60
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16
Text Generation
•
3B
•
Updated
•
84
•
4
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation
•
0.6B
•
Updated
•
30
RedHatAI/gemma-2-2b-it-quantized.w4a16
Text Generation
•
1B
•
Updated
•
574
•
1
RedHatAI/gemma-2-9b-it-quantized.w4a16
Text Generation
•
3B
•
Updated
•
586
•
2
RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16
Text Generation
•
3B
•
Updated
•
16
RedHatAI/gemma-2-2b-quantized.w8a16
Text Generation
•
2B
•
Updated
•
17