arxiv:2411.02355
Eldar Kurtić
ekurtic
AI & ML interests
Efficient inference
Recent Activity
updated
a model
2 days ago
ekurtic/Qwen3-8B-kvattn-fp8-tensor
updated
a model
2 days ago
ekurtic/Qwen3-8B-kvattn-fp8-attn_head
published
a model
2 days ago
ekurtic/Qwen3-8B-kvattn-fp8-tensor
Organizations
models
15
ekurtic/Qwen3-8B-kvattn-fp8-tensor
8B
•
Updated
•
6
ekurtic/Qwen3-8B-kvattn-fp8-attn_head
8B
•
Updated
•
6
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-tensor
8B
•
Updated
•
9
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-attn_head_layer1_4q2kv
Updated
•
10
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-attn_head_layer1
Updated
•
10
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-attn_head
8B
•
Updated
•
10
ekurtic/Llama-2-7b-chat-hf-kvattn-fp8-tensor
7B
•
Updated
•
7
ekurtic/Llama-2-7b-chat-hf-kvattn-fp8-attn_head
7B
•
Updated
•
7
ekurtic/qwen3-8b-int4-asym
2B
•
Updated
•
5
ekurtic/qwen3-8b-int4-sym
2B
•
Updated
•
8
datasets
0
None public yet