t1u1's picture

t1u1

t1u1

·

AI & ML interests

None yet

Recent Activity

liked a model 2 days ago

open-thoughts/OpenThinker-7B

liked a model 3 days ago

unsloth/DeepSeek-R1-GGUF

reacted to mitkox's post with 👍 4 days ago

llama.cpp is 26.8% faster than ollama. I have upgraded both, and using the same settings, I am running the same DeepSeek R1 Distill 1.5B on the same hardware. It's an Apples to Apples comparison. Total duration: llama.cpp 6.85 sec <- 26.8% faster ollama 8.69 sec Breakdown by phase: Model loading llama.cpp 241 ms <- 2x faster ollama 553 ms Prompt processing llama.cpp 416.04 tokens/s with an eval time 45.67 ms <- 10x faster ollama 42.17 tokens/s with an eval time of 498 ms Token generation llama.cpp 137.79 tokens/s with an eval time 6.62 sec <- 13% faster ollama 122.07 tokens/s with an eval time 7.64 sec llama.cpp is LLM inference in C/C++; ollama adds abstraction layers and marketing. Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.

View all activity

Organizations

None yet

t1u1's activity

New activity in unsloth/phi-4-GGUF 10 days ago

Can you please create weighted/imatrix quant versions?

#1 opened 10 days ago by

New activity in m-a-p/MusicPile 11 months ago

Auto conversion from MIDI to ABC

#2 opened 11 months ago by

New activity in musiclang/musiclang-predict 11 months ago

Short duration

#1 opened 11 months ago by

New activity in m-a-p/ChatMusician 11 months ago

Small bugs in the dataset

#4 opened 11 months ago by

New activity in MaziyarPanahi/ChatMusician-GGUF 11 months ago

Enable text inference

#2 opened 11 months ago by

New activity in m-a-p/ChatMusician 11 months ago

Quantized version

#2 opened 11 months ago by