Hardware requirements?
#7
by
ccocks-deca
- opened
What hardware do you need to run this? Do you need a GPU (I don't have one)? What's the biggest Qwen model I can run without a GPU?
Old question. If you don't have a GPU, you should go check for Ollama which offers GGUF quantized versions that can run OK on a CPU. You can probably run the 32G model if you have 64G of RAM, but it would be awfully slow. I'd recommend the 7B model, which is really good for its size. Good luck!
And do remember to close this issue!