Hugging Face's logo

macrae
/
Llama-3-2-3B-rk3588

llama3.2
llama3.2-3B
rkllm
rockchip
rk3588
Model card Files Community
1

Llama 3.2 3B for RK3588

This is a conversion from https://huggingface.co/meta-llama/Meta-Llama-3.2-3B to the RKLLM format for Rockchip devices. Target conversion to be running on the RK3588 NPU.

RKLLM runtime 1.1.1 requires NPU driver 0.9.6:

RKLLM runtime 1.1.4 requires NPU driver 0.9.8:

License

Same as the original LLM:

https://huggingface.co/meta-llama/Meta-Llama-3.2-3B/blob/main/LICENSE.txt

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.