AutoGPTQ model for meta-llama/Llama-3.2-3B-Instruct: 4bits, gr128, desc_act=False 2f369f9 verified TinyLamda commited on Oct 14, 2024