Hugging Face's logo

kingbri
/
Nous-Hermes-limarp-l2-13B-GPTQ

Text Generation
Transformers
English
llama
Inference Endpoints
Model card Files Community

This is a GPTQ quantized version of Nous-Hermes-limarp-l2-13B

Please refer to the original creator for more information.

Branches:

  • main: 4 bits, groupsize 128, act order false
  • 4bit-128g-actorder: 4 bits, groupsize 128, act order true
  • 4bit-32g-actorder: 4 bits, groupsize 32, act order true
Downloads last month
8
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.