Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
Nous-Hermes-2-Yi-34B-marlin
like
5
Follow
Neural Magic
319
Text Generation
Transformers
Safetensors
llama
nm-vllm
marlin
int4
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
arxiv:
2210.17323
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Nous-Hermes-2-Yi-34B-marlin
1 contributor
History:
5 commits
robertgshaw2
Create requirements.txt
ba190a7
verified
11 months ago
quantization
Create requirements.txt
11 months ago
.gitattributes
Safe
1.52 kB
initial commit
11 months ago
README.md
Safe
2.48 kB
Create README.md
11 months ago
added_tokens.json
Safe
57 Bytes
Upload folder using huggingface_hub
11 months ago
config.json
Safe
1.02 kB
Upload folder using huggingface_hub
11 months ago
model.safetensors
Safe
19.1 GB
LFS
Upload folder using huggingface_hub
11 months ago
quantize_config.json
Safe
276 Bytes
Upload folder using huggingface_hub
11 months ago
special_tokens_map.json
Safe
570 Bytes
Upload folder using huggingface_hub
11 months ago
tokenizer.json
Safe
3.56 MB
Upload folder using huggingface_hub
11 months ago
tokenizer.model
Safe
1.03 MB
LFS
Upload folder using huggingface_hub
11 months ago
tokenizer_config.json
Safe
1.93 kB
Upload folder using huggingface_hub
11 months ago