Hugging Face's logo

GPT4All-Community
/
Meta-Llama-3.1-8B-Instruct-128k-GGUF

Text Generation
GGUF
text-generation-inference
Inference Endpoints
conversational
Model card Files Community
2
Meta-Llama-3.1-8B-Instruct-128k-GGUF / README.md
ThiloteE's picture
ThiloteE
Update README.md
d17e51b verified
preview code
|
raw
history blame
1.05 kB
metadata
license: llama3.1
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
pipeline_tag: text-generation
tags:
  - text-generation-inference

This is a featured model that is assumed to perform well, but may require more testing and user feedback. Be aware, only models featured within the GUI of GPT4All, are curated and officially supported by Nomic. Use at your own risk.

About

Model converted and quantized by: 3Simplex.
GPT4All v3.1.1 required.

image/png

Prompt Template 

<|start_header_id|>system<|end_header_id|>

{system_prompt}<|eot_id|>

<|start_header_id|>user<|end_header_id|>

{user_input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{assistant_response}

128k Context Length

"llama.context_length": 131072