File size: 1,627 Bytes
0aaf534 42d29ef 7be2b71 353ce36 0aaf534 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 |
---
language:
- en
license: llama3
tags:
- Llama-3
- instruct
- finetune
- chatml
- gpt4
- synthetic data
- distillation
- function calling
- json mode
- axolotl
- roleplaying
- chat
base_model: NousResearch/Hermes-3-Llama-3.2-3B
widget:
- example_title: Hermes 3
messages:
- role: system
content: >-
You are a sentient, superintelligent artificial general intelligence,
here to teach and assist me.
- role: user
content: >-
Write a short story about Goku discovering kirby has teamed up with
Majin Buu to destroy the world.
model-index:
- name: mrcuddle/Dark-Hermes3-Llama3.2-3B
results:
- task:
type: text-generation
name: Text Generation
dataset:
type: lambada_openai
name: LAMBADA OpenAI
config: default
split: test
metrics:
- type: accuracy
value: 0.6837
name: Accuracy
config: none
args:
n-shot: 0
stderr: 0.0065
- type: perplexity
value: 3.7577
name: Perplexity
config: none
args:
n-shot: 0
stderr: 0.0933
library_name: transformers
---
# Model Card
"Dark-Hermes3-Llama3.2-3B" is a fine-tuned version of NousResearch's Hermes 3B.
Original repo : https://huggingface.co/mrcuddle/Dark-Hermes3-Llama3.2-3B
Local benchs :
- PPL 512 eng : 9.37
- PPL 512 fr : 7.81
- ARC C LlamaCPP : 47.8
- ARC E LlamaCPP : 71.4
## Training Details
Base Model:
- Hermes 3B by NousResearch
Fine-Tuning Datasets:
- Synthetic-Dark-RP
- Luminous_Opus
- Synthetic-RP
Tools Used:
- AutoTrain
- Axolotl
|