File size: 1,541 Bytes
1b94435 63df14c a946b9d 1b94435 a946b9d 4f50d33 0f03b81 24ecd84 0f03b81 fbd4695 63df14c d3371c1 63df14c fbd4695 4f50d33 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
---
license: apache-2.0
datasets:
- roneneldan/TinyStories
language:
- en
pipeline_tag: text-generation
model-index:
- name: AuroraStories-12M
results:
- task:
type: text-generation
metrics:
- name: cross entropy
type: cross entropy
value: 1.652
---
## Instructions
Download All Files (Safetensors isnt needed)
Make sure all of the files are in the same folder
Run "Inference.py"
## Information
12M Parameters
100M Tokens
9106 Tera Flops
17 Hours
## Configuration
Intel i5 7200u
Nvidia 940MX
## Speed
Disclaimer: These speeds are achieved with an Nvidia 940MX
Initialization: 7 Seconds (From start to being able to generate)
Story: 1.5-2.5 Seconds (Depends on the length)
## Output
Below is an example of what you should expect:
Once upon a time, there was a little boy named Timmy. Timmy loved to play outside in the park. One day, Timmy found a big, red ball. He picked it up and started to play with it. Suddenly, he heard a loud noise. It was a big truck! Timmy was very scared and didn't know what to do. Suddenly, the truck stopped and looked at Timmy's foot. It was a fire truck! Timmy was so happy that he ran towards the truck. He told his mom about the fire truck and how he found it. His mom smiled and said, "I told you it was a good thing to do, Timmy." Timmy felt better and went back to playing with the big, red ball. He was happy that he found a way to play with the truck and that he had learned something important. The end. |