clibrain
/

Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

mrm8488 commited on Aug 30, 2023

Commit

1e0cb79

·

1 Parent(s): 7181e55

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

@@ -133,4 +133,7 @@ def generate(
 instruction = "Dame una lista de lugares a visitar en España."
 print(generate(instruction))
-```

 instruction = "Dame una lista de lugares a visitar en España."
 print(generate(instruction))
+```
+### Benchmark
+Running the model on a *Nvidia T4 with 16GB VRAM, it takes aprox **0.091 seconds** to generate a token