Nelis5174473
/

GovLLM-7B-ultra

Text Generation

question-answering

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Nelis5174473 commited on May 6, 2024

Commit

0a57e78

·

verified ·

1 Parent(s): 2ce2a51

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ tags: []
 </p>
 <div style="margin:auto; text-align:center">
-<h1 style="margin-bottom: 0">GovLLM</h1>
 <em>A question answering model about the Dutch Government.</em>
 </div>
@@ -48,10 +48,10 @@ The following hyperparameters were used during training:
 - batch_size: 2,
 - optimizer: adamw_torch,
 - schedular: linear,
-- quantization: int4,
 - peft: true,
 - lora_r: 16,
-- lora_alpha: 32,
 - lora_dropout: 0.05
 ## Model Authors & Contact

 </p>
 <div style="margin:auto; text-align:center">
+<h1 style="margin-bottom: 0">GovLLM-7B-ultra</h1>
 <em>A question answering model about the Dutch Government.</em>
 </div>
 - batch_size: 2,
 - optimizer: adamw_torch,
 - schedular: linear,
+- quantization: int8,
 - peft: true,
 - lora_r: 16,
+- lora_alpha: 16,
 - lora_dropout: 0.05
 ## Model Authors & Contact