rishanthrajendhran
/

VeriFastScore

Text Generation

text-generation-inference

Model card Files Files and versions Community

rishanthrajendhran commited on about 1 month ago

Commit

68857af

·

verified ·

1 Parent(s): 6ba7858

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -114,10 +114,11 @@ inputs = tokenizer.apply_chat_template(
     add_generation_prompt=True,
     tokenize=True,
     truncation=False,
-    padding="do_not_pad"
 ).to(model.device)
-outputs = model.generate(**inputs, max_new_tokens=2048)
 print(tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True))
 ```

     add_generation_prompt=True,
     tokenize=True,
     truncation=False,
+    padding="do_not_pad",
+    return_tensors="pt"
 ).to(model.device)
+outputs = model.generate(inputs, max_new_tokens=2048)
 print(tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True))
 ```