huihui-ai
/

granite-vision-3.2-2b-abliterated

Image-Text-to-Text

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

huihui-ai commited on 8 days ago

Commit

be41e22

·

verified ·

1 Parent(s): 8d52238

Update README.md

Files changed (1) hide show

README.md +6 -1

README.md CHANGED Viewed

@@ -57,7 +57,12 @@ inputs = processor.apply_chat_template(
 # autoregressively complete prompt
 output = model.generate(**inputs, max_new_tokens=100)
-print(processor.decode(output[0], skip_special_tokens=True))
 ```
 ### Donation

 # autoregressively complete prompt
 output = model.generate(**inputs, max_new_tokens=100)
+# print(processor.decode(output[0], skip_special_tokens=True))
+response = processor.decode(output[0], skip_special_tokens=True)
+cleaned_response = response.split("<|assistant|>")[1].split("<")[0].strip()
+print(cleaned_response)
 ```
 ### Donation