Intel
/

t5-large-finetuned-xsum-cnn-int8-dynamic-inc

text2text-generation

Intel® Neural Compressor

neural-compressor

PostTrainingDynamic

text-generation-inference

Model card Files Files and versions

echarlaix HF Staff commited on Mar 21, 2024

Commit

2f9bf39

·

1 Parent(s): 2750b4f

update loading instructions

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -29,8 +29,8 @@ The original fp32 model comes from the fine-tuned model [sysresearch101/t5-large
 ### Load with optimum:
 ```python
-from optimum.intel.neural_compressor.quantization import IncQuantizedModelForSeq2SeqLM
-int8_model = IncQuantizedModelForSeq2SeqLM.from_pretrained(
-    'Intel/t5-large-finetuned-xsum-cnn-int8-dynamic',
-)
-```

 ### Load with optimum:
 ```python
+from optimum.intel import INCModelForSeq2SeqLM
+model_id = "Intel/t5-large-finetuned-xsum-cnn-int8-dynamic"
+int8_model = INCModelForSeq2SeqLM.from_pretrained(model_id)
+```