update loading instructions
Browse files
README.md
CHANGED
|
@@ -35,10 +35,10 @@ The linear module **bert.encoder.layer.6.attention.self.key** falls back to fp32
|
|
| 35 |
#### Load with optimum:
|
| 36 |
|
| 37 |
```python
|
| 38 |
-
from optimum.intel
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
)
|
| 42 |
```
|
| 43 |
|
| 44 |
### ONNX
|
|
@@ -62,4 +62,4 @@ The calibration dataloader is the eval dataloader. The calibration sampling size
|
|
| 62 |
```python
|
| 63 |
from optimum.onnxruntime import ORTModelForSequenceClassification
|
| 64 |
model = ORTModelForSequenceClassification.from_pretrained('Intel/MiniLM-L12-H384-uncased-mrpc-int8-static')
|
| 65 |
-
```
|
|
|
|
| 35 |
#### Load with optimum:
|
| 36 |
|
| 37 |
```python
|
| 38 |
+
from optimum.intel import INCModelForSequenceClassification
|
| 39 |
+
|
| 40 |
+
model_id = "Intel/MiniLM-L12-H384-uncased-mrpc-int8-static"
|
| 41 |
+
int8_model = INCModelForSequenceClassification(model_id)
|
| 42 |
```
|
| 43 |
|
| 44 |
### ONNX
|
|
|
|
| 62 |
```python
|
| 63 |
from optimum.onnxruntime import ORTModelForSequenceClassification
|
| 64 |
model = ORTModelForSequenceClassification.from_pretrained('Intel/MiniLM-L12-H384-uncased-mrpc-int8-static')
|
| 65 |
+
```
|