Update README.md
Browse files
README.md
CHANGED
|
@@ -102,6 +102,8 @@ pip install transformers==v4.56.0
|
|
| 102 |
|
| 103 |
The following code snippet shows how to use the transformers library to load and apply the model.
|
| 104 |
|
|
|
|
|
|
|
| 105 |
we use tencent/Hunyuan-MT-7B for example
|
| 106 |
|
| 107 |
```python
|
|
|
|
| 102 |
|
| 103 |
The following code snippet shows how to use the transformers library to load and apply the model.
|
| 104 |
|
| 105 |
+
*!!! If you want to load fp8 model with transformers, you need to change the name"ignored_layers" in config.json to "ingore" and upgrade the compressed-tensors to compressed-tensors-0.11.0.*
|
| 106 |
+
|
| 107 |
we use tencent/Hunyuan-MT-7B for example
|
| 108 |
|
| 109 |
```python
|