Added note on lm head warning
Browse files
README.md
CHANGED
|
@@ -118,4 +118,5 @@ tensor([[0.7161, 0.4021],
|
|
| 118 |
[0.4525, 0.7370]])
|
| 119 |
"""
|
| 120 |
|
| 121 |
-
```
|
|
|
|
|
|
| 118 |
[0.4525, 0.7370]])
|
| 119 |
"""
|
| 120 |
|
| 121 |
+
```
|
| 122 |
+
*Note: When running the above a warning will appear indicating that lm_head.weight was not used. This layer is only for token prediction and is not required for embedding extraction, so the warning safely be ignored.*
|