Update README.md
Browse files
README.md
CHANGED
@@ -27,7 +27,7 @@ We use the XVERSE-13B-Chat model for measurement, but this optimized inference i
|
|
27 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
28 |
| --- | --- | --- | --- | --- | --- |
|
29 |
| Torch | 34.8 | 249.2 | 470.1 | 878.6 | 1478.9 |
|
30 |
-
| lyraXVERSE
|
31 |
|
32 |
## Docker Environment Recommendation
|
33 |
|
|
|
27 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
28 |
| --- | --- | --- | --- | --- | --- |
|
29 |
| Torch | 34.8 | 249.2 | 470.1 | 878.6 | 1478.9 |
|
30 |
+
| lyraXVERSE | 96.6 | 725.5 | 1359.3 | 2415.6 | 3923.2 |
|
31 |
|
32 |
## Docker Environment Recommendation
|
33 |
|