Update README.md
Browse files
README.md
CHANGED
|
@@ -163,6 +163,4 @@ python fms-extras/scripts/paged_speculative_inference.py \
|
|
| 163 |
--top_k_tokens_per_head=4,3,2,2,2 \
|
| 164 |
--batch_input \
|
| 165 |
--compile \
|
| 166 |
-
```
|
| 167 |
-
|
| 168 |
-
Sample code can be found [here](https://github.com/foundation-model-stack/fms-extras/blob/main/scripts/paged_speculative_inference.py)
|
|
|
|
| 163 |
--top_k_tokens_per_head=4,3,2,2,2 \
|
| 164 |
--batch_input \
|
| 165 |
--compile \
|
| 166 |
+
```
|
|
|
|
|
|