Update README.md (#1012)
Browse files
README.md
CHANGED
|
@@ -990,9 +990,12 @@ tokens: # these are delimiters
|
|
| 990 |
|
| 991 |
When you include these tokens in your axolotl config, axolotl adds these tokens to the tokenizer's vocabulary.
|
| 992 |
|
| 993 |
-
### Inference
|
| 994 |
|
| 995 |
-
|
|
|
|
|
|
|
|
|
|
| 996 |
|
| 997 |
- Pretrained LORA:
|
| 998 |
```bash
|
|
|
|
| 990 |
|
| 991 |
When you include these tokens in your axolotl config, axolotl adds these tokens to the tokenizer's vocabulary.
|
| 992 |
|
| 993 |
+
### Inference Playground
|
| 994 |
|
| 995 |
+
Axolotl allows you to load your model in an interactive terminal playground for quick experimentation.
|
| 996 |
+
The config file is the same config file used for training.
|
| 997 |
+
|
| 998 |
+
Pass the appropriate flag to the inference command, depending upon what kind of model was trained:
|
| 999 |
|
| 1000 |
- Pretrained LORA:
|
| 1001 |
```bash
|