Link to Streamlit app
Browse files
README.md
CHANGED
|
@@ -23,6 +23,8 @@ and much more.
|
|
| 23 |
For the latest details about Snowflake Arctic including tutorials, etc., please refer to our GitHub repo:
|
| 24 |
* https://github.com/Snowflake-Labs/snowflake-arctic
|
| 25 |
|
|
|
|
|
|
|
| 26 |
**Model developers** Snowflake AI Research Team
|
| 27 |
|
| 28 |
**License** Apache-2.0
|
|
@@ -96,7 +98,7 @@ outputs = model.generate(input_ids=input_ids, max_new_tokens=20)
|
|
| 96 |
print(tokenizer.decode(outputs[0]))
|
| 97 |
```
|
| 98 |
|
| 99 |
-
The Arctic
|
| 100 |
|
| 101 |
* Example with pure-HF: https://github.com/Snowflake-Labs/snowflake-arctic/blob/main/inference
|
| 102 |
* Tutorial using vLLM: https://github.com/Snowflake-Labs/snowflake-arctic/tree/main/inference/vllm
|
|
|
|
| 23 |
For the latest details about Snowflake Arctic including tutorials, etc., please refer to our GitHub repo:
|
| 24 |
* https://github.com/Snowflake-Labs/snowflake-arctic
|
| 25 |
|
| 26 |
+
Try a live demo with our [Streamlit app](https://huggingface.co/spaces/Snowflake/snowflake-arctic-st-demo).
|
| 27 |
+
|
| 28 |
**Model developers** Snowflake AI Research Team
|
| 29 |
|
| 30 |
**License** Apache-2.0
|
|
|
|
| 98 |
print(tokenizer.decode(outputs[0]))
|
| 99 |
```
|
| 100 |
|
| 101 |
+
The Arctic GitHub page has additional code snippets and examples around running inference:
|
| 102 |
|
| 103 |
* Example with pure-HF: https://github.com/Snowflake-Labs/snowflake-arctic/blob/main/inference
|
| 104 |
* Tutorial using vLLM: https://github.com/Snowflake-Labs/snowflake-arctic/tree/main/inference/vllm
|