Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,27 @@
|
|
| 1 |
-
---
|
| 2 |
-
license:
|
| 3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
# Introduction
|
| 6 |
+
|
| 7 |
+
This repository hosts the **Qwen 2.5** models for the [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It includes **unquantized** version of the Qwen model in `.pte` format, ready for use in the **ExecuTorch** runtime.
|
| 8 |
+
|
| 9 |
+
If you'd like to run these models in your own ExecuTorch runtime, refer to the [official documentation](https://pytorch.org/executorch/stable/index.html) for setup instructions.
|
| 10 |
+
|
| 11 |
+
## Compatibility
|
| 12 |
+
|
| 13 |
+
If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the **ExecuTorch** version used to export the `.pte` files. For more details, see the compatibility note in the [ExecuTorch GitHub repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4). If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with runtime used behind the scenes.
|
| 14 |
+
|
| 15 |
+
These models were exported using `v0.6.0` version and **no forward compatibility** is guaranteed. Older versions of the runtime may not work with these files.
|
| 16 |
+
|
| 17 |
+
### Repository Structure
|
| 18 |
+
|
| 19 |
+
The repository is organized into one main directory:
|
| 20 |
+
|
| 21 |
+
- `original`
|
| 22 |
+
|
| 23 |
+
The directory contains original version of model.
|
| 24 |
+
|
| 25 |
+
- The `.pte` file should be passed to the `modelSource` parameter.
|
| 26 |
+
- The tokenizer for the models is available within the repo root, under `tokenizer.json` and `tokenizer_config.json`
|
| 27 |
+
|