qaihm-bot commited on
Commit
94d4192
·
verified ·
1 Parent(s): 23b6fa8

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +32 -18
README.md CHANGED
@@ -14,7 +14,7 @@ tags:
14
 
15
  The Fast Segment Anything Model (FastSAM) is a novel, real-time CNN-based solution for the Segment Anything task. This task is designed to segment any object within an image based on various possible user interaction prompts. The model performs competitively despite significantly reduced computation, making it a practical choice for a variety of vision tasks.
16
 
17
- This model is an implementation of FastSam-X found [here](https://github.com/CASIA-IVA-Lab/FastSAM).
18
  This repository provides scripts to run FastSam-X on Qualcomm® devices.
19
  More details on model performance across various devices, can be found
20
  [here](https://aihub.qualcomm.com/models/fastsam_x).
@@ -30,14 +30,24 @@ More details on model performance across various devices, can be found
30
  - Number of parameters: 72.2M
31
  - Model size: 276 MB
32
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
 
34
 
35
 
36
- | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
37
- | ---|---|---|---|---|---|---|---|
38
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | QNN Model Library | 45.786 ms | 5 - 21 MB | FP16 | NPU | [FastSam-X.so](https://huggingface.co/qualcomm/FastSam-X/blob/main/FastSam-X.so)
39
-
40
-
41
 
42
  ## Installation
43
 
@@ -93,16 +103,16 @@ device. This script does the following:
93
  ```bash
94
  python -m qai_hub_models.models.fastsam_x.export
95
  ```
96
-
97
  ```
98
- Profile Job summary of FastSam-X
99
- --------------------------------------------------
100
- Device: Snapdragon X Elite CRD (11)
101
- Estimated Inference Time: 44.46 ms
102
- Estimated Peak Memory Range: 4.70-4.70 MB
103
- Compute Units: NPU (418) | Total (418)
104
-
105
-
 
106
  ```
107
 
108
 
@@ -201,15 +211,19 @@ provides instructions on how to use the `.so` shared library in an Android appl
201
  Get more details on FastSam-X's performance across various devices [here](https://aihub.qualcomm.com/models/fastsam_x).
202
  Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
203
 
 
204
  ## License
205
- - The license for the original implementation of FastSam-X can be found
206
- [here](https://github.com/CASIA-IVA-Lab/FastSAM/blob/main/LICENSE).
207
- - The license for the compiled assets for on-device deployment can be found [here](https://github.com/CASIA-IVA-Lab/FastSAM/blob/main/LICENSE)
 
208
 
209
  ## References
210
  * [Fast Segment Anything](https://arxiv.org/abs/2306.12156)
211
  * [Source Model Implementation](https://github.com/CASIA-IVA-Lab/FastSAM)
212
 
 
 
213
  ## Community
214
  * Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
215
  * For questions or feedback please [reach out to us](mailto:[email protected]).
 
14
 
15
  The Fast Segment Anything Model (FastSAM) is a novel, real-time CNN-based solution for the Segment Anything task. This task is designed to segment any object within an image based on various possible user interaction prompts. The model performs competitively despite significantly reduced computation, making it a practical choice for a variety of vision tasks.
16
 
17
+ This model is an implementation of FastSam-X found [here]({source_repo}).
18
  This repository provides scripts to run FastSam-X on Qualcomm® devices.
19
  More details on model performance across various devices, can be found
20
  [here](https://aihub.qualcomm.com/models/fastsam_x).
 
30
  - Number of parameters: 72.2M
31
  - Model size: 276 MB
32
 
33
+ | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
34
+ |---|---|---|---|---|---|---|---|---|
35
+ | FastSam-X | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 45.671 ms | 5 - 19 MB | FP16 | NPU | [FastSam-X.so](https://huggingface.co/qualcomm/FastSam-X/blob/main/FastSam-X.so) |
36
+ | FastSam-X | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 48.826 ms | 0 - 157 MB | FP16 | NPU | [FastSam-X.onnx](https://huggingface.co/qualcomm/FastSam-X/blob/main/FastSam-X.onnx) |
37
+ | FastSam-X | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 38.249 ms | 5 - 63 MB | FP16 | NPU | [FastSam-X.so](https://huggingface.co/qualcomm/FastSam-X/blob/main/FastSam-X.so) |
38
+ | FastSam-X | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 39.188 ms | 1 - 157 MB | FP16 | NPU | [FastSam-X.onnx](https://huggingface.co/qualcomm/FastSam-X/blob/main/FastSam-X.onnx) |
39
+ | FastSam-X | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 43.275 ms | 5 - 6 MB | FP16 | NPU | Use Export Script |
40
+ | FastSam-X | SA8255 (Proxy) | SA8255P Proxy | QNN | 43.253 ms | 5 - 11 MB | FP16 | NPU | Use Export Script |
41
+ | FastSam-X | SA8775 (Proxy) | SA8775P Proxy | QNN | 42.992 ms | 5 - 12 MB | FP16 | NPU | Use Export Script |
42
+ | FastSam-X | SA8650 (Proxy) | SA8650P Proxy | QNN | 43.064 ms | 5 - 13 MB | FP16 | NPU | Use Export Script |
43
+ | FastSam-X | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 90.623 ms | 5 - 67 MB | FP16 | NPU | Use Export Script |
44
+ | FastSam-X | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 30.823 ms | 5 - 61 MB | FP16 | NPU | Use Export Script |
45
+ | FastSam-X | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 31.678 ms | 1 - 77 MB | FP16 | NPU | [FastSam-X.onnx](https://huggingface.co/qualcomm/FastSam-X/blob/main/FastSam-X.onnx) |
46
+ | FastSam-X | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 44.484 ms | 5 - 5 MB | FP16 | NPU | Use Export Script |
47
+ | FastSam-X | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 49.5 ms | 139 - 139 MB | FP16 | NPU | [FastSam-X.onnx](https://huggingface.co/qualcomm/FastSam-X/blob/main/FastSam-X.onnx) |
48
 
49
 
50
 
 
 
 
 
 
51
 
52
  ## Installation
53
 
 
103
  ```bash
104
  python -m qai_hub_models.models.fastsam_x.export
105
  ```
 
106
  ```
107
+ Profiling Results
108
+ ------------------------------------------------------------
109
+ FastSam-X
110
+ Device : Samsung Galaxy S23 (13)
111
+ Runtime : QNN
112
+ Estimated inference time (ms) : 45.7
113
+ Estimated peak memory usage (MB): [5, 19]
114
+ Total # Ops : 418
115
+ Compute Unit(s) : NPU (418 ops)
116
  ```
117
 
118
 
 
211
  Get more details on FastSam-X's performance across various devices [here](https://aihub.qualcomm.com/models/fastsam_x).
212
  Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
213
 
214
+
215
  ## License
216
+ * The license for the original implementation of FastSam-X can be found [here](https://github.com/CASIA-IVA-Lab/FastSAM/blob/main/LICENSE).
217
+ * The license for the compiled assets for on-device deployment can be found [here](https://github.com/CASIA-IVA-Lab/FastSAM/blob/main/LICENSE)
218
+
219
+
220
 
221
  ## References
222
  * [Fast Segment Anything](https://arxiv.org/abs/2306.12156)
223
  * [Source Model Implementation](https://github.com/CASIA-IVA-Lab/FastSAM)
224
 
225
+
226
+
227
  ## Community
228
  * Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
229
  * For questions or feedback please [reach out to us](mailto:[email protected]).