Hugging Face's logo

qualcomm
/
Yolo-v6

Object Detection
PyTorch
real_time
android
Model card Files
xet
Community
qaihm-bot commited on
Commit
738f4c9
·
verified ·
1 Parent(s): dcf00ae

v0.34.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.34.0 for changelog.

Files changed (1) hide show
  1. README.md +241 -88
README.md CHANGED
@@ -19,7 +19,11 @@ YoloV6 is a machine learning model that predicts bounding boxes and classes of o
19
  This model is an implementation of Yolo-v6 found [here](https://github.com/meituan/YOLOv6/).
20
 
21
 
22
- More details on model performance across various devices, can be found [here](https://aihub.qualcomm.com/models/yolov6).
 
 
 
 
23
 
24
  ### Model Details
25
 
@@ -34,87 +38,255 @@ This model is an implementation of Yolo-v6 found [here](https://github.com/meitu
34
 
35
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
36
  |---|---|---|---|---|---|---|---|---|
37
- | Yolo-v6 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 22.267 ms | 0 - 43 MB | NPU | -- |
38
  | Yolo-v6 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 14.869 ms | 0 - 74 MB | NPU | -- |
39
- | Yolo-v6 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 12.907 ms | 0 - 41 MB | NPU | -- |
40
  | Yolo-v6 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 7.409 ms | 5 - 40 MB | NPU | -- |
41
- | Yolo-v6 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 10.748 ms | 0 - 15 MB | NPU | -- |
42
  | Yolo-v6 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 4.501 ms | 5 - 33 MB | NPU | -- |
43
- | Yolo-v6 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 12.667 ms | 0 - 43 MB | NPU | -- |
44
  | Yolo-v6 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 6.25 ms | 2 - 69 MB | NPU | -- |
45
- | Yolo-v6 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 22.267 ms | 0 - 43 MB | NPU | -- |
46
  | Yolo-v6 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 14.869 ms | 0 - 74 MB | NPU | -- |
47
- | Yolo-v6 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 10.766 ms | 0 - 16 MB | NPU | -- |
48
  | Yolo-v6 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 4.513 ms | 4 - 35 MB | NPU | -- |
49
- | Yolo-v6 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 13.556 ms | 0 - 29 MB | NPU | -- |
50
  | Yolo-v6 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 6.94 ms | 4 - 32 MB | NPU | -- |
51
- | Yolo-v6 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 11.0 ms | 0 - 20 MB | NPU | -- |
52
  | Yolo-v6 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 4.523 ms | 5 - 31 MB | NPU | -- |
53
- | Yolo-v6 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 12.667 ms | 0 - 43 MB | NPU | -- |
54
  | Yolo-v6 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 6.25 ms | 2 - 69 MB | NPU | -- |
55
- | Yolo-v6 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 10.699 ms | 0 - 15 MB | NPU | -- |
56
  | Yolo-v6 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 4.549 ms | 3 - 34 MB | NPU | -- |
57
- | Yolo-v6 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.658 ms | 0 - 53 MB | NPU | -- |
58
- | Yolo-v6 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 7.393 ms | 0 - 56 MB | NPU | -- |
59
  | Yolo-v6 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 3.225 ms | 5 - 111 MB | NPU | -- |
60
- | Yolo-v6 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.086 ms | 0 - 153 MB | NPU | -- |
61
- | Yolo-v6 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 6.368 ms | 0 - 50 MB | NPU | -- |
62
  | Yolo-v6 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 2.949 ms | 5 - 76 MB | NPU | -- |
63
- | Yolo-v6 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.575 ms | 5 - 103 MB | NPU | -- |
64
  | Yolo-v6 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.995 ms | 0 - 0 MB | NPU | -- |
65
- | Yolo-v6 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.043 ms | 6 - 6 MB | NPU | -- |
66
- | Yolo-v6 | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.226 ms | 2 - 28 MB | NPU | -- |
67
- | Yolo-v6 | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.752 ms | 2 - 39 MB | NPU | -- |
68
- | Yolo-v6 | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.171 ms | 2 - 9 MB | NPU | -- |
69
- | Yolo-v6 | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.755 ms | 2 - 30 MB | NPU | -- |
70
- | Yolo-v6 | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 8.671 ms | 0 - 30 MB | NPU | -- |
71
- | Yolo-v6 | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.226 ms | 2 - 28 MB | NPU | -- |
72
- | Yolo-v6 | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.173 ms | 2 - 12 MB | NPU | -- |
73
- | Yolo-v6 | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 3.299 ms | 0 - 34 MB | NPU | -- |
74
- | Yolo-v6 | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.188 ms | 2 - 10 MB | NPU | -- |
75
- | Yolo-v6 | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.755 ms | 2 - 30 MB | NPU | -- |
76
- | Yolo-v6 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 2.185 ms | 2 - 11 MB | NPU | -- |
77
- | Yolo-v6 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.881 ms | 0 - 32 MB | NPU | -- |
78
- | Yolo-v6 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.449 ms | 2 - 43 MB | NPU | -- |
79
- | Yolo-v6 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.008 ms | 2 - 106 MB | NPU | -- |
80
- | Yolo-v6 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.331 ms | 2 - 34 MB | NPU | -- |
81
- | Yolo-v6 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.851 ms | 1 - 98 MB | NPU | -- |
82
- | Yolo-v6 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.592 ms | 8 - 8 MB | NPU | -- |
83
- | Yolo-v6 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.404 ms | 3 - 3 MB | NPU | -- |
84
- | Yolo-v6 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.463 ms | 0 - 20 MB | NPU | -- |
85
- | Yolo-v6 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.213 ms | 1 - 21 MB | NPU | -- |
86
- | Yolo-v6 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.263 ms | 0 - 37 MB | NPU | -- |
87
- | Yolo-v6 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.677 ms | 1 - 33 MB | NPU | -- |
88
- | Yolo-v6 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.069 ms | 0 - 29 MB | NPU | -- |
89
- | Yolo-v6 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.347 ms | 1 - 29 MB | NPU | -- |
90
- | Yolo-v6 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.501 ms | 0 - 21 MB | NPU | -- |
91
- | Yolo-v6 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.677 ms | 1 - 22 MB | NPU | -- |
92
- | Yolo-v6 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 4.615 ms | 0 - 30 MB | NPU | -- |
93
- | Yolo-v6 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.771 ms | 1 - 27 MB | NPU | -- |
94
- | Yolo-v6 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 34.91 ms | 3 - 11 MB | NPU | -- |
95
- | Yolo-v6 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.463 ms | 0 - 20 MB | NPU | -- |
96
- | Yolo-v6 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.213 ms | 1 - 21 MB | NPU | -- |
97
- | Yolo-v6 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.076 ms | 0 - 30 MB | NPU | -- |
98
- | Yolo-v6 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.351 ms | 1 - 28 MB | NPU | -- |
99
- | Yolo-v6 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 3.026 ms | 0 - 22 MB | NPU | -- |
100
- | Yolo-v6 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.296 ms | 1 - 27 MB | NPU | -- |
101
- | Yolo-v6 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.067 ms | 0 - 29 MB | NPU | -- |
102
- | Yolo-v6 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.348 ms | 1 - 28 MB | NPU | -- |
103
- | Yolo-v6 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.501 ms | 0 - 21 MB | NPU | -- |
104
- | Yolo-v6 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.677 ms | 1 - 22 MB | NPU | -- |
105
- | Yolo-v6 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 2.08 ms | 0 - 30 MB | NPU | -- |
106
- | Yolo-v6 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 1.355 ms | 1 - 28 MB | NPU | -- |
107
- | Yolo-v6 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 3.923 ms | 0 - 34 MB | NPU | -- |
108
- | Yolo-v6 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.366 ms | 0 - 37 MB | NPU | -- |
109
- | Yolo-v6 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.895 ms | 1 - 35 MB | NPU | -- |
110
- | Yolo-v6 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 2.636 ms | 0 - 127 MB | NPU | -- |
111
- | Yolo-v6 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 1.35 ms | 0 - 28 MB | NPU | -- |
112
- | Yolo-v6 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 0.843 ms | 1 - 25 MB | NPU | -- |
113
- | Yolo-v6 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 2.709 ms | 1 - 90 MB | NPU | -- |
114
- | Yolo-v6 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.701 ms | 17 - 17 MB | NPU | -- |
115
- | Yolo-v6 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 4.131 ms | 4 - 4 MB | NPU | -- |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
116
 
 
 
117
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
118
 
119
 
120
  ## License
@@ -131,26 +303,7 @@ This model is an implementation of Yolo-v6 found [here](https://github.com/meitu
131
 
132
 
133
  ## Community
134
- * Join [our AI Hub Slack community](https://qualcomm-ai-hub.slack.com/join/shared_invite/zt-2d5zsmas3-Sj0Q9TzslueCjS31eXG2UA#/shared-invite/email) to collaborate, post questions and learn more about on-device AI.
135
  * For questions or feedback please [reach out to us](mailto:[email protected]).
136
 
137
- ## Usage and Limitations
138
-
139
- Model may not be used for or in connection with any of the following applications:
140
-
141
- - Accessing essential private and public services and benefits;
142
- - Administration of justice and democratic processes;
143
- - Assessing or recognizing the emotional state of a person;
144
- - Biometric and biometrics-based systems, including categorization of persons based on sensitive characteristics;
145
- - Education and vocational training;
146
- - Employment and workers management;
147
- - Exploitation of the vulnerabilities of persons resulting in harmful behavior;
148
- - General purpose social scoring;
149
- - Law enforcement;
150
- - Management and operation of critical infrastructure;
151
- - Migration, asylum and border control management;
152
- - Predictive policing;
153
- - Real-time remote biometric identification in public spaces;
154
- - Recommender systems of social media platforms;
155
- - Scraping of facial images (from the internet or otherwise); and/or
156
- - Subliminal manipulation
 
19
  This model is an implementation of Yolo-v6 found [here](https://github.com/meituan/YOLOv6/).
20
 
21
 
22
+ This repository provides scripts to run Yolo-v6 on Qualcomm® devices.
23
+ More details on model performance across various devices, can be found
24
+ [here](https://aihub.qualcomm.com/models/yolov6).
25
+
26
+ **WARNING**: The model assets are not readily available for download due to licensing restrictions.
27
 
28
  ### Model Details
29
 
 
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | Yolo-v6 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 22.166 ms | 0 - 43 MB | NPU | -- |
42
  | Yolo-v6 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 14.869 ms | 0 - 74 MB | NPU | -- |
43
+ | Yolo-v6 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 12.435 ms | 0 - 42 MB | NPU | -- |
44
  | Yolo-v6 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 7.409 ms | 5 - 40 MB | NPU | -- |
45
+ | Yolo-v6 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 10.718 ms | 0 - 15 MB | NPU | -- |
46
  | Yolo-v6 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 4.501 ms | 5 - 33 MB | NPU | -- |
47
+ | Yolo-v6 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 12.557 ms | 0 - 43 MB | NPU | -- |
48
  | Yolo-v6 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 6.25 ms | 2 - 69 MB | NPU | -- |
49
+ | Yolo-v6 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 22.166 ms | 0 - 43 MB | NPU | -- |
50
  | Yolo-v6 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 14.869 ms | 0 - 74 MB | NPU | -- |
51
+ | Yolo-v6 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 10.987 ms | 0 - 22 MB | NPU | -- |
52
  | Yolo-v6 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 4.513 ms | 4 - 35 MB | NPU | -- |
53
+ | Yolo-v6 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 13.624 ms | 0 - 29 MB | NPU | -- |
54
  | Yolo-v6 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 6.94 ms | 4 - 32 MB | NPU | -- |
55
+ | Yolo-v6 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 10.779 ms | 0 - 15 MB | NPU | -- |
56
  | Yolo-v6 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 4.523 ms | 5 - 31 MB | NPU | -- |
57
+ | Yolo-v6 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 12.557 ms | 0 - 43 MB | NPU | -- |
58
  | Yolo-v6 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 6.25 ms | 2 - 69 MB | NPU | -- |
59
+ | Yolo-v6 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 10.745 ms | 0 - 16 MB | NPU | -- |
60
  | Yolo-v6 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 4.549 ms | 3 - 34 MB | NPU | -- |
61
+ | Yolo-v6 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.639 ms | 0 - 49 MB | NPU | -- |
62
+ | Yolo-v6 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 7.401 ms | 0 - 58 MB | NPU | -- |
63
  | Yolo-v6 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 3.225 ms | 5 - 111 MB | NPU | -- |
64
+ | Yolo-v6 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.108 ms | 2 - 151 MB | NPU | -- |
65
+ | Yolo-v6 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 7.287 ms | 0 - 51 MB | NPU | -- |
66
  | Yolo-v6 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 2.949 ms | 5 - 76 MB | NPU | -- |
67
+ | Yolo-v6 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 4.118 ms | 5 - 102 MB | NPU | -- |
68
  | Yolo-v6 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.995 ms | 0 - 0 MB | NPU | -- |
69
+ | Yolo-v6 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.154 ms | 6 - 6 MB | NPU | -- |
70
+ | Yolo-v6 | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.183 ms | 2 - 28 MB | NPU | -- |
71
+ | Yolo-v6 | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.751 ms | 2 - 33 MB | NPU | -- |
72
+ | Yolo-v6 | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.156 ms | 2 - 12 MB | NPU | -- |
73
+ | Yolo-v6 | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.744 ms | 0 - 26 MB | NPU | -- |
74
+ | Yolo-v6 | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 8.589 ms | 0 - 29 MB | NPU | -- |
75
+ | Yolo-v6 | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.183 ms | 2 - 28 MB | NPU | -- |
76
+ | Yolo-v6 | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.186 ms | 3 - 12 MB | NPU | -- |
77
+ | Yolo-v6 | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 3.313 ms | 1 - 32 MB | NPU | -- |
78
+ | Yolo-v6 | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.173 ms | 4 - 12 MB | NPU | -- |
79
+ | Yolo-v6 | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.744 ms | 0 - 26 MB | NPU | -- |
80
+ | Yolo-v6 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 2.184 ms | 3 - 12 MB | NPU | -- |
81
+ | Yolo-v6 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.802 ms | 0 - 34 MB | NPU | -- |
82
+ | Yolo-v6 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.452 ms | 2 - 41 MB | NPU | -- |
83
+ | Yolo-v6 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.183 ms | 2 - 101 MB | NPU | -- |
84
+ | Yolo-v6 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.334 ms | 2 - 34 MB | NPU | -- |
85
+ | Yolo-v6 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.94 ms | 2 - 102 MB | NPU | -- |
86
+ | Yolo-v6 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.587 ms | 8 - 8 MB | NPU | -- |
87
+ | Yolo-v6 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.284 ms | 3 - 3 MB | NPU | -- |
88
+ | Yolo-v6 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.421 ms | 0 - 20 MB | NPU | -- |
89
+ | Yolo-v6 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.209 ms | 1 - 22 MB | NPU | -- |
90
+ | Yolo-v6 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.273 ms | 0 - 33 MB | NPU | -- |
91
+ | Yolo-v6 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.674 ms | 1 - 32 MB | NPU | -- |
92
+ | Yolo-v6 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.078 ms | 0 - 29 MB | NPU | -- |
93
+ | Yolo-v6 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.358 ms | 1 - 26 MB | NPU | -- |
94
+ | Yolo-v6 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.479 ms | 0 - 22 MB | NPU | -- |
95
+ | Yolo-v6 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.694 ms | 1 - 24 MB | NPU | -- |
96
+ | Yolo-v6 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 4.415 ms | 0 - 30 MB | NPU | -- |
97
+ | Yolo-v6 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.897 ms | 1 - 27 MB | NPU | -- |
98
+ | Yolo-v6 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 36.109 ms | 3 - 12 MB | NPU | -- |
99
+ | Yolo-v6 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.421 ms | 0 - 20 MB | NPU | -- |
100
+ | Yolo-v6 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.209 ms | 1 - 22 MB | NPU | -- |
101
+ | Yolo-v6 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.066 ms | 0 - 30 MB | NPU | -- |
102
+ | Yolo-v6 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.365 ms | 0 - 27 MB | NPU | -- |
103
+ | Yolo-v6 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.992 ms | 0 - 27 MB | NPU | -- |
104
+ | Yolo-v6 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.311 ms | 1 - 28 MB | NPU | -- |
105
+ | Yolo-v6 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.065 ms | 0 - 29 MB | NPU | -- |
106
+ | Yolo-v6 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.362 ms | 1 - 27 MB | NPU | -- |
107
+ | Yolo-v6 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.479 ms | 0 - 22 MB | NPU | -- |
108
+ | Yolo-v6 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.694 ms | 1 - 24 MB | NPU | -- |
109
+ | Yolo-v6 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 2.062 ms | 0 - 29 MB | NPU | -- |
110
+ | Yolo-v6 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 1.364 ms | 1 - 28 MB | NPU | -- |
111
+ | Yolo-v6 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 4.197 ms | 0 - 42 MB | NPU | -- |
112
+ | Yolo-v6 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.353 ms | 0 - 36 MB | NPU | -- |
113
+ | Yolo-v6 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.892 ms | 1 - 33 MB | NPU | -- |
114
+ | Yolo-v6 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 2.936 ms | 0 - 121 MB | NPU | -- |
115
+ | Yolo-v6 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 1.356 ms | 0 - 27 MB | NPU | -- |
116
+ | Yolo-v6 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 0.815 ms | 1 - 25 MB | NPU | -- |
117
+ | Yolo-v6 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.154 ms | 0 - 104 MB | NPU | -- |
118
+ | Yolo-v6 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.694 ms | 18 - 18 MB | NPU | -- |
119
+ | Yolo-v6 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 4.691 ms | 4 - 4 MB | NPU | -- |
120
+
121
+
122
+
123
+
124
+ ## Installation
125
+
126
+
127
+ Install the package via pip:
128
+ ```bash
129
+ pip install "qai-hub-models[yolov6]"
130
+ ```
131
+
132
+
133
+ ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
134
+
135
+ Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
136
+ Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
137
+
138
+ With this API token, you can configure your client to run models on the cloud
139
+ hosted devices.
140
+ ```bash
141
+ qai-hub configure --api_token API_TOKEN
142
+ ```
143
+ Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
144
+
145
+
146
+
147
+ ## Demo off target
148
+
149
+ The package contains a simple end-to-end demo that downloads pre-trained
150
+ weights and runs this model on a sample input.
151
+
152
+ ```bash
153
+ python -m qai_hub_models.models.yolov6.demo
154
+ ```
155
+
156
+ The above demo runs a reference implementation of pre-processing, model
157
+ inference, and post processing.
158
+
159
+ **NOTE**: If you want running in a Jupyter Notebook or Google Colab like
160
+ environment, please add the following to your cell (instead of the above).
161
+ ```
162
+ %run -m qai_hub_models.models.yolov6.demo
163
+ ```
164
+
165
+
166
+ ### Run model on a cloud-hosted device
167
+
168
+ In addition to the demo, you can also run the model on a cloud-hosted Qualcomm®
169
+ device. This script does the following:
170
+ * Performance check on-device on a cloud-hosted device
171
+ * Downloads compiled assets that can be deployed on-device for Android.
172
+ * Accuracy check between PyTorch and on-device outputs.
173
+
174
+ ```bash
175
+ python -m qai_hub_models.models.yolov6.export
176
+ ```
177
+
178
+
179
+
180
+ ## How does this work?
181
+
182
+ This [export script](https://aihub.qualcomm.com/models/yolov6/qai_hub_models/models/Yolo-v6/export.py)
183
+ leverages [Qualcomm® AI Hub](https://aihub.qualcomm.com/) to optimize, validate, and deploy this model
184
+ on-device. Lets go through each step below in detail:
185
+
186
+ Step 1: **Compile model for on-device deployment**
187
+
188
+ To compile a PyTorch model for on-device deployment, we first trace the model
189
+ in memory using the `jit.trace` and then call the `submit_compile_job` API.
190
+
191
+ ```python
192
+ import torch
193
 
194
+ import qai_hub as hub
195
+ from qai_hub_models.models.yolov6 import Model
196
 
197
+ # Load the model
198
+ torch_model = Model.from_pretrained()
199
+
200
+ # Device
201
+ device = hub.Device("Samsung Galaxy S24")
202
+
203
+ # Trace model
204
+ input_shape = torch_model.get_input_spec()
205
+ sample_inputs = torch_model.sample_inputs()
206
+
207
+ pt_model = torch.jit.trace(torch_model, [torch.tensor(data[0]) for _, data in sample_inputs.items()])
208
+
209
+ # Compile model on a specific device
210
+ compile_job = hub.submit_compile_job(
211
+ model=pt_model,
212
+ device=device,
213
+ input_specs=torch_model.get_input_spec(),
214
+ )
215
+
216
+ # Get target model to run on-device
217
+ target_model = compile_job.get_target_model()
218
+
219
+ ```
220
+
221
+
222
+ Step 2: **Performance profiling on cloud-hosted device**
223
+
224
+ After compiling models from step 1. Models can be profiled model on-device using the
225
+ `target_model`. Note that this scripts runs the model on a device automatically
226
+ provisioned in the cloud. Once the job is submitted, you can navigate to a
227
+ provided job URL to view a variety of on-device performance metrics.
228
+ ```python
229
+ profile_job = hub.submit_profile_job(
230
+ model=target_model,
231
+ device=device,
232
+ )
233
+
234
+ ```
235
+
236
+ Step 3: **Verify on-device accuracy**
237
+
238
+ To verify the accuracy of the model on-device, you can run on-device inference
239
+ on sample input data on the same cloud hosted device.
240
+ ```python
241
+ input_data = torch_model.sample_inputs()
242
+ inference_job = hub.submit_inference_job(
243
+ model=target_model,
244
+ device=device,
245
+ inputs=input_data,
246
+ )
247
+ on_device_output = inference_job.download_output_data()
248
+
249
+ ```
250
+ With the output of the model, you can compute like PSNR, relative errors or
251
+ spot check the output with expected output.
252
+
253
+ **Note**: This on-device profiling and inference requires access to Qualcomm®
254
+ AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
255
+
256
+
257
+
258
+ ## Run demo on a cloud-hosted device
259
+
260
+ You can also run the demo on-device.
261
+
262
+ ```bash
263
+ python -m qai_hub_models.models.yolov6.demo --eval-mode on-device
264
+ ```
265
+
266
+ **NOTE**: If you want running in a Jupyter Notebook or Google Colab like
267
+ environment, please add the following to your cell (instead of the above).
268
+ ```
269
+ %run -m qai_hub_models.models.yolov6.demo -- --eval-mode on-device
270
+ ```
271
+
272
+
273
+ ## Deploying compiled model to Android
274
+
275
+
276
+ The models can be deployed using multiple runtimes:
277
+ - TensorFlow Lite (`.tflite` export): [This
278
+ tutorial](https://www.tensorflow.org/lite/android/quickstart) provides a
279
+ guide to deploy the .tflite model in an Android application.
280
+
281
+
282
+ - QNN (`.so` export ): This [sample
283
+ app](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/sample_app.html)
284
+ provides instructions on how to use the `.so` shared library in an Android application.
285
+
286
+
287
+ ## View on Qualcomm® AI Hub
288
+ Get more details on Yolo-v6's performance across various devices [here](https://aihub.qualcomm.com/models/yolov6).
289
+ Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
290
 
291
 
292
  ## License
 
303
 
304
 
305
  ## Community
306
+ * Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
307
  * For questions or feedback please [reach out to us](mailto:[email protected]).
308
 
309
+