Hugging Face's logo

qualcomm
/
Whisper-Small-En

Automatic Speech Recognition
PyTorch
LiteRT
ONNX
foundation
android
Model card Files Community
qaihm-bot commited on
Commit
b415aa9
·
verified ·
1 Parent(s): 5081a10

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +28 -28
README.md CHANGED
@@ -38,30 +38,30 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | WhisperDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 55.414 ms | 14 - 41 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
42
- | WhisperDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 45.791 ms | 16 - 417 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
43
- | WhisperDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 40.412 ms | 21 - 277 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
44
- | WhisperDecoder | SA7255P ADP | SA7255P | TFLITE | 120.347 ms | 16 - 267 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
45
- | WhisperDecoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 55.503 ms | 16 - 42 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
46
- | WhisperDecoder | SA8295P ADP | SA8295P | TFLITE | 51.275 ms | 16 - 248 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
47
- | WhisperDecoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 55.643 ms | 16 - 41 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
48
- | WhisperDecoder | SA8775P ADP | SA8775P | TFLITE | 55.559 ms | 16 - 267 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
49
- | WhisperDecoder | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 120.347 ms | 16 - 267 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
50
- | WhisperDecoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 55.652 ms | 16 - 41 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
51
- | WhisperDecoder | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 55.559 ms | 16 - 267 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
52
- | WhisperDecoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 58.245 ms | 14 - 402 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
53
- | WhisperEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 696.187 ms | 110 - 134 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
54
- | WhisperEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 934.985 ms | 106 - 200 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
55
- | WhisperEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 449.288 ms | 109 - 140 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
56
- | WhisperEncoder | SA7255P ADP | SA7255P | TFLITE | 4466.415 ms | 101 - 133 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
57
- | WhisperEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 701.364 ms | 97 - 118 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
58
- | WhisperEncoder | SA8295P ADP | SA8295P | TFLITE | 655.091 ms | 109 - 140 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
59
- | WhisperEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 683.542 ms | 102 - 208 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
60
- | WhisperEncoder | SA8775P ADP | SA8775P | TFLITE | 1290.925 ms | 108 - 139 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
61
- | WhisperEncoder | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 4466.415 ms | 101 - 133 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
62
- | WhisperEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 954.302 ms | 56 - 111 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
63
- | WhisperEncoder | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 1290.925 ms | 108 - 139 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
64
- | WhisperEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 1036.055 ms | 83 - 180 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
65
 
66
 
67
 
@@ -125,8 +125,8 @@ Profiling Results
125
  WhisperDecoder
126
  Device : Samsung Galaxy S23 (13)
127
  Runtime : TFLITE
128
- Estimated inference time (ms) : 55.4
129
- Estimated peak memory usage (MB): [14, 41]
130
  Total # Ops : 2573
131
  Compute Unit(s) : NPU (2573 ops)
132
 
@@ -134,8 +134,8 @@ Compute Unit(s) : NPU (2573 ops)
134
  WhisperEncoder
135
  Device : Samsung Galaxy S23 (13)
136
  Runtime : TFLITE
137
- Estimated inference time (ms) : 696.2
138
- Estimated peak memory usage (MB): [110, 134]
139
  Total # Ops : 911
140
  Compute Unit(s) : GPU (900 ops) CPU (11 ops)
141
  ```
 
38
 
39
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | WhisperDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 54.814 ms | 16 - 43 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
42
+ | WhisperDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 43.884 ms | 16 - 414 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
43
+ | WhisperDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 40.538 ms | 14 - 269 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
44
+ | WhisperDecoder | SA7255P ADP | SA7255P | TFLITE | 119.442 ms | 16 - 268 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
45
+ | WhisperDecoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 56.491 ms | 13 - 40 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
46
+ | WhisperDecoder | SA8295P ADP | SA8295P | TFLITE | 55.877 ms | 16 - 248 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
47
+ | WhisperDecoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 55.726 ms | 16 - 42 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
48
+ | WhisperDecoder | SA8775P ADP | SA8775P | TFLITE | 54.865 ms | 16 - 268 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
49
+ | WhisperDecoder | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 119.442 ms | 16 - 268 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
50
+ | WhisperDecoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 55.884 ms | 16 - 43 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
51
+ | WhisperDecoder | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 54.865 ms | 16 - 268 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
52
+ | WhisperDecoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 66.814 ms | 16 - 404 MB | FP16 | NPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperDecoder.tflite) |
53
+ | WhisperEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 694.71 ms | 107 - 184 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
54
+ | WhisperEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 1066.29 ms | 86 - 175 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
55
+ | WhisperEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 544.658 ms | 108 - 139 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
56
+ | WhisperEncoder | SA7255P ADP | SA7255P | TFLITE | 4482.798 ms | 102 - 136 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
57
+ | WhisperEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 701.695 ms | 22 - 148 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
58
+ | WhisperEncoder | SA8295P ADP | SA8295P | TFLITE | 655.428 ms | 109 - 141 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
59
+ | WhisperEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 698.036 ms | 83 - 143 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
60
+ | WhisperEncoder | SA8775P ADP | SA8775P | TFLITE | 1289.809 ms | 94 - 127 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
61
+ | WhisperEncoder | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 4482.798 ms | 102 - 136 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
62
+ | WhisperEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 735.815 ms | 18 - 217 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
63
+ | WhisperEncoder | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 1289.809 ms | 94 - 127 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
64
+ | WhisperEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 1667.095 ms | 108 - 206 MB | FP16 | GPU | [Whisper-Small-En.tflite](https://huggingface.co/qualcomm/Whisper-Small-En/blob/main/WhisperEncoder.tflite) |
65
 
66
 
67
 
 
125
  WhisperDecoder
126
  Device : Samsung Galaxy S23 (13)
127
  Runtime : TFLITE
128
+ Estimated inference time (ms) : 54.8
129
+ Estimated peak memory usage (MB): [16, 43]
130
  Total # Ops : 2573
131
  Compute Unit(s) : NPU (2573 ops)
132
 
 
134
  WhisperEncoder
135
  Device : Samsung Galaxy S23 (13)
136
  Runtime : TFLITE
137
+ Estimated inference time (ms) : 694.7
138
+ Estimated peak memory usage (MB): [107, 184]
139
  Total # Ops : 911
140
  Compute Unit(s) : GPU (900 ops) CPU (11 ops)
141
  ```