Update README.md
Browse files
README.md
CHANGED
@@ -31,17 +31,16 @@ should probably proofread and complete it, then remove this comment. -->
|
|
31 |
# xls-asr-vi-40h-1B
|
32 |
|
33 |
This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on the common voice 7.0 vi & private dataset.
|
34 |
-
It achieves the following results on the evaluation set Common voice 7.0 vi test set (Without Language Model):
|
35 |
-
- Cer: 19.94
|
36 |
-
- Wer: 34.21
|
37 |
|
38 |
-
|
|
|
|
|
|
|
39 |
|
40 |
-
|
41 |
-
|
42 |
-
|
43 |
-
|
44 |
-
More information needed
|
45 |
|
46 |
## Training and evaluation data
|
47 |
|
@@ -63,6 +62,13 @@ The following hyperparameters were used during training:
|
|
63 |
- lr_scheduler_warmup_steps: 1500
|
64 |
- num_epochs: 50.0
|
65 |
- mixed_precision_training: Native AMP
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
66 |
|
67 |
### Training results
|
68 |
|
|
|
31 |
# xls-asr-vi-40h-1B
|
32 |
|
33 |
This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on the common voice 7.0 vi & private dataset.
|
|
|
|
|
|
|
34 |
|
35 |
+
### Benchmark WER result:
|
36 |
+
| | [VIVOS](https://huggingface.co/datasets/vivos) | [COMMON VOICE 7.0 VI](https://huggingface.co/datasets/mozilla-foundation/common_voice_7_0) |
|
37 |
+
|---|---|---|
|
38 |
+
|without LM| 25.92 | 34.21 |
|
39 |
|
40 |
+
### Benchmark CER result:
|
41 |
+
| | [VIVOS](https://huggingface.co/datasets/vivos) | [COMMON VOICE 7.0 VI](https://huggingface.co/datasets/mozilla-foundation/common_voice_7_0) |
|
42 |
+
|---|---|---|
|
43 |
+
|without LM| 9.24 | 19.94 |
|
|
|
44 |
|
45 |
## Training and evaluation data
|
46 |
|
|
|
62 |
- lr_scheduler_warmup_steps: 1500
|
63 |
- num_epochs: 50.0
|
64 |
- mixed_precision_training: Native AMP
|
65 |
+
- attention_dropout: 0.2
|
66 |
+
- activation_dropout: 0.1
|
67 |
+
- warmup_steps: 1500
|
68 |
+
- mask_time_prob: .15
|
69 |
+
- mask_time_length: 10
|
70 |
+
- mask_feature_prob: 0.25
|
71 |
+
- mask_feature_length: 64
|
72 |
|
73 |
### Training results
|
74 |
|