--- library_name: transformers base_model: kotoba-tech/kotoba-whisper-v2.0 datasets: - litagin/Galgame_Speech_ASR_16kHz - OOPPEENN/Galgame_Dataset language: - ja pipeline_tag: automatic-speech-recognition tags: - whisper - anime - japanese license: mit --- # Anime Whisper ๐ค๐ค๐ **Anime Whisper** ใฏใ็นใซๆฅๆฌ่ชใฎใขใใก่ชฟๆผๆใปใชใใฎใใกใคใณใซ็นๅใใๆฅๆฌ่ช้ณๅฃฐ่ช่ญใขใใซใงใใ ใใฎใขใใซใฏ [kotoba-whisper-v2.0](https://huggingface.co/kotoba-tech/kotoba-whisper-v2.0) ใใใผในใขใใซใจใใฆใ็ด5,300ๆ้373ไธใใกใคใซใฎใขใใก่ชฟใฎ้ณๅฃฐใปๅฐๆฌใใผใฟใปใใ [Galgame_Speech_ASR_16kHz](https://huggingface.co/datasets/litagin/Galgame_Speech_ASR_16kHz) ใงใใกใคใณใใฅใผใใณใฐใใใใฎใงใใ ็นใซใขใใกๆผๆ้ณๅฃฐใใกใคใณใซ็นๅใใฆใใพใใใใใไปฅๅคใฎ้ณๅฃฐใงใใไปใฎใขใใซใซใฏใชใ็นๅพดใ้ซใๆง่ฝใๆใฃใฆใใพใใ ๆฐ่ปฝใซใ่ฉฆใใงใใใใขใฏใใกใใใ: https://huggingface.co/spaces/litagin/anime-whisper-demo ## ๆณจๆโ **ใใฎใขใใซใฏๅๆใใญใณใใ(initial prompt) ใจใฎ็ธๆงใๆชใใใใงใ่จญๅฎใใใใจใใซใทใใผใทใงใณใ่ตทใใฆ่ณชใๆฅตใใฆๅฃๅใใพใใๅๆใใญใณใใใ่จญๅฎใใใซใไฝฟ็จใใ ใใใ** **Using an initial prompt causes a decline in quality, with the model exhibiting hallucinations and significantly degraded performance. Please avoid using an initial prompt.** ## ็นๅพด ๐ Anime Whisperใฏใไปใขใใซใซๆฏในใฆไธ่ฌ็ใซๆฌกใฎใใใชๅพๅใใใใพใใ - ใใซใทใใผใทใงใณใๅฐใชใ - ไปใฎใขใใซใงในใญใใใใใใกใช่จใๆทใฟใใ็ฌใๅฃฐใๅซใณใๅๆฏใชใฉใฎ้่จ่ช็บ่ฉฑใๅฟ ๅฎใซๆธใ่ตทใใ - ใใใ!?โฆใใฎๅฅ่ชญ็นใ้ณๅฃฐใฎใชใบใ ใๆๆ ใซๅใใใฆ้ฉๅใซไปใใใปใชใๅฐๆฌใจใใฆ้ๅๆใใชใ่ช็ถใชๆไฝใงๆธใ่ตทใใใใ - ใขใใก่ชฟใชๆผๆใปใชใใซๅฏพใใฆใฏ็นใซ็ฒพๅบฆใ้ซใ - [kotoba-whisper](https://huggingface.co/kotoba-tech/kotoba-whisper-v2.0) ([whisper-large-v3](https://huggingface.co/openai/whisper-large-v3)ใฎ่ธ็ใขใใซ) ใใผในใชใฎใง่ปฝ้ใง้ซ้ - ไปใขใใซใงใฏๆธใ่ตทใใใใปใผไธๅฏ่ฝใชNSFW้ณๅฃฐใใใกใใจใใๆไฝใงๆๅญ่ตทใใๅฏ่ฝ ## ไฝฟใๆนไพ ๐ ```python import torch from transformers import pipeline generate_kwargs = { "language": "Japanese", "no_repeat_ngram_size": 0, "repetition_penalty": 1.0, } pipe = pipeline( "automatic-speech-recognition", model="litagin/anime-whisper", device="cuda", torch_dtype=torch.float16, chunk_length_s=30.0, batch_size=64, ) audio_path = "test.wav" result = pipe(audio_path, generate_kwargs=generate_kwargs) print(result["text"]) ``` - ่คๆฐใใกใคใซใไธๆฐใซๆจ่ซใใๅ ดๅใฏ `pipe` ใซๅใซใใกใคใซใในใฎใชในใใๆธกใใฐใใใงใใ - ็นฐใ่ฟใใใซใทใใผใทใงใณใ็ฎ็ซใคๅ ดๅใฏใไธ่จใฎ `no_repeat_ngram_size: int` ใ 5 - 10 ็จๅบฆใซ่จญๅฎใใใใ`repetition_penalty` ใ1ใใไธใซ่จญๅฎใใใใจใงๆๅถใงใใพใใ ## ่ฉไพก ๐ **่ฉณใใ่ฉไพกใป่ฆณๅฏใฌใใผใใ่ฉไพกใณใผใใฏ[GitHubใชใใธใใช](https://github.com/litagin02/anime-whisper)ใงๅ ฌ้ไบๅฎใงใใ** ### CER (Character Error Rate, ๆๅญ่ชคใ็) - ใๅญฆ็ฟใใผใฟใจๅใใขใใก่ชฟใปใชใใฎใใกใคใณใงใฏใใใใ**ๅญฆ็ฟใใผใฟใซใฏๅซใพใใฆใใชใ**ๅไบบ็ใซๆๆใใฆใใ5ๆฌใใใซใฒใผใ ๏ผๅ่จ็ด75kใใกใคใซ๏ผใใง่ฉไพก - OpenAIใฎWhisper็ณปใฎ็นฐใ่ฟใใใซใทใใผใทใงใณๆๆญขใฎใใ`no_repeat_ngram_size=5`ใฎใใฉใกใผใฟใง็ๆ - CERใฏ้ฉๅใชๆญฃ่ฆๅใ่กใฃใ็ตๆใซๅฏพใใCER  <details> <summary>่กจ</summary> | ใขใใซๅ | game1 | game2 | game3 | game4 | game5 | avg | | --- | --- | --- | --- | --- | --- | --- | | [openai/whisper-large](https://huggingface.co/openai/whisper-large) | 15.11 | 20.24 | 14.89 | 17.95 | 19.37 | 17.5 | | [openai/whisper-large-v2](https://huggingface.co/openai/whisper-large-v2) | 15.11 | 20.12 | 14.83 | 17.65 | 18.59 | 17.3 | | [openai/whisper-large-v3](https://huggingface.co/openai/whisper-large-v3) | 14.60 | 18.66 | 14.43 | 17.29 | 17.74 | 16.5 | | [openai/whisper-large-v3-turbo](https://huggingface.co/openai/whisper-large-v3-turbo) | 15.18 | 19.24 | 14.43 | 17.38 | 18.15 | 16.9 | | [reazon-research/reazonspeech-nemo-v2](https://huggingface.co/reazon-research/reazonspeech-nemo-v2) | 23.92 | 25.08 | 20.29 | 25.91 | 22.71 | 23.6 | | [nvidia/parakeet-tdt_ctc-0.6b-ja](https://huggingface.co/nvidia/parakeet-tdt_ctc-0.6b-ja) | 17.67 | 20.44 | 15.33 | 19.60 | 19.86 | 18.6 | | [kotoba-tech/kotoba-whisper-v1.0](https://huggingface.co/kotoba-tech/kotoba-whisper-v1.0) | 16.62 | 21.54 | 16.42 | 19.83 | 20.01 | 18.9 | | [kotoba-tech/kotoba-whisper-v2.0](https://huggingface.co/kotoba-tech/kotoba-whisper-v2.0) | 16.38 | 21.51 | 16.51 | 19.69 | 20.04 | 18.8 | | **Anime Whisper** | 11.32 | 16.52 | 11.16 | 12.78 | 13.23 | 13.0 | </details> ## ใใคใขใน็ญ ๐จ - ไบบๅ็ญใฎๅบๆๅ่ฉใๅญฆ็ฟใใผใฟใฎใใธใฅใขใซใใใซใซๅญๅจใใๅ ดๅใใใฎใฒใผใ ๅ ใฎๆผขๅญใงๆธใ่ตทใใใใใใจใๅคใ - ไปใซใใใผใฟใปใใใซๅญๅจใใไธ้จ็นๅฎใฎๅ่ชใ้ๅธธใจใฏ็ฐใชใๆธใ่ตทใใใซใชใใใจใใใ๏ผไพ: `ใใใ ` โ `่บซไฝ` ็ญใใใใฎไปๅบๆๅ่ฉ็ญ๏ผ - [ใใผใฟใปใใใฎๆญฃ่ฆๅ](https://huggingface.co/datasets/litagin/Galgame_Speech_ASR_16kHz#modifications) ใซใใใไปฅไธใฎใใฎใฏๅบๅ็ตๆใซใปใผ็พใใชใ: - ๆฏ้ณใ้ท้ณ็ฌฆใฎ้ฃ็ถ: `ใใใใใผใผใผใผ` - ๅใๆๅ็ฌฆใฎ้ฃ็ถ: `ใใใผใฃ!!!!` `ใชใซใใ!?!?!?!?` - ไธ็นใชใผใใผใฎ้ฃ็ถ: `โฆโฆ` ๏ผๆฅๆฌ่ช่กจ่จใจใใฆใฏ2ๅ็จใใ `โฆโฆ` ใๆญฃใใใใใปใผๅธธใซ1ๅใฎใฟ `โฆ` ใงๅบๅใใใ๏ผ - ๆฐๅญใจใขใซใใกใใใใจๆๅ็ฌฆใฏๅ่งใงๆธใ่ตทใใใใ - ๆๆซใฎใใใใฏใปใผๅธธใซ็็ฅใใใ - ไธ้จๅ่ชใฎๆธใ่ตทใใใซไผใๅญใโใใๅซใพใใใใจใใใ ## ไพ ๐ ไธ่จ่ฉไพกใจๅใใ**ๅญฆ็ฟๅ ใซใฏๅ ฅใฃใฆใใชใ**ใใใซใฒใผใ ใฎใปใชใใฎๆธใ่ตทใใๆฏ่ผใงใ๏ผๅๆงใซ`no_repeat_ngram_size=5`ใงใฎ็ๆ๏ผใ ็ตๆใ่ฆใใจใใ ใใใwhisper-large-v3็จๅบฆใฎ่ฏใๆง่ฝใๅบใฆใใใไปฅไธใงใฏไปใขใใซใจใฎๅทฎใ้ก่ใชไพ๏ผ็นใซ้่จ่ช็บ่ฉฑใๆๆ ็ใช้ณๅฃฐ็ญ๏ผใฎใฟใใใคใๆ็ฒใใฆใใพใใ | **ๆญฃ่งฃใใญในใ** | **Anime Whisper** | whisper-large-v3 | kotoba-whisper-v2.0 | reazonspeech-nemo | | --- | --- | --- | --- | --- | | ใใใใใฃ๏ผใใใใใฃ๏ผ | ใฏใใใฃใใใใใใฃโฆ! | ใใใใใใใใใใ | ใใใใ | ใใ! | | ใใฃใใใฃใโฆโฆใโฆโฆโฆใโฆโฆใใใชใใ ใ | ใใฃโฆใใฃใโฆใใใชใใ โฆ | ใใฃใโฆใใใชใใ โฆ | ใใฃใโฆใใใชใใ | ใใฃใใฃใใใฃใใใชใใ ใ | | ใใถใใใผใใๅใคใใฏใ | ใใถใใใใฏใๅใคใใฏใ | ๅคๅใๅใๅใคใฏใใ | ๅคๅๅใๅใคใฏใ | ๅใๅใคใฏใใ | | ใใใใปใฃโฆโฆใชใใ ใใใค๏ผ | ใใปใฃใใใปใฃโฆใชใใ ใใใใคโฆ | ใชใใ ใใใใคโฆ | ใชใใ ใใใค | ใใไฝใ ใใใคใ | | ใฏใฃใใฏใใใใใงใใโฆโฆใใฎใใใฃใจใใธใฃใๅคใ ใฃใใงใใใใ๏ผ | ใฏใใฏใใใใใงใโฆใใฎใใใจโฆใธใๅคใ ใฃใใงใใใใโฆ? | ใใใฏใใใใใงใใใใใใฃใจใใธใๅคใ ใฃใใงใใใใใ | ใฏใใใใงใใใใใจๅคใ ใฃใใงใใใใ | ใใฃใฏใใใใงใใใใใฃใจใธๅคใ ใฃใใงใใใใ? | | ใถใถใถใถ่ฑใฏใฝใใกใกใก๏ผๅพ ใฆใณใซใกใกใก๏ผ | ใถใถใถใถใถใใถใใใใใผ!ๅพ ใฆใใใใ! | ๅพ ใฆใใใผ | ๅพ ใฆใใใ | ๅพ ใฆใใ! | | ๅฐ้ขใๆบใใใจใใใใโฆโฆใใใฃ๏ผ | ๅฐ้ขใๆบใใใจใใใใโฆใฒใใฃ!? | ๅฐ้ขใๆบใใใจใใใใ? | ๅฐ้ขใๆบใใใจใใใใ | ใใฃ! | | ใใใฃใปใ๏ผใใใใใฃใใใใ ใใพใผใ๏ผ | ใใใฃใปใ!ใใใใใใใใ ใใพใผใ! | ใญใฃใใใผ!ใใใใใ ใใพใ! | ใญใฃใใผ!ใใใ ใใพใ! | ใใใใใใ ใใพใ! | | โฆโฆใฃใใฏใโฆโฆใใใใใใไปๆฅใฏโฆโฆ | ใใฃใใฏใโฆใใ็งใไปๆฅใฏโฆ | ็งใไปๆฅใฏโฆ | ็งไปๆฅใฏ | ใใฃใจ็งไปๆฅใ | | โฆโฆใทใตใฃใใณใใใใฃใใใฃใใใฃโฆโฆใทใตใฃใใใฃใใใตใตใฃใใใฃใไพกๅค่ฆณ | ใใตใตใฃโฆใใใใฏใฃโฆใทใฃโฆใฏใใฃโฆใใไพกๅค่ฆณใฃโฆ | ไพกๅค่ฆณ! | ไพกๅค่ฆณ | ใใใใกใใ! | | ใใ็ใใใญใโฆโฆใใใชใใใโฆโฆ๏ผ | ใใ็ใใใญใโฆใใใชใใใใฃโฆ! | ใใๅๅพฉใใญใใใใใชใใใฌใ | ใใใใใใญใใใใช | ใใใใใญใใใใชใใใ | | ใฒใใฃ๏ผใใใใ ใใใใใฃใโฆโฆใใใใฃใใใฏใใใฏใฏใฃ | ใฒใใใฃ!ใใฃใใใ ใฃโฆใใใใฃใใฃโฆใใฃใใใฃใใฏใใฃใใใฏใฏใฃ! | ใใ !ใใใ ! | ใใ | ใใฃใป! | | ใตใใใๆฅใซๆญขใพใใชใใงใใโฆโฆ | ใตใใใๆฅใซๆญขใพใใชใใงใใ | ใใธใใๆฅใซๆญขใพใใชใใงใ | ใใธใๆฅใซๆญขใพใใชใใงใ | ๆฅใซๆญขใพใใชใใงใใ | | ใใใ๏ผ๏ผใญใญใใชใใงใ็งใผ๏ผ | ใใใ50ใญใญใใชใใงใ็งใผ! | 50ใญใญใใชใใงใ็ง! | 550ใญใญใใชใใงใ็ง | 50ใญใญใใชใใงใใใใ! | | ใใใใใใณใฐใใใใใณใฐใใผใใฃ | ใใใใณใฐใใใใณใฐใใผใ! | ใใใใ! ใบใใใซ10! ใบใใใซ10! | ใใใบใใใผใใณ! | ใใฟใพใใใใฟใพใใใ | | ้ๆใใ่ฒดๆงใกใกใก๏ผ | ้ๆใใ่ฒดๆงใใใฃ! | ใใใฑใซใญๆง! | ใพใฌใใใใใพ | ๆใใ่ฒดๆง! | | ใทใใใโฆโฆใฒใฃใใฒใใฃโฆโฆ | ใใฃโฆใใใใฃโฆใทใฃโฆใใใฃโฆ | ใ่ฆ่ดใใใใจใใใใใพใใ | ใใ | ใใใใใใใใใใใ | | ใญใใฏโฆโฆใใใฃใใฏใฃโฆโฆใๆๅใใโฆโฆใใใฃใใใฃใๅฎน่ตฆใใชใใช | ๅใฏใโฆใฏใใฃใใฏใใฃโฆๆๅใใโฆใใใฃใใใฃใๅฎน่ตฆใใชใใชใโฆ | ๅใฏโฆโฆๆๅใใๅฎน่ตฆใใชใใช | ๅใฏๆๅใใใใใๅฎน่ตฆใใชใใช | ๅใฏๆๅใใใใฃใใๅฎน่ตฆใใชใใชใใ | | ๆใใงใใใโฆโฆใใฎใฃใใฎใฃใใฎใฃโฆโฆๆใใงใใใงใใไธ็ใ็ตใใใฐใใใฃใฆโฆโฆๅผทใใๅผทใใฃใใฏใใฃใใฏใใฃ | ๆใใงใใใโฆใฎใใฎใใฎโฆๆใใงใใใงใโฆไธ็ใ็ตใใใฐใใใฃใฆใๅผทใใๅผทใโฆใฏใใฃ | ๆใใงใใใโฆๆใใงใใใงใโฆไธ็ใ็ตใใใฐใใใฃใฆโฆๅผทใโฆๅผทใโฆ | ๆใใงใใใโฆใฎใฎใใใงใใใงใไธ็ใ็ตใใใฐใใใฃใฆๅผทใๅผทใ | ใ?ๆใใงใใใงใใไธ็ใ็ตใใใฐใใใฃใฆๅผทใๅผทใใ | ### NSFWไพ ๐ซฃ ๆไบบๅใใฎ่กจ็พใๅซใพใใใใใ้ฒ่ฆงใซใฏใๆณจๆใใ ใใใ <details> <summary>ๅใๅฃฐ</summary> | **ๆญฃ่งฃใใญในใ** | **Anime Whisper** | whisper-large-v3 | kotoba-whisper-v2.0 | reazonspeech-nemo | | --- | --- | --- | --- | --- | | ใฒใฃใใใฃ๏ผใใ ใฃใใใใใใใใใใใใฃ๏ผใฏใฃใใฏใฃใใฏใฃใใฏใฃใใฒใใฃ๏ผ | ใใใฃใใใฃใใใฃใใใใใใฃ!ใใฃใใฏใใฃใใฏใใฃโฆใใฃใใตใใใใฃ! | ใ่ฆ่ดใใใใจใใใใใพใใ | ใขใใใ | ใใ! | | ใกใใกใใฃโฆโฆใใฃใใใใโฆโฆๆฐๆใกใใใใใใโฆโฆใใใฃใใใใฃใๅพ ใฆใจโฆโฆใใใฃใใฏใโฆโฆใใตใ ใฃโฆโฆ | ใกใใกใใฃโฆใฏใใฃใใฏใใฃใๆฐๆใกใใใใใใใฃโฆใใฃใใใใฃใๅพ ใฆใจใฃโฆใใใฃใใฏใใใฏใใฃโฆ | ใกใใกใโฆๆฐๆใกใใใใใโฆๅพ ใฆใจโฆ | ใกใกใๆฐๆใกใใใใใๅพ ใฆใจ | ใก้ใใฏใๆฐๆใกใใใใใๅพ ใฆใจใใฃใ | | ใใใฃ๏ผใใฃใใใฃโฆโฆใใฃใใใโฆโฆใใฃใใฏใใฏใใฏใใใณใณใณใณใ๏ผใดใฃใใดใใดใใใฃใฆใใฆโฆโฆใใใใฃ๏ผใฏใใฏใใฏใใใใฃใใใใกโฆโฆใใใงใ๏ผ | ใตใใใฃ!ใใฃใใใใฃ!ใใฃใใใใฃโฆใใฃใใฏใใฃใใฏใใฃโฆใใใฃ!ใดใใดใใดใใฃใฆใใใฆโฆใฒใใฃ!ใฏใฃใใฏใใใฏใใฃโฆ!ใใๆฐๆใกใใใใงใใฃโฆ! | ใใโฆใใฃใชใใฃใชใงใใโฆๆฐๆใกใใใงใโฆ | ใใใใฃใชใใฃใชใใชใงใใ | ใใใใใใใงใ! | | ใใฎ่ชฟๅญใฃใฆโฆโฆใใใฃใใใใชใฎใใใใฃใใใฃใใใโฆโฆใใใฃใใใใฃโฆโฆใใใฃโฆโฆใ ใโฆโฆใใฃใใใใฃโฆโฆ | ใใฎ่ชฟๅญใฃใฆโฆใใใฃใใใใชใฎโฆใฏใใฃใใใใฃโฆใใฃใใใใฃโฆใฏใใฃโฆใใกโฆใใฃใใใฃโฆ | ใใฎ่ชฟๅญใฃใฆโฆใใใชใฎโฆใใกโฆ | ใใฎ่ชฟๅญใฃใฆใใใชใฎ | ใใฎ่ชฟๅญใฃใฆใใใใใใชใฎใใกใใ | | ใฏใใฃใใใฃโฆโฆใใฃโฆโฆใใ ใใใใฃโฆโฆใใโฆโฆใใใฏใใใใฏใโฆโฆใ ใใใ โฆโฆใใฃใใใใฃใใตโฆโฆใฒใใใฃ๏ผใใใฃโฆโฆใพใๅพ ใฃใฆใใโฆโฆใใใโฆโฆ๏ผ | ใฏใใฃใใใฃใใใ ใ ใฃโฆใใฃใใใฃใใใใฏใฃโฆใฏใใฃใใใกใ ใฃโฆใใใฃโฆใฒใ ใ ใใฃ!ใใใฃโฆใพใๅพ ใฃใฆใใใฃโฆใใใใฃ! | ใใใฏใใใกใ ใใใใๅพ ใฃใฆใใ | ใใใฏใใใฏใใกใ ใใใใใพใฃใฆใใ | ใใใพๅพ ใฃใฆใใใใใ | | ใใฏใใฏใฃโฆโฆใใฃใใใใฃโฆโฆใชใใใ ใใใโฆโฆๆฐๆใกใใใใใโฆโฆใใฃใใใใใใฃใใฏใใฃใใตใใโฆโฆใใฃใใใ ใ | ใฏใใฃใใฏใใฃใใใฃโฆใใ ใฃโฆใชใใใ ใใใโฆๆฐๆใกใใใใใโฆใใใฃใใใฃใใใใฃโฆใตใใใฃใใฏใใฃโฆใใใฃโฆ | ใใใใใใใใฃใใใใชใใ ใใใใๆฐๆใกใใใใใใใใ,ใใใใใใใใใฃ | ใชใใ ใใใใๆฐๆใกใใใใ | ใใฃใชใใ ใใใใใใฏใๆฐๆใกใใใใใใใ!ใใใใ | | ใ ใใใปใณใใคโฆโฆใใใชใซใใกโใกใๆฟใใใใใ ใใ ใใฃโฆโฆใใฃใใใใใใฃโฆโฆ๏ผ | ใ ใใๅ ่ผฉโฆใใฃใใใใชใซใใใกโใกใๆฟใใใใใ ใโฆใฏใใใใใโฆใฃ | ใใกใๅ ่ผฉโฆใใใชใซ้ฅใใใใใกโฆ | ใใกๅ ่ผฉใใใชใซ่ฝใกๅ ฅใใใใใกใช | ใใกๅ ่ผฉใใใชใซๆฐๅ ฅใใใใใกใ ใ | | ใใใใฃใใใใใใฃใใใกโใกใใใใใชใซใใณใใณใใใใชใใฎใฃโฆโฆใใใฃใใฒใใใใใฃโฆโฆใฏใใฃใใใใฃใใใใใใใฃ๏ผ๏ผ | ใฒใใใฃ!ใใใใใฃใใใกโใกใใใใใชใซใใฏใใฏใใใชใใฎใฃ!ใฒใใฃใใใฃใใฏใใฃใใฏใใฃ! | ใใใใใใใใใใใฃใกใใใชใซใใฏใใฏใใใชใใฎ?ใใใใชใซใใ | ใใใใใฃใกใใใชใซใใฏใใฏใใใชใใฎ | ใใๅ จ็ถใใใชใซใใฏใใฏใใใชใใฎใใ! | | ใใฃโฆโฆใใฃใโฆโฆใๅ ใกใใใฎ่ใใใใฃใไธญใงใใใใฃใโฆโฆใใใชใใใใใใใกใใใใฃใใตใใฃใใใใ ใ ใฃใใใใฃใใใใฃใ | ใใฃใใใฃใใๅ ใกใใใฎ่ใใไธญใงโฆใใใฃใใใใชใซใใใใใใกใโฆใใฃใใใฃใใใฃใใตใใใฃใใใใใฃโฆ! | ใซใใผ!ใๅ ใกใใใฎ่ใใ่ นใงโฆใซใใผ!ใใใชใซใฐใชใฐใชใใโฆใซใใผ!! | ใๅ ใกใใใฎไธใใ่ นใงใใฃใผใใใชใซใฐใชใฐใชใใ | ใๅ ใกใใใฎ่ใใใชใใงใใใใชใซใฐใคใฐใคใใใใฃใซใใ! | | ใฏใฃใๆฟใใโฆโฆใใฆใใณใใใใฃ๏ผใฏใใฃใใฏใใฃโฆโฆใใฃใ็งใโฆโฆไธๆฐใซโฆโฆใณใใใคใใใคใใใกใใฃใฆใใ ใใใ๏ผ | ใฏใๆฟใใใใใฆโฆใใฃใใใ ใฃโฆ็งใใไธๆฐใซโฆใใใคใใใกใใฃใฆใใ ใใโฆ! | ใใใฒใณใทๅใในใใใใขใใใขใโฆ็งใไธๆฐใซใ่กใใใฆใใใใ ใใ! | ใใใใใใใฆ็งใฏไธๆฐใซ่กใใใฆใใ ใใ | ๆฟใใ็งใไธ่ผ่กใใใกใใฃใฆใใ ใใ! | </details> <details> <summary>ใใฅใ้ณ</summary> | **ๆญฃ่งฃใใญในใ** | **Anime Whisper** | whisper-large-v3 | kotoba-whisper-v2.0 | reazonspeech-nemo | | --- | --- | --- | --- | --- | | ใใใฃใใใฃโฆโฆใใใใกใ ใใใกใ | ใใใฃใใใใฃใใกใ ใใใฃ | ใใใใใ | ใใใใ ใ | ใทใฅใ! | | ใฏใฃใใฏใ๏ผใใฃใใใใฃใใใใฃโฆโฆใใฃใใใใฃ | ใฏใใฏใโฆใฃใใใใโฆใฃใใใใ ใฃใใใใใฃโฆ | ใใใฏใใใใใใใใใใใใธใใธใใธ | ใใใฏใ | ใฏใใ | | ใใใฃใใใโฆโฆใใตใตใใใใฎ็ทใชใใใจๅๅฟใใใญใใใกใ ใใกใ ใใฃโฆโฆใใใใ๏ผใฉใ๏ผ | ใใใใใใใฃโฆใใฃใใตใตใฃใใใใฎ็ทใชใใใจๅๅฟใใใญโฆใกใ ใฃใใกใ ใฃโฆใใใใ?ใฉใ? | ใใใฎ็ทใชใใใจๅๅฟใใใญใใใใ?ใฉใ? | ใใใฎ็ทใชใใใจๅๅฟใใใญใใใตใใซ | ใธใธใธใใใฎ็ทใชใใใจๅๅฟใใใญใใใใ?ใฉใ? | | ใใใโฆโฆใกใ โฆโฆใใใใใโฆโฆใโฆโฆใโฆโฆใกใ โฆโฆใใใโฆโฆใใโฆโฆใกใ ใ โฆโฆใกใ ใฑใฃโฆโฆใใใใใโฆโฆ | ใใใกใ ใฃโฆใใใใใฃโฆใใกใ ใฃใใใใฃโฆใกใ ใฑใกใ ใทใฃโฆใใใใฃโฆ | ใขใ ใผโฆ | ใใ | ใใธใใ | | ใใกใ ใฃโฆโฆใใใใโฆโฆใใใใใกใ ใฃใใใใใใใโฆโฆใกใ ใฃใใกใ ใฑใฃโฆโฆ | ใใกใ ใฃใใใใใใฃใใกใ ใฑใกใ ใ ใฃโฆใใใใใใกใ ใฃโฆใกใ ใทใฃโฆ | ใ็ฒใๆงใงใใ | ใใใฌใใใฑใ | ใใ | | ใโฆโฆใคใฏโฆโฆใกใ ใใ โฆโฆใคใใกใใโฆโฆใโฆโฆใใใฃใใกใ ใใใฃใใคใฏโฆโฆใใโฆโฆใใใโฆโฆใใใใโฆโฆใคใฏโฆโฆใคใฏใ ใ โฆโฆ | ใใใใคใฏใฃโฆใคใใกใใโฆใใฃใใใฃใใใ ใใใฃใใคใฏใฃใใใใฃโฆใใใฃใใคใฏใใใคใฏใ! | ใใผใพใใใผใใพใใใผใพใใใใใพใใใใใผ | ใๅ | ใใใใคๅ! | | ใใใโฆโฆโฆโฆใใกใ โฆโฆใใใใโฆโฆใโฆโฆใกใ โฆโฆใใใใโฆโฆใใใใใใโฆโฆใกใ โฆโฆ | ใใใโฆใใกใ ใใใใใโฆใกใ ใฑโฆใใใใใใใกใ โฆ | ใจใซโฆใฉโฆใซโฆใขโฆใจใซโฆใซโฆใโฆใณโฆใจโฆใจใซโฆใโฆใซโฆใข...ใจใซโฆใซ...ใโฆ | ใใใ | | | ใฏใทใฃใใกใ ใทใใใโฆโฆใฏใใใใใฃใใใใฆโฆโฆใกใใฝโฆโฆใใใฃใใกใ ใใดใกใ ใใกใ ใฑใฃโฆโฆใฏใใๅ่ตทใกใใฝใกใใใ ใใๅ่ตทใกใใฝ็งใซใกใใใ ใ | ใใ ใทใฃใใใ ใผใฃ!ๆฉใใใฃใใใใฆใฃใใกใใฝใฃ!ใใใ ใใใใใใฃ!ใฏใใใฃใใฏใใๅ่ตทใกใใฝใกใใใใใฃใๅ่ตทใกโใฝใใใใซใกใใใ ใใฃ! | ๆฉใ่ตทใใใใฆ!ใใณใใณ!ๆฉใใๆฉใใใใญใใณใใณใกใใใ ใ! ใใใญใใณใใณ็งใซใกใใใ ใ!! | ๆฉใๅคงใใใใฆใใณใใณๆฉใใใใญๅ จ้จๅ จ้จ็งใซใกใใใ ใ | ๆฉใใใฃใใๅญใใฆใใใผใ!ใ?ๆฉใๆฉใใใฑๅ จ้จใกใใใ ใใใใฑๅ จ้จ็งใซใกใใใ ใ! | | ใใฃใใใใใโฆโฆใใใฃใใฏใฃโฆโฆใใฃใใใใฐใใใใณใ๏ผใใใใใฃ๏ผใใฃใใใฃใใใฏใโฆโฆใใกใฃใใใใฃใใใใฃใใใใฃใใใใฃใ | ใใใใใใใโฆใฏใใใฏใใใใ้ ๅผตใใโฆใใฃใใใฃใใใฃใใใใใฏใโฆใใใใกใ ใใกใ ใฑใใกใ ใใใฃ | ใใใใใใ้ ๅผตใใ! | ใใใใใ้ ๅผตใใ | ใใใใใใใใใใใฐใใใ | | ใฏใใใกใ ใใใใฃใใใโฆโฆใใใใฃใใตใผใฃใใตใผใฃใใใใชใใธใใใใใฒใ๏ผใกใ ใฃโฆโฆใใ ใฃใโฆโฆใใ ใใใใใฃใใ | ใฏใโฆใกใ ใใใใฃโฆใใใฏใโฆใใใชใใธใใฉใใใใโฆใกใ ใฃใใกใ ใใใฃโฆ | ใใใชโฆๅปไธๅนณโฆ | ใใใชๅปไธๅนณ | ใใใ?ใใใช?ใฉใใใใใใใฃใ | </details> ## ๅญฆ็ฟๆ้ ๐ **่ฉณใใๅญฆ็ฟๆ้ ใใใคใใผใใฉใกใผใฟใๅญฆ็ฟใณใผใใฏใใฎใใก[GitHub](https://github.com/litagin02/anime-whisper)ใงๅ ฌ้ไบๅฎใงใใ** - ๅ จใใผใฟใฎใใก1็ชๆๅพใฎtarใใกใคใซใtestใใผใฟใจใใฆๆฎใใใใไปฅๅคใฎ3,735,363ใใกใคใซใงๅญฆ็ฟ - ใพใใฏใใผในใขใใซใใEncoderใๅ็ตใใฆDecoderใฎใฟใงๆฐใจใใใฏใๅญฆ็ฟ - ใใฎๅพEncoderใฎๅ็ตใ่งฃ้คใใๅ จไฝใงๆฐใจใใใฏใๅญฆ็ฟ - ๅญฆ็ฟๆใกๅใๅพใซใใใใๆ็นใใๅฅใฎๆ็นใพใงใฎใขใใซใฎๅนณๅ๏ผใใผใธ๏ผใใๅใๆไฝใงๆง่ฝๅไธใ่ฉฆใฟใOptunaใไฝฟใฃใฆใใณใใใผใฏใใผใฟใซๅฏพใใCERใงๆ้ฉๅใใใใฎ็ตๆใๆ็ตใขใใซใจใใ ### ็ฐๅข ๐ฅ - ่ช่ นใง[vast.ai](https://vast.ai/)ใง H100 NVL (VRAM 96GB) ใๅใใฆๅ่จ3้ฑ้ๅผฑใ่ฉฆ่ก้ฏ่ชคใใชใใๅญฆ็ฟใใใ๏ผๅฝๅใฏใใผในใขใใซใwhisper-large-v3-turboใซใใฆใใใฎใงใใใฎๅใๅซใพใใ๏ผ - ๅฎ้ใซใใฎใขใใซใซไฝฟใใใๅญฆ็ฟๆ้ใฏใH100 NVL * 11.2ๆฅ ็จๅบฆ๏ผใใ ใๅพๅใฎๆนใฏใใใใ้ๅญฆ็ฟใซใใใในใใใผใฟใซๅฏพใใๆง่ฝใๆชใใฃใใใใๆ็ตใใผใธใซใฏ็จใใชใใฃใ๏ผ