{"action":"created","issue":{"url":"https://api.github.com/repos/mozilla/DeepSpeech/issues/1423","repository_url":"https://api.github.com/repos/mozilla/DeepSpeech","labels_url":"https://api.github.com/repos/mozilla/DeepSpeech/issues/1423/labels{/name}","comments_url":"https://api.github.com/repos/mozilla/DeepSpeech/issues/1423/comments","events_url":"https://api.github.com/repos/mozilla/DeepSpeech/issues/1423/events","html_url":"https://github.com/mozilla/DeepSpeech/issues/1423","id":337234541,"node_id":"MDU6SXNzdWUzMzcyMzQ1NDE=","number":1423,"title":"Common Voice's cv-other-train.csv contains empty transcripts, which cause the training to crash (Labels length is zero in batch 0)","user":{"login":"Franck-Dernoncourt","id":15331,"node_id":"MDQ6VXNlcjE1MzMx","avatar_url":"https://avatars2.githubusercontent.com/u/15331?v=4","gravatar_id":"","url":"https://api.github.com/users/Franck-Dernoncourt","html_url":"https://github.com/Franck-Dernoncourt","followers_url":"https://api.github.com/users/Franck-Dernoncourt/followers","following_url":"https://api.github.com/users/Franck-Dernoncourt/following{/other_user}","gists_url":"https://api.github.com/users/Franck-Dernoncourt/gists{/gist_id}","starred_url":"https://api.github.com/users/Franck-Dernoncourt/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Franck-Dernoncourt/subscriptions","organizations_url":"https://api.github.com/users/Franck-Dernoncourt/orgs","repos_url":"https://api.github.com/users/Franck-Dernoncourt/repos","events_url":"https://api.github.com/users/Franck-Dernoncourt/events{/privacy}","received_events_url":"https://api.github.com/users/Franck-Dernoncourt/received_events","type":"User","site_admin":false},"labels":[{"id":386594038,"node_id":"MDU6TGFiZWwzODY1OTQwMzg=","url":"https://api.github.com/repos/mozilla/DeepSpeech/labels/bug","name":"bug","color":"ee0701","default":true},{"id":710807662,"node_id":"MDU6TGFiZWw3MTA4MDc2NjI=","url":"https://api.github.com/repos/mozilla/DeepSpeech/labels/documentation","name":"documentation","color":"fbca04","default":false}],"state":"closed","locked":false,"assignee":{"login":"lissyx","id":1645737,"node_id":"MDQ6VXNlcjE2NDU3Mzc=","avatar_url":"https://avatars0.githubusercontent.com/u/1645737?v=4","gravatar_id":"","url":"https://api.github.com/users/lissyx","html_url":"https://github.com/lissyx","followers_url":"https://api.github.com/users/lissyx/followers","following_url":"https://api.github.com/users/lissyx/following{/other_user}","gists_url":"https://api.github.com/users/lissyx/gists{/gist_id}","starred_url":"https://api.github.com/users/lissyx/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lissyx/subscriptions","organizations_url":"https://api.github.com/users/lissyx/orgs","repos_url":"https://api.github.com/users/lissyx/repos","events_url":"https://api.github.com/users/lissyx/events{/privacy}","received_events_url":"https://api.github.com/users/lissyx/received_events","type":"User","site_admin":false},"assignees":[{"login":"lissyx","id":1645737,"node_id":"MDQ6VXNlcjE2NDU3Mzc=","avatar_url":"https://avatars0.githubusercontent.com/u/1645737?v=4","gravatar_id":"","url":"https://api.github.com/users/lissyx","html_url":"https://github.com/lissyx","followers_url":"https://api.github.com/users/lissyx/followers","following_url":"https://api.github.com/users/lissyx/following{/other_user}","gists_url":"https://api.github.com/users/lissyx/gists{/gist_id}","starred_url":"https://api.github.com/users/lissyx/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lissyx/subscriptions","organizations_url":"https://api.github.com/users/lissyx/orgs","repos_url":"https://api.github.com/users/lissyx/repos","events_url":"https://api.github.com/users/lissyx/events{/privacy}","received_events_url":"https://api.github.com/users/lissyx/received_events","type":"User","site_admin":false}],"milestone":null,"comments":3,"created_at":"2018-06-30T18:37:38Z","updated_at":"2019-01-02T23:52:41Z","closed_at":"2018-07-02T17:54:55Z","author_association":"NONE","body":"**Issue**: Common Voice's `cv-other-train.csv` contains 2 empty transcripts. which cause the training on `cv-other-train.csv` to crash:\r\n\r\n```\r\ntensorflow.python.framework.errors_impl.InvalidArgumentError: Labels length is zero in batch 0\r\n         [[Node: tower_1/CTCLoss = CTCLoss[ctc_merge_repeated=true, ignore_longer_outputs_than_inputs=false, preprocess_collapse_repeated=false, _device=\"/job:localhost/replica:0/task:0/device:CPU:0\"](tower_1/logits/_1879, tower_1/ToInt64/_1881, tower_1/Gather, tower_1/Gather_1_DequeueMany:1)]]\r\n```\r\n\r\nHowever, in the current [README.md](https://github.com/mozilla/DeepSpeech/blob/28b07e45fd9a10741f2f31b4ed2d8242dba377f2/README.md), it says that one can train DeepSpeech with Common Voice on `cv-other-train.csv`:\r\n\r\n```\r\n./DeepSpeech.py --train_files ../data/CV/cv-valid-train.csv,../data/CV/cv-other-train.csv --dev_files ../data/CV/cv-valid-dev.csv --test_files ../data/CV/cv-valid-test.csv\r\n```\r\n\r\nIt's not user-friendly for people going through the README.md.\r\n\r\n**Suggestions**: \r\n\r\n- Remove `../data/CV/cv-other-train.csv` from the command given in `README.md`\r\n- Amend `import_cv.py` to remove empty transcripts from `cv-other-train.csv`\r\n- Ignore empty transcripts in `DeepSpeech.py`\r\n"},"comment":{"url":"https://api.github.com/repos/mozilla/DeepSpeech/issues/comments/451021353","html_url":"https://github.com/mozilla/DeepSpeech/issues/1423#issuecomment-451021353","issue_url":"https://api.github.com/repos/mozilla/DeepSpeech/issues/1423","id":451021353,"node_id":"MDEyOklzc3VlQ29tbWVudDQ1MTAyMTM1Mw==","user":{"login":"lock[bot]","id":33595554,"node_id":"MDM6Qm90MzM1OTU1NTQ=","avatar_url":"https://avatars1.githubusercontent.com/in/6672?v=4","gravatar_id":"","url":"https://api.github.com/users/lock%5Bbot%5D","html_url":"https://github.com/apps/lock","followers_url":"https://api.github.com/users/lock%5Bbot%5D/followers","following_url":"https://api.github.com/users/lock%5Bbot%5D/following{/other_user}","gists_url":"https://api.github.com/users/lock%5Bbot%5D/gists{/gist_id}","starred_url":"https://api.github.com/users/lock%5Bbot%5D/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lock%5Bbot%5D/subscriptions","organizations_url":"https://api.github.com/users/lock%5Bbot%5D/orgs","repos_url":"https://api.github.com/users/lock%5Bbot%5D/repos","events_url":"https://api.github.com/users/lock%5Bbot%5D/events{/privacy}","received_events_url":"https://api.github.com/users/lock%5Bbot%5D/received_events","type":"Bot","site_admin":false},"created_at":"2019-01-02T23:52:41Z","updated_at":"2019-01-02T23:52:41Z","author_association":"NONE","body":"This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.\n"}}
{"actor":{"display_login":"lock"}}