{"action":"created","issue":{"url":"https://api.github.com/repos/SeanNaren/deepspeech.torch/issues/51","repository_url":"https://api.github.com/repos/SeanNaren/deepspeech.torch","labels_url":"https://api.github.com/repos/SeanNaren/deepspeech.torch/issues/51/labels{/name}","comments_url":"https://api.github.com/repos/SeanNaren/deepspeech.torch/issues/51/comments","events_url":"https://api.github.com/repos/SeanNaren/deepspeech.torch/issues/51/events","html_url":"https://github.com/SeanNaren/deepspeech.torch/issues/51","id":180453043,"number":51,"title":"What is the possible improvement on the performance of this project? ","user":{"login":"chanil1218","id":1420133,"avatar_url":"https://avatars.githubusercontent.com/u/1420133?v=3","gravatar_id":"","url":"https://api.github.com/users/chanil1218","html_url":"https://github.com/chanil1218","followers_url":"https://api.github.com/users/chanil1218/followers","following_url":"https://api.github.com/users/chanil1218/following{/other_user}","gists_url":"https://api.github.com/users/chanil1218/gists{/gist_id}","starred_url":"https://api.github.com/users/chanil1218/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chanil1218/subscriptions","organizations_url":"https://api.github.com/users/chanil1218/orgs","repos_url":"https://api.github.com/users/chanil1218/repos","events_url":"https://api.github.com/users/chanil1218/events{/privacy}","received_events_url":"https://api.github.com/users/chanil1218/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2016-10-01T11:58:10Z","updated_at":"2016-10-04T11:45:38Z","closed_at":null,"body":"I've trained LibriSpeech train-clean-100 dataset with 20 epoch and get this results. \r\n\r\n`Training Epoch: 20 Average Loss: 2.504252 Average Validation WER: 40.84 Average Validation CER: 3.60`\r\nIt doesn't seem maximally optimized as done in the paper(They suggest 1% of their dataset, 120 hours and got WER 29.23). \r\n\r\nBut the result seems encouraging for catching up their performance by adapting few techniques. Like SortaGrad or Language Models. \r\n\r\nCould you suggest me what part of the paper is not implemented in here or possible improvements, then I could work on it improving performance of this project! "},"comment":{"url":"https://api.github.com/repos/SeanNaren/deepspeech.torch/issues/comments/251365791","html_url":"https://github.com/SeanNaren/deepspeech.torch/issues/51#issuecomment-251365791","issue_url":"https://api.github.com/repos/SeanNaren/deepspeech.torch/issues/51","id":251365791,"user":{"login":"chanil1218","id":1420133,"avatar_url":"https://avatars.githubusercontent.com/u/1420133?v=3","gravatar_id":"","url":"https://api.github.com/users/chanil1218","html_url":"https://github.com/chanil1218","followers_url":"https://api.github.com/users/chanil1218/followers","following_url":"https://api.github.com/users/chanil1218/following{/other_user}","gists_url":"https://api.github.com/users/chanil1218/gists{/gist_id}","starred_url":"https://api.github.com/users/chanil1218/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chanil1218/subscriptions","organizations_url":"https://api.github.com/users/chanil1218/orgs","repos_url":"https://api.github.com/users/chanil1218/repos","events_url":"https://api.github.com/users/chanil1218/events{/privacy}","received_events_url":"https://api.github.com/users/chanil1218/received_events","type":"User","site_admin":false},"created_at":"2016-10-04T11:45:38Z","updated_at":"2016-10-04T11:45:38Z","body":"I just found this projects implements SortaGrad with initial sorted LMDB data and `permuteBatchOrder`. \r\n\r\nAnd while seeing [this lecture, Deep Learning for Speech Recognition (Adam Coates, Baidu) - around 1:15:10](https://www.youtube.com/watch?v=g-sndkf7mCs), normalizing utterances so that batches have similar lengths by padding some short utterances would improve performance after first sorted epoch. \r\n\r\nWhat do you think? "}}
{"actor":{"display_login":"chanil1218"}}