{"action":"created","issue":{"url":"https://api.github.com/repos/Microsoft/CNTK/issues/738","repository_url":"https://api.github.com/repos/Microsoft/CNTK","labels_url":"https://api.github.com/repos/Microsoft/CNTK/issues/738/labels{/name}","comments_url":"https://api.github.com/repos/Microsoft/CNTK/issues/738/comments","events_url":"https://api.github.com/repos/Microsoft/CNTK/issues/738/events","html_url":"https://github.com/Microsoft/CNTK/issues/738","id":169467511,"number":738,"title":"Implementation of Time and Frequency LSTM","user":{"login":"funguy74","id":17862588,"avatar_url":"https://avatars.githubusercontent.com/u/17862588?v=3","gravatar_id":"","url":"https://api.github.com/users/funguy74","html_url":"https://github.com/funguy74","followers_url":"https://api.github.com/users/funguy74/followers","following_url":"https://api.github.com/users/funguy74/following{/other_user}","gists_url":"https://api.github.com/users/funguy74/gists{/gist_id}","starred_url":"https://api.github.com/users/funguy74/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/funguy74/subscriptions","organizations_url":"https://api.github.com/users/funguy74/orgs","repos_url":"https://api.github.com/users/funguy74/repos","events_url":"https://api.github.com/users/funguy74/events{/privacy}","received_events_url":"https://api.github.com/users/funguy74/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2016-08-04T20:35:18Z","updated_at":"2016-08-05T00:08:54Z","closed_at":null,"body":"TF LSTM is based on the following Microsoft paper:\r\nhttps://www.microsoft.com/en-us/research/publication/lstm-time-and-frequency-recurrence-for-automatic-speech-recognition/\r\n\r\nFrom paper, the author said TF-LSTM is implemented in CNTK. I'm wondering how it can be implemented in CNTK.\r\n\r\nBasically, F-LSTM and T-LSTM has different operational time scale:\r\n\r\n1) For each time t, F-LSTM should swipe log-filter frequency chunks.\r\n2) After finishing frequency swiping, L-LSTM can start operation at time t\r\n\r\nSo, basically, L-LSTM should wait until collecting all F-LSTM output at time t. How can we implement this in ndl file or brainscript?  What I understand in ndl format is that we can only designate connection and operational units but we cannot assign operational time scale.\r\n\r\nShould we modify source code?\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/Microsoft/CNTK/issues/comments/237722321","html_url":"https://github.com/Microsoft/CNTK/issues/738#issuecomment-237722321","issue_url":"https://api.github.com/repos/Microsoft/CNTK/issues/738","id":237722321,"user":{"login":"funguy74","id":17862588,"avatar_url":"https://avatars.githubusercontent.com/u/17862588?v=3","gravatar_id":"","url":"https://api.github.com/users/funguy74","html_url":"https://github.com/funguy74","followers_url":"https://api.github.com/users/funguy74/followers","following_url":"https://api.github.com/users/funguy74/following{/other_user}","gists_url":"https://api.github.com/users/funguy74/gists{/gist_id}","starred_url":"https://api.github.com/users/funguy74/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/funguy74/subscriptions","organizations_url":"https://api.github.com/users/funguy74/orgs","repos_url":"https://api.github.com/users/funguy74/repos","events_url":"https://api.github.com/users/funguy74/events{/privacy}","received_events_url":"https://api.github.com/users/funguy74/received_events","type":"User","site_admin":false},"created_at":"2016-08-05T00:08:54Z","updated_at":"2016-08-05T00:08:54Z","body":"Therefore, by recursively calling LSTM inside layer, we can implement fixed-dimensional F-LSTM in CNTK. It looks like we can easily extend it into TF-LSTM (not separate but simultaneous) by using similar trick.\r\n\r\nI really thank both of you. Also, Jinyli, could you notify bug fixed in this thread if it is fixed? I like to try TF-LSTM training when you fix it."}}
{"actor":{"display_login":"funguy74"}}