{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1037","repository_url":"https://api.github.com/repos/tensorflow/tensorflow","labels_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1037/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1037/comments","events_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1037/events","html_url":"https://github.com/tensorflow/tensorflow/issues/1037","id":132531284,"number":1037,"title":"bidirectional_rnn return state","user":{"login":"lucaswiser","id":13629847,"avatar_url":"https://avatars.githubusercontent.com/u/13629847?v=3","gravatar_id":"","url":"https://api.github.com/users/lucaswiser","html_url":"https://github.com/lucaswiser","followers_url":"https://api.github.com/users/lucaswiser/followers","following_url":"https://api.github.com/users/lucaswiser/following{/other_user}","gists_url":"https://api.github.com/users/lucaswiser/gists{/gist_id}","starred_url":"https://api.github.com/users/lucaswiser/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lucaswiser/subscriptions","organizations_url":"https://api.github.com/users/lucaswiser/orgs","repos_url":"https://api.github.com/users/lucaswiser/repos","events_url":"https://api.github.com/users/lucaswiser/events{/privacy}","received_events_url":"https://api.github.com/users/lucaswiser/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"ebrevdo","id":1794715,"avatar_url":"https://avatars.githubusercontent.com/u/1794715?v=3","gravatar_id":"","url":"https://api.github.com/users/ebrevdo","html_url":"https://github.com/ebrevdo","followers_url":"https://api.github.com/users/ebrevdo/followers","following_url":"https://api.github.com/users/ebrevdo/following{/other_user}","gists_url":"https://api.github.com/users/ebrevdo/gists{/gist_id}","starred_url":"https://api.github.com/users/ebrevdo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ebrevdo/subscriptions","organizations_url":"https://api.github.com/users/ebrevdo/orgs","repos_url":"https://api.github.com/users/ebrevdo/repos","events_url":"https://api.github.com/users/ebrevdo/events{/privacy}","received_events_url":"https://api.github.com/users/ebrevdo/received_events","type":"User","site_admin":false},"milestone":null,"comments":8,"created_at":"2016-02-09T20:54:09Z","updated_at":"2016-06-06T19:05:39Z","closed_at":null,"body":"Hi I am wondering why the bi-directional rnn doesn't return a final state? From a code point of view it would be very easy to return. I.e line 301 in rnn.py  \r\n\r\n output_fw, _ = rnn(cell_fw, inputs, initial_state_fw, dtype,\r\n                       sequence_length)\r\n\r\nOne could just return _ (named as final_state or whatever) with the concatenated outputs at the end. Is there any theoretical reason why you would never want the final output state? I was planning on feeding the final forward state as the initial state of the forward and backward rnn's on the next pass. The reason I am wanting to do this is the sequences I am working on are much longer than the number of steps I can unroll (seqs are about 15k on average, I'm unrolling 1000 steps) so continuing state is pretty important. It seems weird that the bidirectional rnn would even have the ability to input an initial state but you can't return the output state (what state would you feed in if not the output of the last pass?) \r\n\r\nLet me know what you think, i'm no rnn expert. \r\n\r\nOff topic but does anyone have any advice for super long sequences? What is the maximum you think I could unroll? Are there other techniques I could use besides long unroll and refeeding the outputs? Can LSTM even learn 1000+ step dependencies? \r\n"},"comment":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/comments/224056250","html_url":"https://github.com/tensorflow/tensorflow/issues/1037#issuecomment-224056250","issue_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/1037","id":224056250,"user":{"login":"girving","id":70511,"avatar_url":"https://avatars.githubusercontent.com/u/70511?v=3","gravatar_id":"","url":"https://api.github.com/users/girving","html_url":"https://github.com/girving","followers_url":"https://api.github.com/users/girving/followers","following_url":"https://api.github.com/users/girving/following{/other_user}","gists_url":"https://api.github.com/users/girving/gists{/gist_id}","starred_url":"https://api.github.com/users/girving/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/girving/subscriptions","organizations_url":"https://api.github.com/users/girving/orgs","repos_url":"https://api.github.com/users/girving/repos","events_url":"https://api.github.com/users/girving/events{/privacy}","received_events_url":"https://api.github.com/users/girving/received_events","type":"User","site_admin":false},"created_at":"2016-06-06T19:05:39Z","updated_at":"2016-06-06T19:05:39Z","body":"@ebrevdo: Do we have dynamic RNNs yet? "}}
{"actor":{"display_login":"girving"}}