{"action":"created","issue":{"url":"https://api.github.com/repos/sampepose/flownet2-tf/issues/52","repository_url":"https://api.github.com/repos/sampepose/flownet2-tf","labels_url":"https://api.github.com/repos/sampepose/flownet2-tf/issues/52/labels{/name}","comments_url":"https://api.github.com/repos/sampepose/flownet2-tf/issues/52/comments","events_url":"https://api.github.com/repos/sampepose/flownet2-tf/issues/52/events","html_url":"https://github.com/sampepose/flownet2-tf/issues/52","id":358670132,"node_id":"MDU6SXNzdWUzNTg2NzAxMzI=","number":52,"title":"out of memory error","user":{"login":"xiaojifeng","id":28840940,"node_id":"MDQ6VXNlcjI4ODQwOTQw","avatar_url":"https://avatars3.githubusercontent.com/u/28840940?v=4","gravatar_id":"","url":"https://api.github.com/users/xiaojifeng","html_url":"https://github.com/xiaojifeng","followers_url":"https://api.github.com/users/xiaojifeng/followers","following_url":"https://api.github.com/users/xiaojifeng/following{/other_user}","gists_url":"https://api.github.com/users/xiaojifeng/gists{/gist_id}","starred_url":"https://api.github.com/users/xiaojifeng/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/xiaojifeng/subscriptions","organizations_url":"https://api.github.com/users/xiaojifeng/orgs","repos_url":"https://api.github.com/users/xiaojifeng/repos","events_url":"https://api.github.com/users/xiaojifeng/events{/privacy}","received_events_url":"https://api.github.com/users/xiaojifeng/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-09-10T15:15:28Z","updated_at":"2018-09-11T14:29:17Z","closed_at":"2018-09-11T14:29:17Z","author_association":"NONE","body":"I'm trying to train the model from scratch, using the command line \"python -m src.flownet2.train\". But after some iterations the process was killed. I found that because python tried to comsume about 70 GB memory so the kernel kill the process. I don't change the code, just training with the original code and the original training data \"fc_sample.tfrecords\". I want to know is that normal? How many memory do i need to train this model?"},"comment":{"url":"https://api.github.com/repos/sampepose/flownet2-tf/issues/comments/420294396","html_url":"https://github.com/sampepose/flownet2-tf/issues/52#issuecomment-420294396","issue_url":"https://api.github.com/repos/sampepose/flownet2-tf/issues/52","id":420294396,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMDI5NDM5Ng==","user":{"login":"xiaojifeng","id":28840940,"node_id":"MDQ6VXNlcjI4ODQwOTQw","avatar_url":"https://avatars3.githubusercontent.com/u/28840940?v=4","gravatar_id":"","url":"https://api.github.com/users/xiaojifeng","html_url":"https://github.com/xiaojifeng","followers_url":"https://api.github.com/users/xiaojifeng/followers","following_url":"https://api.github.com/users/xiaojifeng/following{/other_user}","gists_url":"https://api.github.com/users/xiaojifeng/gists{/gist_id}","starred_url":"https://api.github.com/users/xiaojifeng/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/xiaojifeng/subscriptions","organizations_url":"https://api.github.com/users/xiaojifeng/orgs","repos_url":"https://api.github.com/users/xiaojifeng/repos","events_url":"https://api.github.com/users/xiaojifeng/events{/privacy}","received_events_url":"https://api.github.com/users/xiaojifeng/received_events","type":"User","site_admin":false},"created_at":"2018-09-11T14:29:17Z","updated_at":"2018-09-11T14:29:17Z","author_association":"NONE","body":"I've found the solution: just set num_threads as 1 and reduce the value common_queue_capacity and common_queue_min. "}}
{"actor":{"display_login":"xiaojifeng"}}