{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/5112","repository_url":"https://api.github.com/repos/tensorflow/tensorflow","labels_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/5112/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/5112/comments","events_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/5112/events","html_url":"https://github.com/tensorflow/tensorflow/issues/5112","id":184449924,"number":5112,"title":"Does tensorflow support to write checkpoint to hdfs?","user":{"login":"qingzew","id":3603171,"avatar_url":"https://avatars.githubusercontent.com/u/3603171?v=3","gravatar_id":"","url":"https://api.github.com/users/qingzew","html_url":"https://github.com/qingzew","followers_url":"https://api.github.com/users/qingzew/followers","following_url":"https://api.github.com/users/qingzew/following{/other_user}","gists_url":"https://api.github.com/users/qingzew/gists{/gist_id}","starred_url":"https://api.github.com/users/qingzew/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/qingzew/subscriptions","organizations_url":"https://api.github.com/users/qingzew/orgs","repos_url":"https://api.github.com/users/qingzew/repos","events_url":"https://api.github.com/users/qingzew/events{/privacy}","received_events_url":"https://api.github.com/users/qingzew/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/tensorflow/tensorflow/labels/awaiting%20googler","name":"awaiting googler","color":"b60205"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-10-21T10:15:13Z","updated_at":"2016-10-22T09:17:33Z","closed_at":null,"body":"now tensorflow 0.11 can read data from hdfs, so how can I write checkpoint to hdfs? for example:\r\n```python\r\nsaver.save(save_path='hdfs://some_dir')\r\n```"},"comment":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/comments/255517116","html_url":"https://github.com/tensorflow/tensorflow/issues/5112#issuecomment-255517116","issue_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/5112","id":255517116,"user":{"login":"qingzew","id":3603171,"avatar_url":"https://avatars.githubusercontent.com/u/3603171?v=3","gravatar_id":"","url":"https://api.github.com/users/qingzew","html_url":"https://github.com/qingzew","followers_url":"https://api.github.com/users/qingzew/followers","following_url":"https://api.github.com/users/qingzew/following{/other_user}","gists_url":"https://api.github.com/users/qingzew/gists{/gist_id}","starred_url":"https://api.github.com/users/qingzew/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/qingzew/subscriptions","organizations_url":"https://api.github.com/users/qingzew/orgs","repos_url":"https://api.github.com/users/qingzew/repos","events_url":"https://api.github.com/users/qingzew/events{/privacy}","received_events_url":"https://api.github.com/users/qingzew/received_events","type":"User","site_admin":false},"created_at":"2016-10-22T09:17:33Z","updated_at":"2016-10-22T09:17:33Z","body":"ok, I have tested it. It can do that, but sometimes with an error:\r\n```shell\r\nTraceback (most recent call last):\r\n  File \"cifar10_train.py\", line 134, in <module>\r\n    tf.app.run()\r\n  File \"/usr/lib/python2.7/site-packages/tensorflow/python/platform/app.py\", line 30, in run\r\n    sys.exit(main(sys.argv[:1] + flags_passthrough))\r\n  File \"cifar10_train.py\", line 130, in main\r\n    train()\r\n  File \"cifar10_train.py\", line 122, in train\r\n    saver.save(sess, checkpoint_path, global_step=step)\r\n  File \"/usr/lib/python2.7/site-packages/tensorflow/python/training/saver.py\", line 1281, in save\r\n    self.last_checkpoints, latest_filename)\r\n  File \"/usr/lib/python2.7/site-packages/tensorflow/python/training/saver.py\", line 743, in update_checkpoint_state\r\n    file_io.rename(temp_pathname, coord_checkpoint_filename, overwrite=True)\r\n  File \"/usr/lib/python2.7/site-packages/tensorflow/python/lib/io/file_io.py\", line 295, in rename\r\n    compat.as_bytes(oldname), compat.as_bytes(newname), overwrite, status)\r\n  File \"/usr/lib64/python2.7/contextlib.py\", line 24, in __exit__\r\n    self.gen.next()\r\n  File \"/usr/lib/python2.7/site-packages/tensorflow/python/framework/errors.py\", line 463, in raise_exception_on_not_ok_status\r\n    pywrap_tensorflow.TF_GetCode(status))\r\ntensorflow.python.framework.errors.UnknownError\r\n```\r\n\r\nyou just to modify cifar10 like this:\r\n```python\r\ntf.app.flags.DEFINE_string('train_dir', 'hdfs://localhost:9000/cifar10_train'\r\n```"}}
{"actor":{"display_login":"qingzew"}}