{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/serving/issues/359","repository_url":"https://api.github.com/repos/tensorflow/serving","labels_url":"https://api.github.com/repos/tensorflow/serving/issues/359/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/serving/issues/359/comments","events_url":"https://api.github.com/repos/tensorflow/serving/issues/359/events","html_url":"https://github.com/tensorflow/serving/issues/359","id":214897310,"node_id":"MDU6SXNzdWUyMTQ4OTczMTA=","number":359,"title":"Fail to load the models from HDFS","user":{"login":"tobegit3hub","id":2715000,"node_id":"MDQ6VXNlcjI3MTUwMDA=","avatar_url":"https://avatars0.githubusercontent.com/u/2715000?v=4","gravatar_id":"","url":"https://api.github.com/users/tobegit3hub","html_url":"https://github.com/tobegit3hub","followers_url":"https://api.github.com/users/tobegit3hub/followers","following_url":"https://api.github.com/users/tobegit3hub/following{/other_user}","gists_url":"https://api.github.com/users/tobegit3hub/gists{/gist_id}","starred_url":"https://api.github.com/users/tobegit3hub/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tobegit3hub/subscriptions","organizations_url":"https://api.github.com/users/tobegit3hub/orgs","repos_url":"https://api.github.com/users/tobegit3hub/repos","events_url":"https://api.github.com/users/tobegit3hub/events{/privacy}","received_events_url":"https://api.github.com/users/tobegit3hub/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":11,"created_at":"2017-03-17T03:19:13Z","updated_at":"2018-06-07T02:00:04Z","closed_at":"2017-04-24T13:01:29Z","author_association":"CONTRIBUTOR","body":"We have tested the integration of TensorFlow and HDFS. It works for training and we can use TensorFlow APIs to access HDFS data.\r\n\r\nHowever, I use that version of TensorFlow to build TensorFlow Serving and the server could not load the files from HDFS. I think TensorFlow Serving use the native TensorFlow Filesystem APIs and it should support HDFS well.\r\n\r\nWe pass the path of HDFS like this.\r\n\r\n```\r\n--model_base_path=hdfs://namenode:10000/user/u_chendihao/deep_recommend_system/model/\r\n```\r\n\r\nHere is the error log.\r\n\r\n```\r\nE tensorflow_serving/sources/storage_path/file_system_storage_path_source.cc:304] FileSystemStoragePathSource encountered a file-system access error: Could not find base path hdfs://namenode:10000/user/u_chendihao/deep_recommend_system/model/ for servable dense\r\n```"},"comment":{"url":"https://api.github.com/repos/tensorflow/serving/issues/comments/395268621","html_url":"https://github.com/tensorflow/serving/issues/359#issuecomment-395268621","issue_url":"https://api.github.com/repos/tensorflow/serving/issues/359","id":395268621,"node_id":"MDEyOklzc3VlQ29tbWVudDM5NTI2ODYyMQ==","user":{"login":"JohnHerry","id":8011802,"node_id":"MDQ6VXNlcjgwMTE4MDI=","avatar_url":"https://avatars0.githubusercontent.com/u/8011802?v=4","gravatar_id":"","url":"https://api.github.com/users/JohnHerry","html_url":"https://github.com/JohnHerry","followers_url":"https://api.github.com/users/JohnHerry/followers","following_url":"https://api.github.com/users/JohnHerry/following{/other_user}","gists_url":"https://api.github.com/users/JohnHerry/gists{/gist_id}","starred_url":"https://api.github.com/users/JohnHerry/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JohnHerry/subscriptions","organizations_url":"https://api.github.com/users/JohnHerry/orgs","repos_url":"https://api.github.com/users/JohnHerry/repos","events_url":"https://api.github.com/users/JohnHerry/events{/privacy}","received_events_url":"https://api.github.com/users/JohnHerry/received_events","type":"User","site_admin":false},"created_at":"2018-06-07T02:00:04Z","updated_at":"2018-06-07T02:00:04Z","author_association":"NONE","body":"Yes, I missed some environment variable about hadoop before.\r\nIf you still have such problem, try as follows:\r\n# in $HOME/.bash_profile.\r\n`export HADOOP_HOME=/home/john/tests/hdfs_tensorflow/hadoop/hadoop-2.8.0\r\nexport HADOOP_INSTALL=$HADOOP_HOME\r\nexport HADOOP_MAPRED_HOME=$HADOOP_HOME\r\nexport HADOOP_COMMON_HOME=$HADOOP_HOME\r\nexport HADOOP_HDFS_HOME=$HADOOP_HOME\r\nexport YARN_HOME=$HADOOP_HOME\r\nexport HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native\r\nexport PATH=$PATH:$HADOOP_HOME/sbin:$HADOOP_HOME/bin`\r\n"}}
{"actor":{"display_login":"JohnHerry"}}