{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/models/issues/5392","repository_url":"https://api.github.com/repos/tensorflow/models","labels_url":"https://api.github.com/repos/tensorflow/models/issues/5392/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/models/issues/5392/comments","events_url":"https://api.github.com/repos/tensorflow/models/issues/5392/events","html_url":"https://github.com/tensorflow/models/issues/5392","id":364678422,"node_id":"MDU6SXNzdWUzNjQ2Nzg0MjI=","number":5392,"title":"Tensor batch_normalization/beta is not found in /home/resnet_v2_imagenet_checkpoint/model.ckpt-258931","user":{"login":"vilmara","id":30601934,"node_id":"MDQ6VXNlcjMwNjAxOTM0","avatar_url":"https://avatars0.githubusercontent.com/u/30601934?v=4","gravatar_id":"","url":"https://api.github.com/users/vilmara","html_url":"https://github.com/vilmara","followers_url":"https://api.github.com/users/vilmara/followers","following_url":"https://api.github.com/users/vilmara/following{/other_user}","gists_url":"https://api.github.com/users/vilmara/gists{/gist_id}","starred_url":"https://api.github.com/users/vilmara/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vilmara/subscriptions","organizations_url":"https://api.github.com/users/vilmara/orgs","repos_url":"https://api.github.com/users/vilmara/repos","events_url":"https://api.github.com/users/vilmara/events{/privacy}","received_events_url":"https://api.github.com/users/vilmara/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":{"login":"robieta","id":13089297,"node_id":"MDQ6VXNlcjEzMDg5Mjk3","avatar_url":"https://avatars0.githubusercontent.com/u/13089297?v=4","gravatar_id":"","url":"https://api.github.com/users/robieta","html_url":"https://github.com/robieta","followers_url":"https://api.github.com/users/robieta/followers","following_url":"https://api.github.com/users/robieta/following{/other_user}","gists_url":"https://api.github.com/users/robieta/gists{/gist_id}","starred_url":"https://api.github.com/users/robieta/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/robieta/subscriptions","organizations_url":"https://api.github.com/users/robieta/orgs","repos_url":"https://api.github.com/users/robieta/repos","events_url":"https://api.github.com/users/robieta/events{/privacy}","received_events_url":"https://api.github.com/users/robieta/received_events","type":"User","site_admin":false},"assignees":[{"login":"robieta","id":13089297,"node_id":"MDQ6VXNlcjEzMDg5Mjk3","avatar_url":"https://avatars0.githubusercontent.com/u/13089297?v=4","gravatar_id":"","url":"https://api.github.com/users/robieta","html_url":"https://github.com/robieta","followers_url":"https://api.github.com/users/robieta/followers","following_url":"https://api.github.com/users/robieta/following{/other_user}","gists_url":"https://api.github.com/users/robieta/gists{/gist_id}","starred_url":"https://api.github.com/users/robieta/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/robieta/subscriptions","organizations_url":"https://api.github.com/users/robieta/orgs","repos_url":"https://api.github.com/users/robieta/repos","events_url":"https://api.github.com/users/robieta/events{/privacy}","received_events_url":"https://api.github.com/users/robieta/received_events","type":"User","site_admin":false}],"milestone":null,"comments":1,"created_at":"2018-09-27T22:35:34Z","updated_at":"2018-10-03T00:13:48Z","closed_at":"2018-10-02T23:46:47Z","author_association":"NONE","body":"### System information\r\n- **What is the top-level directory of the model you are using**:  /models/official/resnet\r\n- **Have I written custom code (as opposed to using a stock example script provided in TensorFlow)**: Yes\r\n- **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: Ubuntu 16.04.5 LTS (GNU/Linux 4.4.0-128-generic x86_64)\r\n- **TensorFlow installed from (source or binary)**: binary\r\n- **TensorFlow version (use command below)**: v1.10.1-0-g4dcfddc5d1 1.10.1\r\n- **Bazel version (if compiling from source)**: n/a\r\n- **CUDA/cuDNN version**: CUDA Version 9.0.176 / 7.2.1\r\n- **GPU model and memory**: Tesla V100-SXM2-32GB\r\n- **Exact command to reproduce**:\r\n\r\n### Describe the problem\r\nI am using the official model resnet50 to train my small dataset using transfer learning,  have tried to run my script with both pretrained checkpoint versions I downloaded from the official resnet in TensorFlow website https://github.com/tensorflow/models/tree/master/official/resnet  : ResNet-50 v2 and ResNet-50 v2 (fp16), but I am getting the below errors:\r\n\r\nUsing ResNet-50 v2 checkpoints:  \r\n`Tensor batch_normalization/beta is not found in /home/resnet_v2_imagenet_checkpoint/model.ckpt-258931`\r\n\r\nUsing ResNet-50 v2 (fp16) checkpoints: \r\n`Tensor batch_normalization/beta is not found in /home/resnet_v2_fp16_imagenet_checkpoint/model.ckpt-62500`\r\n\r\nUsing ResNet-50 v1 checkpoints:\r\n`Tensor batch_normalization/beta is not found in /home/resnet_v1_imagenet_checkpoint/model.ckpt-257706`\r\n\r\nIt looks like the script is unable to restore the model from checkpoint file I am pointing to\r\n\r\n### Source code / logs\r\n```\r\nroot@C4140-V100-1:/home/chexnet/# python3 chexnet_vs.py\r\nINFO:tensorflow:Using` config: {'_task_id': 0, '_service': None, '_master': '', '_global_id_in_cluster': 0, '_save_checkpoints_secs': 1000000000.0, '_is_chief': True, '_cluster_spec': <tensorflow.python.training.server_lib.ClusterSpec object at 0x7f647b8fb4e0>, '_model_dir': '/home/chexnet_checkpoints', '_save_checkpoints_steps': None, '_num_ps_replicas': 0, '_device_fn': None, '_save_summary_steps': 100, '_tf_random_seed': None, '_num_worker_replicas': 1, '_train_distribute': None, '_keep_checkpoint_max': 5, '_task_type': 'worker', '_log_step_count_steps': 100, '_keep_checkpoint_every_n_hours': 10000, '_session_config': None, '_evaluation_master': ''}\r\nStarting a training cycle.\r\nWARNING:tensorflow:From chexnet_vs.py:128: batch_and_drop_remainder (from tensorflow.contrib.data.python.ops.batching) is deprecated and will be removed in a future version.\r\nInstructions for updating:\r\nUse `tf.data.Dataset.batch(..., drop_remainder=True)`.\r\nINFO:tensorflow:Calling model_fn.\r\nTraceback (most recent call last):\r\n  File \"chexnet_vs.py\", line 230, in <module>\r\n    tf.app.run(argv=[sys.argv[0]] + unparsed)\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/platform/app.py\", line 125, in run\r\n    _sys.exit(main(argv))\r\n  File \"chexnet_vs.py\", line 220, in main\r\n    hooks=[logging_hook])\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py\", line 376, in train\r\n    loss = self._train_model(input_fn, hooks, saving_listeners)\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py\", line 1145, in _train_model\r\n    return self._train_model_default(input_fn, hooks, saving_listeners)\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py\", line 1170, in _train_model_default\r\n    features, labels, model_fn_lib.ModeKeys.TRAIN, self.config)\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py\", line 1133, in _call_model_fn\r\n    model_fn_results = self._model_fn(features=features, **kwargs)\r\n  File \"chexnet_vs.py\", line 147, in model_fn\r\n    {var.name.split(':')[0]: var for var in vars_to_restore})\r\n  File \"/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/checkpoint_utils.py\", line 206, in init_from_checkpoint\r\n    tensor_name_in_ckpt, ckpt_dir_or_file, variable_map\r\nValueError: Tensor batch_normalization/beta is not found in /home/resnet_v2_imagenet_checkpoint/model.ckpt-62500 checkpoint\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/tensorflow/models/issues/comments/426471934","html_url":"https://github.com/tensorflow/models/issues/5392#issuecomment-426471934","issue_url":"https://api.github.com/repos/tensorflow/models/issues/5392","id":426471934,"node_id":"MDEyOklzc3VlQ29tbWVudDQyNjQ3MTkzNA==","user":{"login":"robieta","id":13089297,"node_id":"MDQ6VXNlcjEzMDg5Mjk3","avatar_url":"https://avatars0.githubusercontent.com/u/13089297?v=4","gravatar_id":"","url":"https://api.github.com/users/robieta","html_url":"https://github.com/robieta","followers_url":"https://api.github.com/users/robieta/followers","following_url":"https://api.github.com/users/robieta/following{/other_user}","gists_url":"https://api.github.com/users/robieta/gists{/gist_id}","starred_url":"https://api.github.com/users/robieta/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/robieta/subscriptions","organizations_url":"https://api.github.com/users/robieta/orgs","repos_url":"https://api.github.com/users/robieta/repos","events_url":"https://api.github.com/users/robieta/events{/privacy}","received_events_url":"https://api.github.com/users/robieta/received_events","type":"User","site_admin":false},"created_at":"2018-10-03T00:13:48Z","updated_at":"2018-10-03T00:13:48Z","author_association":"CONTRIBUTOR","body":"FYI I'm going to be updating the checkpoints and SavedModels in the next couple of days to ones that are compatible with the changes that have been made since June."}}
{"actor":{"display_login":"robieta"}}