{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/benchmarks/issues/134","repository_url":"https://api.github.com/repos/tensorflow/benchmarks","labels_url":"https://api.github.com/repos/tensorflow/benchmarks/issues/134/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/benchmarks/issues/134/comments","events_url":"https://api.github.com/repos/tensorflow/benchmarks/issues/134/events","html_url":"https://github.com/tensorflow/benchmarks/issues/134","id":294993164,"number":134,"title":"Potential Cause for Sub-par ResNet50 Accuracy","user":{"login":"tjingrant","id":6410074,"avatar_url":"https://avatars1.githubusercontent.com/u/6410074?v=4","gravatar_id":"","url":"https://api.github.com/users/tjingrant","html_url":"https://github.com/tjingrant","followers_url":"https://api.github.com/users/tjingrant/followers","following_url":"https://api.github.com/users/tjingrant/following{/other_user}","gists_url":"https://api.github.com/users/tjingrant/gists{/gist_id}","starred_url":"https://api.github.com/users/tjingrant/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tjingrant/subscriptions","organizations_url":"https://api.github.com/users/tjingrant/orgs","repos_url":"https://api.github.com/users/tjingrant/repos","events_url":"https://api.github.com/users/tjingrant/events{/privacy}","received_events_url":"https://api.github.com/users/tjingrant/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":7,"created_at":"2018-02-07T03:19:38Z","updated_at":"2018-02-09T19:57:53Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"Hi,\r\n\r\nI think there's an inconsistency between pytorch and tf benchmark regarding Resnet-50 definition here. Basically, right before the first residual block, tensorflow produces the following intermediate feature map of shape:\r\n```\r\n('first mpool:', <tf.Tensor 'v0/tower_0/cg/mpool0/MaxPool:0' shape=(64, 64, 55, 55) dtype=float32>)\r\n```\r\nBut PyTorch gives:\r\n```\r\n(1L, 64L, 56L, 56L)\r\n```\r\n\r\nSo essentially TF is missing out 1 pixel in each spatial dimension compared with PyTorch. Maybe this is the reason why ResNet50 gives subpar accuracy (upper 73% TF compared with upper 75% PyTorch)?"},"comment":{"url":"https://api.github.com/repos/tensorflow/benchmarks/issues/comments/364546483","html_url":"https://github.com/tensorflow/benchmarks/issues/134#issuecomment-364546483","issue_url":"https://api.github.com/repos/tensorflow/benchmarks/issues/134","id":364546483,"user":{"login":"ppwwyyxx","id":1381301,"avatar_url":"https://avatars3.githubusercontent.com/u/1381301?v=4","gravatar_id":"","url":"https://api.github.com/users/ppwwyyxx","html_url":"https://github.com/ppwwyyxx","followers_url":"https://api.github.com/users/ppwwyyxx/followers","following_url":"https://api.github.com/users/ppwwyyxx/following{/other_user}","gists_url":"https://api.github.com/users/ppwwyyxx/gists{/gist_id}","starred_url":"https://api.github.com/users/ppwwyyxx/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ppwwyyxx/subscriptions","organizations_url":"https://api.github.com/users/ppwwyyxx/orgs","repos_url":"https://api.github.com/users/ppwwyyxx/repos","events_url":"https://api.github.com/users/ppwwyyxx/events{/privacy}","received_events_url":"https://api.github.com/users/ppwwyyxx/received_events","type":"User","site_admin":false},"created_at":"2018-02-09T19:57:53Z","updated_at":"2018-02-09T19:57:53Z","author_association":"CONTRIBUTOR","body":"It does the padding for you though you haven't asked it to. That's how it works. Call it a feature or bug.\r\nIt's mentioned in https://github.com/caffe2/caffe2/blob/0990a2d868b4de57619bf32fe769867fa2f5b016/caffe2/proto/caffe2_legacy.proto#L23-L34 as well."}}
{"actor":{"display_login":"ppwwyyxx"}}