{"action":"created","issue":{"url":"https://api.github.com/repos/apache/incubator-mxnet/issues/9916","repository_url":"https://api.github.com/repos/apache/incubator-mxnet","labels_url":"https://api.github.com/repos/apache/incubator-mxnet/issues/9916/labels{/name}","comments_url":"https://api.github.com/repos/apache/incubator-mxnet/issues/9916/comments","events_url":"https://api.github.com/repos/apache/incubator-mxnet/issues/9916/events","html_url":"https://github.com/apache/incubator-mxnet/issues/9916","id":300969599,"node_id":"MDU6SXNzdWUzMDA5Njk1OTk=","number":9916,"title":"precision bug in batchnorm.","user":{"login":"zheng-da","id":70481,"node_id":"MDQ6VXNlcjcwNDgx","avatar_url":"https://avatars1.githubusercontent.com/u/70481?v=4","gravatar_id":"","url":"https://api.github.com/users/zheng-da","html_url":"https://github.com/zheng-da","followers_url":"https://api.github.com/users/zheng-da/followers","following_url":"https://api.github.com/users/zheng-da/following{/other_user}","gists_url":"https://api.github.com/users/zheng-da/gists{/gist_id}","starred_url":"https://api.github.com/users/zheng-da/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zheng-da/subscriptions","organizations_url":"https://api.github.com/users/zheng-da/orgs","repos_url":"https://api.github.com/users/zheng-da/repos","events_url":"https://api.github.com/users/zheng-da/events{/privacy}","received_events_url":"https://api.github.com/users/zheng-da/received_events","type":"User","site_admin":false},"labels":[{"id":206159502,"node_id":"MDU6TGFiZWwyMDYxNTk1MDI=","url":"https://api.github.com/repos/apache/incubator-mxnet/labels/Bug","name":"Bug","color":"fc2929","default":false},{"id":821540470,"node_id":"MDU6TGFiZWw4MjE1NDA0NzA=","url":"https://api.github.com/repos/apache/incubator-mxnet/labels/FP16","name":"FP16","color":"fbca04","default":false},{"id":707556574,"node_id":"MDU6TGFiZWw3MDc1NTY1NzQ=","url":"https://api.github.com/repos/apache/incubator-mxnet/labels/Operator","name":"Operator","color":"fbca04","default":false},{"id":721783490,"node_id":"MDU6TGFiZWw3MjE3ODM0OTA=","url":"https://api.github.com/repos/apache/incubator-mxnet/labels/Test","name":"Test","color":"fbca04","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2018-02-28T10:26:40Z","updated_at":"2018-07-19T00:44:46Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"## Description\r\nI noticed this error when MKLDNN is built into MXNet. I haven't tested the case without MKLDNN.\r\n\r\n```\r\n$ export MXNET_TEST_SEED=1307519208\r\n$ nosetests -v tests/python/gpu/test_operator_gpu.py:test_batchnorm_with_type\r\n[INFO] Setting module np/mx/python random seeds, use MXNET_MODULE_SEED=570740139 to reproduce.\r\n[WARNING] *** test-level seed set: all \"@with_seed()\" tests run deterministically ***\r\ntest_operator_gpu.test_batchnorm_with_type ... [INFO] Setting test np/mx/python random seeds, use MXNET_TEST_SEED=1307519208 to reproduce.\r\nTraceback (most recent call last):\r\n  File \"/home/ubuntu/incubator-mxnet/python/mxnet/test_utils.py\", line 1341, in check_consistency\r\n    equal_nan=equal_nan)\r\n  File \"/home/ubuntu/incubator-mxnet/python/mxnet/test_utils.py\", line 493, in assert_almost_equal\r\n    raise AssertionError(msg)\r\nAssertionError: \r\nItems are not equal:\r\nError 1.608877 exceeds tolerance rtol=0.100000, atol=0.100000.  Location of maximum error:(1,), a=-0.890410, b=-0.628418\r\n a: array([ 1786.13305664,    -0.89041042], dtype=float32)\r\n b: array([ 1786.        ,    -0.62841797], dtype=float16)\r\nFAIL\r\n\r\n======================================================================\r\nFAIL: test_operator_gpu.test_batchnorm_with_type\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/usr/lib/python2.7/dist-packages/nose/case.py\", line 197, in runTest\r\n    self.test(*self.arg)\r\n  File \"/home/ubuntu/incubator-mxnet/tests/python/gpu/../unittest/common.py\", line 155, in test_new\r\n    orig_test(*args, **kwargs)\r\n  File \"/home/ubuntu/incubator-mxnet/tests/python/gpu/test_operator_gpu.py\", line 324, in test_batchnorm_with_type\r\n    check_consistency(sym, ctx_list_v2_2D)\r\n  File \"/home/ubuntu/incubator-mxnet/python/mxnet/test_utils.py\", line 1346, in check_consistency\r\n    raise e\r\nAssertionError: \r\nItems are not equal:\r\nError 1.608877 exceeds tolerance rtol=0.100000, atol=0.100000.  Location of maximum error:(1,), a=-0.890410, b=-0.628418\r\n a: array([ 1786.13305664,    -0.89041042], dtype=float32)\r\n b: array([ 1786.        ,    -0.62841797], dtype=float16)\r\n-------------------- >> begin captured stdout << ---------------------\r\nTrain Err: ctx 1 vs ctx 2 at norm_beta\r\n\r\n--------------------- >> end captured stdout << ----------------------\r\n-------------------- >> begin captured logging << --------------------\r\ncommon: INFO: Setting module np/mx/python random seeds, use MXNET_MODULE_SEED=570740139 to reproduce.\r\ncommon: WARNING: *** test-level seed set: all \"@with_seed()\" tests run deterministically ***\r\ncommon: INFO: Setting test np/mx/python random seeds, use MXNET_TEST_SEED=1307519208 to reproduce.\r\n--------------------- >> end captured logging << ---------------------\r\n\r\n----------------------------------------------------------------------\r\nRan 1 test in 1.675s\r\n\r\nFAILED (failures=1)\r\n\r\n```"},"comment":{"url":"https://api.github.com/repos/apache/incubator-mxnet/issues/comments/406117933","html_url":"https://github.com/apache/incubator-mxnet/issues/9916#issuecomment-406117933","issue_url":"https://api.github.com/repos/apache/incubator-mxnet/issues/9916","id":406117933,"node_id":"MDEyOklzc3VlQ29tbWVudDQwNjExNzkzMw==","user":{"login":"haojin2","id":11465736,"node_id":"MDQ6VXNlcjExNDY1NzM2","avatar_url":"https://avatars3.githubusercontent.com/u/11465736?v=4","gravatar_id":"","url":"https://api.github.com/users/haojin2","html_url":"https://github.com/haojin2","followers_url":"https://api.github.com/users/haojin2/followers","following_url":"https://api.github.com/users/haojin2/following{/other_user}","gists_url":"https://api.github.com/users/haojin2/gists{/gist_id}","starred_url":"https://api.github.com/users/haojin2/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/haojin2/subscriptions","organizations_url":"https://api.github.com/users/haojin2/orgs","repos_url":"https://api.github.com/users/haojin2/repos","events_url":"https://api.github.com/users/haojin2/events{/privacy}","received_events_url":"https://api.github.com/users/haojin2/received_events","type":"User","site_admin":false},"created_at":"2018-07-19T00:44:45Z","updated_at":"2018-07-19T00:44:45Z","author_association":"CONTRIBUTOR","body":"Seems like this issue has been addressed already, can we close this? @marcoabreu @szha "}}
{"actor":{"display_login":"haojin2"}}