{"action":"created","issue":{"url":"https://api.github.com/repos/leonid-pishchulin/poseval/issues/23","repository_url":"https://api.github.com/repos/leonid-pishchulin/poseval","labels_url":"https://api.github.com/repos/leonid-pishchulin/poseval/issues/23/labels{/name}","comments_url":"https://api.github.com/repos/leonid-pishchulin/poseval/issues/23/comments","events_url":"https://api.github.com/repos/leonid-pishchulin/poseval/issues/23/events","html_url":"https://github.com/leonid-pishchulin/poseval/issues/23","id":352898896,"node_id":"MDU6SXNzdWUzNTI4OTg4OTY=","number":23,"title":"different evaluate result using different format","user":{"login":"leoxiaobin","id":5362509,"node_id":"MDQ6VXNlcjUzNjI1MDk=","avatar_url":"https://avatars3.githubusercontent.com/u/5362509?v=4","gravatar_id":"","url":"https://api.github.com/users/leoxiaobin","html_url":"https://github.com/leoxiaobin","followers_url":"https://api.github.com/users/leoxiaobin/followers","following_url":"https://api.github.com/users/leoxiaobin/following{/other_user}","gists_url":"https://api.github.com/users/leoxiaobin/gists{/gist_id}","starred_url":"https://api.github.com/users/leoxiaobin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/leoxiaobin/subscriptions","organizations_url":"https://api.github.com/users/leoxiaobin/orgs","repos_url":"https://api.github.com/users/leoxiaobin/repos","events_url":"https://api.github.com/users/leoxiaobin/events{/privacy}","received_events_url":"https://api.github.com/users/leoxiaobin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":10,"created_at":"2018-08-22T10:45:54Z","updated_at":"2018-08-27T23:16:28Z","closed_at":null,"author_association":"NONE","body":"hi, @leonid-pishchulin ,\r\n\r\nthe evaluate code can support 2018 format and 2017 format, but I find that using different format I can get different results in some situation. To investigate the issue, I use only one video sequence, and only two frames's ground truth and prediction results.\r\n\r\nUse ground truth of 2017 format and prediction of 2017 format, I got the result:\r\n```\r\nAverage Precision (AP) metric:\r\n& Head & Shou & Elb  & Wri  & Hip  & Knee & Ankl & Total\\\\\r\n& 94.4 & 83.3 &100.0 &100.0 &100.0 & 90.0 & 77.5 & 92.3 \\\\\r\n``` \r\n\r\nUse ground truth of 2018 format and prediction of 2018 format, I got the result:\r\n```\r\nEvaluation of per-frame multi-person pose estimation\r\nsaving results to ./out/total_AP_metrics.json\r\nAverage Precision (AP) metric:\r\n& Head & Shou & Elb  & Wri  & Hip  & Knee & Ankl & Total\\\\\r\n& 33.3 & 37.5 & 37.5 & 50.0 & 37.5 & 50.0 & 37.5 & 40.0 \\\\\r\n```\r\n\r\nI have upload my test json at https://drive.google.com/open?id=1jfNa75EKAIMHd8TUrOGp44XxXYANLUm9"},"comment":{"url":"https://api.github.com/repos/leonid-pishchulin/poseval/issues/comments/416399103","html_url":"https://github.com/leonid-pishchulin/poseval/issues/23#issuecomment-416399103","issue_url":"https://api.github.com/repos/leonid-pishchulin/poseval/issues/23","id":416399103,"node_id":"MDEyOklzc3VlQ29tbWVudDQxNjM5OTEwMw==","user":{"login":"leonid-pishchulin","id":6402251,"node_id":"MDQ6VXNlcjY0MDIyNTE=","avatar_url":"https://avatars1.githubusercontent.com/u/6402251?v=4","gravatar_id":"","url":"https://api.github.com/users/leonid-pishchulin","html_url":"https://github.com/leonid-pishchulin","followers_url":"https://api.github.com/users/leonid-pishchulin/followers","following_url":"https://api.github.com/users/leonid-pishchulin/following{/other_user}","gists_url":"https://api.github.com/users/leonid-pishchulin/gists{/gist_id}","starred_url":"https://api.github.com/users/leonid-pishchulin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/leonid-pishchulin/subscriptions","organizations_url":"https://api.github.com/users/leonid-pishchulin/orgs","repos_url":"https://api.github.com/users/leonid-pishchulin/repos","events_url":"https://api.github.com/users/leonid-pishchulin/events{/privacy}","received_events_url":"https://api.github.com/users/leonid-pishchulin/received_events","type":"User","site_admin":false},"created_at":"2018-08-27T23:16:28Z","updated_at":"2018-08-27T23:16:28Z","author_association":"OWNER","body":"merged this PR. @leoxiaobin, @wjbKimberly: please pull from the mainline and let us know if it fixes your problems"}}
{"actor":{"display_login":"leonid-pishchulin"}}