{"action":"created","issue":{"url":"https://api.github.com/repos/mcordts/cityscapesScripts/issues/10","repository_url":"https://api.github.com/repos/mcordts/cityscapesScripts","labels_url":"https://api.github.com/repos/mcordts/cityscapesScripts/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/mcordts/cityscapesScripts/issues/10/comments","events_url":"https://api.github.com/repos/mcordts/cityscapesScripts/issues/10/events","html_url":"https://github.com/mcordts/cityscapesScripts/issues/10","id":171422674,"number":10,"title":"Question about \"iIoU = nan\", how to interpret this?","user":{"login":"Almo1982","id":18659261,"avatar_url":"https://avatars.githubusercontent.com/u/18659261?v=3","gravatar_id":"","url":"https://api.github.com/users/Almo1982","html_url":"https://github.com/Almo1982","followers_url":"https://api.github.com/users/Almo1982/followers","following_url":"https://api.github.com/users/Almo1982/following{/other_user}","gists_url":"https://api.github.com/users/Almo1982/gists{/gist_id}","starred_url":"https://api.github.com/users/Almo1982/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Almo1982/subscriptions","organizations_url":"https://api.github.com/users/Almo1982/orgs","repos_url":"https://api.github.com/users/Almo1982/repos","events_url":"https://api.github.com/users/Almo1982/events{/privacy}","received_events_url":"https://api.github.com/users/Almo1982/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2016-08-16T14:14:24Z","updated_at":"2016-08-18T07:34:42Z","closed_at":null,"body":"Hi again Marius,\r\n\r\neverything works so far but another question came up i didnt find an answer for yet:\r\n\r\ni trained some nets with data from your dataset. when i calculate IoU and iIoU then with your script evalPixelLevelSemanticLabeling.py i get for example the result like attached:\r\n![iou](https://cloud.githubusercontent.com/assets/18659261/17701776/6c1e8aa6-63cb-11e6-8cf0-73c326d04337.png)\r\n\r\nMy question is, why do i get a \"nan\" for the result of iIoU of almost all classes? \r\n\r\nWhen i take a look in your script there are following classes defined for calculating iIoU:\r\n\r\nargs.avgClassSize       = {\r\n    \"bicycle\"    :  4672.3249222261 ,\r\n    \"caravan\"    : 36771.8241758242 ,\r\n    \"motorcycle\" :  6298.7200839748 ,\r\n    \"rider\"      :  3930.4788056518 ,\r\n    \"bus\"        : 35732.1511111111 ,\r\n    \"train\"      : 67583.7075812274 ,\r\n    \"car\"        : 12794.0202738185 ,\r\n    \"person\"     :  3462.4756337644 ,\r\n    \"truck\"      : 27855.1264367816 ,\r\n    \"trailer\"    : 16926.9763313609 ,\r\n}\r\n\r\nSo i expect at least for these classes not a \"nan\" as result?! And why did it work for \"car\" and \"person\" in my case? (well, its 0 but at least it does something :-) )\r\n\r\nFor the IoU, the \"nan\" for the train class means that there wasnt even one train-class in my training data set, correct?\r\n\r\nBut i dont understand all the other \"nan\", please help me out!\r\n\r\nThank you!\r\nStefan "},"comment":{"url":"https://api.github.com/repos/mcordts/cityscapesScripts/issues/comments/240646490","html_url":"https://github.com/mcordts/cityscapesScripts/issues/10#issuecomment-240646490","issue_url":"https://api.github.com/repos/mcordts/cityscapesScripts/issues/10","id":240646490,"user":{"login":"Almo1982","id":18659261,"avatar_url":"https://avatars.githubusercontent.com/u/18659261?v=3","gravatar_id":"","url":"https://api.github.com/users/Almo1982","html_url":"https://github.com/Almo1982","followers_url":"https://api.github.com/users/Almo1982/followers","following_url":"https://api.github.com/users/Almo1982/following{/other_user}","gists_url":"https://api.github.com/users/Almo1982/gists{/gist_id}","starred_url":"https://api.github.com/users/Almo1982/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Almo1982/subscriptions","organizations_url":"https://api.github.com/users/Almo1982/orgs","repos_url":"https://api.github.com/users/Almo1982/repos","events_url":"https://api.github.com/users/Almo1982/events{/privacy}","received_events_url":"https://api.github.com/users/Almo1982/received_events","type":"User","site_admin":false},"created_at":"2016-08-18T07:34:41Z","updated_at":"2016-08-18T07:34:41Z","body":"Hi Marius,\r\n\r\nthe task of the Benchmark is clear for me i think, i only have an understanding Problem why it should work with 2048x1024 and not with 512x256...\r\n\r\nIf ALL Images have 512x256 Pixels, where is the difference (except of the less amount of Pixels of course)? i can also predict a Label per Pixel in this case?! \r\n\r\nIt Looks like the calculation of IoU (comparing the prediction Images with the labelIds-annotations) is working fine on base of the 512x256 Images...so what is not clear to me why it doesnt work for the instanceIds-annotations then that have same size?!\r\n\r\nBut i will give it a try with the original size and upscaling my prediction Images...\r\n\r\nThank you again for your comments, i will take a deeper look into the paper again, maybe this helps for my understanding... \r\n\r\nRegards\r\nStefan\r\n"}}
{"actor":{"display_login":"Almo1982"}}