{"action":"created","issue":{"url":"https://api.github.com/repos/openstreetview/uploader/issues/5","repository_url":"https://api.github.com/repos/openstreetview/uploader","labels_url":"https://api.github.com/repos/openstreetview/uploader/issues/5/labels{/name}","comments_url":"https://api.github.com/repos/openstreetview/uploader/issues/5/comments","events_url":"https://api.github.com/repos/openstreetview/uploader/issues/5/events","html_url":"https://github.com/openstreetview/uploader/issues/5","id":168654161,"number":5,"title":"Error uploading photos by exif","user":{"login":"Xevib","id":2422305,"avatar_url":"https://avatars.githubusercontent.com/u/2422305?v=3","gravatar_id":"","url":"https://api.github.com/users/Xevib","html_url":"https://github.com/Xevib","followers_url":"https://api.github.com/users/Xevib/followers","following_url":"https://api.github.com/users/Xevib/following{/other_user}","gists_url":"https://api.github.com/users/Xevib/gists{/gist_id}","starred_url":"https://api.github.com/users/Xevib/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Xevib/subscriptions","organizations_url":"https://api.github.com/users/Xevib/orgs","repos_url":"https://api.github.com/users/Xevib/repos","events_url":"https://api.github.com/users/Xevib/events{/privacy}","received_events_url":"https://api.github.com/users/Xevib/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":32,"created_at":"2016-08-01T14:07:45Z","updated_at":"2016-08-27T04:37:28Z","closed_at":null,"body":"I got this message:\r\n\r\n> usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 524288 bytes but only got 6108. Skipping tag 1\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 9764864 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 9830400 bytes but only got 7108. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 28311552 bytes but only got 7108. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 65536 bytes but only got 7108. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 243400704 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 18481152 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 19988480 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 2271805440 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 2359296 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 786432 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 134742016 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:694: UserWarning: Corrupt EXIF data.  Expecting to read 12 bytes but only got 6. \r\n  warnings.warn(str(msg))\r\nNo sequence file existing\r\nFound 4 pictures to upload\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 524288 bytes but only got 6107. Skipping tag 1\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 9830400 bytes but only got 7107. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 28311552 bytes but only got 7107. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 65536 bytes but only got 7107. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 254541824 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 25600 bytes but only got 7107. Skipping tag 52224\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:694: UserWarning: Corrupt EXIF data.  Expecting to read 12 bytes but only got 5. \r\n  warnings.warn(str(msg))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 524288 bytes but only got 6105. Skipping tag 1\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 9830400 bytes but only got 7105. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 28311552 bytes but only got 7105. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 65536 bytes but only got 7105. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 245760000 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:694: UserWarning: Corrupt EXIF data.  Expecting to read 12 bytes but only got 3. \r\n  warnings.warn(str(msg))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 524288 bytes but only got 6104. Skipping tag 1\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 6375342080 bytes but only got 7104. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 9830400 bytes but only got 7104. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 28311552 bytes but only got 7104. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 65536 bytes but only got 7104. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 235798528 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 262146 bytes but only got 0. Skipping tag 2\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 262151 bytes but only got 0. Skipping tag 56\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 524288 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 5242880 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:680: UserWarning: Possibly corrupt EXIF data.  Expecting to read 875954176 bytes but only got 0. Skipping tag 0\r\n  \"Skipping tag %s\" % (size, len(data), tag))\r\n/usr/local/lib/python3.5/dist-packages/PIL/TiffImagePlugin.py:694: UserWarning: Corrupt EXIF data.  Expecting to read 12 bytes but only got 2. \r\n  warnings.warn(str(msg))\r\nprocessing 2016_07_31_13_50_25_903.jpg\r\nUploaded - 1 of total :4, percentage: 25.0%\r\nprocessing 2016_07_31_13_50_22_794.jpg\r\nUploaded - 2 of total :4, percentage: 50.0%\r\nprocessing 2016_07_31_13_50_24_389.jpg\r\nUploaded - 3 of total :4, percentage: 75.0%\r\nprocessing 2016_07_31_13_50_21_415.jpg\r\nUploaded - 4 of total :4, percentage: 100.0%\r\nFinish uploading form dir: /home/xevi/Baixades/hector/ with sequence id: 11023\r\n\r\nThe result is this sequence http://openstreetview.org/details/11023/0"},"comment":{"url":"https://api.github.com/repos/openstreetview/uploader/issues/comments/242895587","html_url":"https://github.com/openstreetview/uploader/issues/5#issuecomment-242895587","issue_url":"https://api.github.com/repos/openstreetview/uploader/issues/5","id":242895587,"user":{"login":"drkludge","id":1669057,"avatar_url":"https://avatars.githubusercontent.com/u/1669057?v=3","gravatar_id":"","url":"https://api.github.com/users/drkludge","html_url":"https://github.com/drkludge","followers_url":"https://api.github.com/users/drkludge/followers","following_url":"https://api.github.com/users/drkludge/following{/other_user}","gists_url":"https://api.github.com/users/drkludge/gists{/gist_id}","starred_url":"https://api.github.com/users/drkludge/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/drkludge/subscriptions","organizations_url":"https://api.github.com/users/drkludge/orgs","repos_url":"https://api.github.com/users/drkludge/repos","events_url":"https://api.github.com/users/drkludge/events{/privacy}","received_events_url":"https://api.github.com/users/drkludge/received_events","type":"User","site_admin":false},"created_at":"2016-08-27T04:37:28Z","updated_at":"2016-08-27T04:37:28Z","body":"@bogdan-telenav The long story short is that you are not handling an empty id_file.txt on first use.  Here's how to recreate the problem.\r\n\r\n1.You must become mortal to see the problem.\r\n2.I had about 16 OSV OAuth settings.  I removed all of those files.\r\n3.I moved the id file out of the way `mv id_file.txt  old_stuff_to_break_things.txt`.  You need to run the program as if you pulled it down from github for the first time.\r\n4.Run it `python upload_photos_by_exif.py -p 2015_12_07_08_08_43_316___Mapillary`.\r\n5. See Error Report One.  The program is trying to read a nonexistent id_file.txt and does not handle the exception well.\r\n6.Run it again with no success `python upload_photos_by_exif.py -p 2015_12_07_08_08_43_316___Mapillary`.\r\n7. See Error Report Two.  The same error was produced and still no upload.\r\n8. Move the id_file.txt from step three back into place. ` mv old_stuff_to_break_things.txt id_file.txt`.\r\n9.Run it again `python upload_photos_by_exif.py -p 2015_12_07_08_08_43_316___Mapillary`.\r\n10.See Success Report One and sequence 15113.\r\n\r\nYes there were a number of exif issues to fix but the id_file.txt issue was a pain until I created one manually.\r\n\r\n\r\n\r\n**_## Error Report One._**\r\nFor login go to this URL in your browser:\r\nhttp://www.openstreetmap.org/oauth/authorize?oauth_token=...\r\nLogin and  grant acces then press ENTER\r\n\r\nTraceback (most recent call last):\r\n  File \"upload_photos_by_exif.py\", line 218, in main\r\n    id_file = open(\"id_file.txt\", \"r+\")\r\nFileNotFoundError: [Errno 2] No such file or directory: 'id_file.txt'\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 1240, in do_open\r\n    h.request(req.get_method(), req.selector, req.data, headers)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/http/client.py\", line 1083, in request\r\n    self._send_request(method, url, body, headers)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/http/client.py\", line 1128, in _send_request\r\n    self.endheaders(body)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/http/client.py\", line 1079, in endheaders\r\n    self._send_output(message_body)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/http/client.py\", line 911, in _send_output\r\n    self.send(msg)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/http/client.py\", line 854, in send\r\n    self.connect()\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/http/client.py\", line 1237, in connect\r\n    server_hostname=server_hostname)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/ssl.py\", line 376, in wrap_socket\r\n    _context=self)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/ssl.py\", line 747, in __init__\r\n    self.do_handshake()\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/ssl.py\", line 983, in do_handshake\r\n    self._sslobj.do_handshake()\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/ssl.py\", line 628, in do_handshake\r\n    self._sslobj.do_handshake()\r\nssl.SSLError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:646)\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n\r\nTraceback (most recent call last):\r\n  File \"upload_photos_by_exif.py\", line 441, in <module>\r\n    main(sys.argv[1:])\r\n  File \"upload_photos_by_exif.py\", line 268, in main\r\n    opener.open(urllib.request.Request(authorize_url))\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 471, in open\r\n    response = meth(req, response)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 581, in http_response\r\n    'http', request, response, code, msg, hdrs)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 503, in error\r\n    result = self._call_chain(*args)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 443, in _call_chain\r\n    result = func(*args)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 686, in http_error_302\r\n    return self.parent.open(new, timeout=req.timeout)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 471, in open\r\n    response = meth(req, response)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 581, in http_response\r\n    'http', request, response, code, msg, hdrs)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 503, in error\r\n    result = self._call_chain(*args)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 443, in _call_chain\r\n    result = func(*args)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 686, in http_error_302\r\n    return self.parent.open(new, timeout=req.timeout)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 465, in open\r\n    response = self._open(req, data)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 483, in _open\r\n    '_open', req)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 443, in _call_chain\r\n    result = func(*args)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 1283, in https_open\r\n    context=self._context, check_hostname=self._check_hostname)\r\n  File \"/share/CACHEDEV1_DATA/.qpkg/Python3/src/lib/python3.5/urllib/request.py\", line 1242, in do_open\r\n    raise URLError(err)\r\nurllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:646)>\r\n[/share/mapillary/gis/data/osm_survey/mapillary] #\r\n\r\n\r\n**_## Error Report Two._**\r\npython upload_photos_by_exif.py -p 2015_12_07_08_08_43_316___Mapillary\r\n\r\nFor login go to this URL in your browser:\r\nhttp://www.openstreetmap.org/oauth/authorize?oauth_token=...\r\nLogin and  grant acces then press ENTER\r\n\r\nTraceback (most recent call last):\r\n  File \"upload_photos_by_exif.py\", line 218, in main\r\n    id_file = open(\"id_file.txt\", \"r+\")\r\nFileNotFoundError: [Errno 2] No such file or directory: 'id_file.txt'\r\n\r\nDuring handling of the above exception, another exception occurred:\r\n...\r\n\r\n**_## Success Report One._**\r\n\r\npython upload_photos_by_exif.py -p 2015_12_07_08_08_43_316___Mapillary\r\nNo sequence file existing\r\nFound 403 pictures to upload\r\nprocessing 2015_12_07_08_08_51_017.jpg\r\nUploaded - 1 of total :403, percentage: 0.25%\r\nprocessing 2015_12_07_08_08_43_836.jpg\r\nUploaded - 2 of total :403, percentage: 0.5%\r\nprocessing 2015_12_07_08_08_48_550.jpg\r\nUploaded - 3 of total :403, percentage: 0.73999999999999999%\r\nprocessing 2015_12_07_08_08_46_151.jpg\r\nUploaded - 4 of total :403, percentage: 0.98999999999999999%\r\n...\r\nUploaded - 399 of total :403, percentage: 99.010000000000005%\r\nprocessing 2015_12_07_08_32_19_519.jpg\r\nUploaded - 400 of total :403, percentage: 99.260000000000005%\r\nprocessing 2015_12_07_08_32_21_900.jpg\r\nUploaded - 401 of total :403, percentage: 99.5%\r\nprocessing 2015_12_07_08_32_26_850.jpg\r\nUploaded - 402 of total :403, percentage: 99.75%\r\nprocessing 2015_12_07_08_32_24_335.jpg\r\nUploaded - 403 of total :403, percentage: 100.0%\r\nFinish uploading form dir: /share/external/DEV3301_2/gis/data/osm_survey/mapillary/2015_12_07_08_08_43_316___Mapillary/ with sequence id: 15113\r\n"}}
{"actor":{"display_login":"drkludge"}}