{"action":"created","issue":{"url":"https://api.github.com/repos/mrworf/iceshelf/issues/2","repository_url":"https://api.github.com/repos/mrworf/iceshelf","labels_url":"https://api.github.com/repos/mrworf/iceshelf/issues/2/labels{/name}","comments_url":"https://api.github.com/repos/mrworf/iceshelf/issues/2/comments","events_url":"https://api.github.com/repos/mrworf/iceshelf/issues/2/events","html_url":"https://github.com/mrworf/iceshelf/issues/2","id":140493567,"number":2,"title":"UTF-8 filenames","user":{"login":"Jonny007-MKD","id":685945,"avatar_url":"https://avatars.githubusercontent.com/u/685945?v=3","gravatar_id":"","url":"https://api.github.com/users/Jonny007-MKD","html_url":"https://github.com/Jonny007-MKD","followers_url":"https://api.github.com/users/Jonny007-MKD/followers","following_url":"https://api.github.com/users/Jonny007-MKD/following{/other_user}","gists_url":"https://api.github.com/users/Jonny007-MKD/gists{/gist_id}","starred_url":"https://api.github.com/users/Jonny007-MKD/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Jonny007-MKD/subscriptions","organizations_url":"https://api.github.com/users/Jonny007-MKD/orgs","repos_url":"https://api.github.com/users/Jonny007-MKD/repos","events_url":"https://api.github.com/users/Jonny007-MKD/events{/privacy}","received_events_url":"https://api.github.com/users/Jonny007-MKD/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-03-13T15:01:00Z","updated_at":"2016-03-13T19:22:11Z","closed_at":null,"body":"Hi,\r\n\r\nmy test file was uploaded successfully :+1:\r\nNow I changed to real data and stumbled upon the umlauts in my filenames (I guess that's the problem):\r\n\r\n    2016-03-13 15:40:46,663 - iceshelf@140 - INFO - Processing \"music\" (/raid/Multimedia/Audio/)\r\n    2016-03-13 15:44:20,814 - iceshelf@398 - DEBUG - Processing file structure changes\r\n    2016-03-13 15:44:20,851 - iceshelf@173 - INFO - Content is not likely to compress (0% chance), skipping compression.\r\n    2016-03-13 15:49:01,309 - iceshelf@202 - INFO - Creating archive\r\n    2016-03-13 15:49:01,311 - shutil.py@524 - DEBUG - changing into '/raid/Temp/iceshelf/20160313-144046-80c9f'\r\n    2016-03-13 15:49:01,327 - shutil.py@376 - INFO - Creating tar archive\r\n    2016-03-13 15:53:54,889 - shutil.py@552 - DEBUG - changing back to '/home/osmc/build/iceshelf'\r\n    2016-03-13 15:53:54,891 - iceshelf@207 - INFO - Removing temporary copies of files\r\n    Traceback (most recent call last):\r\n      File \"./iceshelf\", line 452, in <module>\r\n        files = gatherData()\r\n      File \"./iceshelf\", line 227, in gatherData\r\n        json.dump(manifest, fp)\r\n      File \"/usr/lib/python2.7/json/__init__.py\", line 189, in dump\r\n        for chunk in iterable:\r\n      File \"/usr/lib/python2.7/json/encoder.py\", line 434, in _iterencode\r\n        for chunk in _iterencode_dict(o, _current_indent_level):\r\n      File \"/usr/lib/python2.7/json/encoder.py\", line 408, in _iterencode_dict\r\n        for chunk in chunks:\r\n      File \"/usr/lib/python2.7/json/encoder.py\", line 387, in _iterencode_dict\r\n        yield _encoder(key)\r\n    UnicodeDecodeError: 'utf8' codec can't decode byte 0xfc in position 77: invalid start byte\r\n\r\nThese are some of my files:\r\n\r\n    $ ls -la /raid/Multimedia/Audio/ \r\n        drwxrwxr-x  30 osmc users  4096 Dec 11 15:55 Hörbücher\r\n        drwxrwxr-x 507 osmc users 20480 Mar  2 19:02 Musik\r\n    $ ls -la /raid/Multimedia/Audio/Hörbücher/\r\n        drwxrwxr-x   3 osmc users  4096 Nov 11 13:40 Jo Nesbø\r\n"},"comment":{"url":"https://api.github.com/repos/mrworf/iceshelf/issues/comments/196025750","html_url":"https://github.com/mrworf/iceshelf/issues/2#issuecomment-196025750","issue_url":"https://api.github.com/repos/mrworf/iceshelf/issues/2","id":196025750,"user":{"login":"Jonny007-MKD","id":685945,"avatar_url":"https://avatars.githubusercontent.com/u/685945?v=3","gravatar_id":"","url":"https://api.github.com/users/Jonny007-MKD","html_url":"https://github.com/Jonny007-MKD","followers_url":"https://api.github.com/users/Jonny007-MKD/followers","following_url":"https://api.github.com/users/Jonny007-MKD/following{/other_user}","gists_url":"https://api.github.com/users/Jonny007-MKD/gists{/gist_id}","starred_url":"https://api.github.com/users/Jonny007-MKD/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Jonny007-MKD/subscriptions","organizations_url":"https://api.github.com/users/Jonny007-MKD/orgs","repos_url":"https://api.github.com/users/Jonny007-MKD/repos","events_url":"https://api.github.com/users/Jonny007-MKD/events{/privacy}","received_events_url":"https://api.github.com/users/Jonny007-MKD/received_events","type":"User","site_admin":false},"created_at":"2016-03-13T19:22:11Z","updated_at":"2016-03-13T19:22:11Z","body":"Now I've got quite the same error at another position. Sorry for consuming so much of your time!\r\n\r\n    Traceback (most recent call last):\r\n      File \"./build/iceshelf/iceshelf\", line 412, in <module>\r\n        gotall = collectSources(config['sources'])\r\n      File \"./build/iceshelf/iceshelf\", line 153, in collectSources\r\n        for root, dirs, files in os.walk(path):\r\n      File \"/usr/lib/python2.7/os.py\", line 296, in walk\r\n        for x in walk(new_path, topdown, onerror, followlinks):\r\n      File \"/usr/lib/python2.7/os.py\", line 296, in walk\r\n        for x in walk(new_path, topdown, onerror, followlinks):\r\n      File \"/usr/lib/python2.7/os.py\", line 286, in walk\r\n        if isdir(join(top, name)):\r\n      File \"/usr/lib/python2.7/posixpath.py\", line 80, in join\r\n        path += '/' + b\r\n    UnicodeDecodeError: 'ascii' codec can't decode byte 0xfc in position 16: ordinal not in range(128)\r\n"}}