{"action":"created","issue":{"url":"https://api.github.com/repos/ioos/thredds_crawler/issues/25","repository_url":"https://api.github.com/repos/ioos/thredds_crawler","labels_url":"https://api.github.com/repos/ioos/thredds_crawler/issues/25/labels{/name}","comments_url":"https://api.github.com/repos/ioos/thredds_crawler/issues/25/comments","events_url":"https://api.github.com/repos/ioos/thredds_crawler/issues/25/events","html_url":"https://github.com/ioos/thredds_crawler/issues/25","id":318404004,"node_id":"MDU6SXNzdWUzMTg0MDQwMDQ=","number":25,"title":"multiprocessing.pool.MaybeEncodingError","user":{"login":"htmlboss","id":5572045,"node_id":"MDQ6VXNlcjU1NzIwNDU=","avatar_url":"https://avatars3.githubusercontent.com/u/5572045?v=4","gravatar_id":"","url":"https://api.github.com/users/htmlboss","html_url":"https://github.com/htmlboss","followers_url":"https://api.github.com/users/htmlboss/followers","following_url":"https://api.github.com/users/htmlboss/following{/other_user}","gists_url":"https://api.github.com/users/htmlboss/gists{/gist_id}","starred_url":"https://api.github.com/users/htmlboss/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/htmlboss/subscriptions","organizations_url":"https://api.github.com/users/htmlboss/orgs","repos_url":"https://api.github.com/users/htmlboss/repos","events_url":"https://api.github.com/users/htmlboss/events{/privacy}","received_events_url":"https://api.github.com/users/htmlboss/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2018-04-27T13:11:37Z","updated_at":"2018-06-06T14:10:19Z","closed_at":"2018-05-01T11:24:23Z","author_association":"NONE","body":"Using Anaconda w/ Python 3.6, I am now getting the following exception:\r\n```python\r\nTraceback (most recent call last):\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/app.py\", line 1997, in __call__\r\n    return self.wsgi_app(environ, start_response)\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/app.py\", line 1985, in wsgi_app\r\n    response = self.handle_exception(e)\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/app.py\", line 1540, in handle_exception\r\n    reraise(exc_type, exc_value, tb)\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/_compat.py\", line 33, in reraise\r\n    raise value\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/app.py\", line 1982, in wsgi_app\r\n    response = self.full_dispatch_request()\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/app.py\", line 1614, in full_dispatch_request\r\n    rv = self.handle_user_exception(e)\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/app.py\", line 1517, in handle_user_exception\r\n    reraise(exc_type, exc_value, tb)\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/_compat.py\", line 33, in reraise\r\n    raise value\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/app.py\", line 1612, in full_dispatch_request\r\n    rv = self.dispatch_request()\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/flask/app.py\", line 1598, in dispatch_request\r\n    return self.view_functions[rule.endpoint](**req.view_args)\r\n  File \"/home/nabil/Ocean-Data-Map-Project/oceannavigator/views.py\", line 81, in query\r\n    data = oceannavigator.misc.list_class4_files()\r\n  File \"/home/nabil/Ocean-Data-Map-Project/oceannavigator/misc.py\", line 531, in list_class4_files\r\n    return list_class4_files_slowly()\r\n  File \"/home/nabil/Ocean-Data-Map-Project/oceannavigator/misc.py\", line 499, in list_class4_files_slowly\r\n    workers=8, debug=True)\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/thredds_crawler/crawl.py\", line 120, in __init__\r\n    datasets = [j.get() for j in jobs]\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/site-packages/thredds_crawler/crawl.py\", line 120, in <listcomp>\r\n    datasets = [j.get() for j in jobs]\r\n  File \"/opt/tools/anaconda2/envs/testpy/lib/python3.6/multiprocessing/pool.py\", line 644, in get\r\n    raise self._value\r\nmultiprocessing.pool.MaybeEncodingError: Error sending result: '<LeafDataset id: class4/class4_20180420_GIOPS_CONCEPTS_2.3_profile.nc, name: class4_20180420_GIOPS_CONCEPTS_2.3_profile.nc, services: ['OPENDAP', 'DAP4', 'HTTPServer', 'NetcdfSubset', 'WMS']>'. Reason: 'TypeError(\"can't pickle lxml.etree._Element objects\",)'\r\n\r\n```\r\n\r\n\r\nPython 2.7 had no issues. The datasets themselves have not changed.\r\nI did have to make some changes to another library using kml since Python 3 changed how lxml works.\r\nAny ideas?"},"comment":{"url":"https://api.github.com/repos/ioos/thredds_crawler/issues/comments/395082371","html_url":"https://github.com/ioos/thredds_crawler/issues/25#issuecomment-395082371","issue_url":"https://api.github.com/repos/ioos/thredds_crawler/issues/25","id":395082371,"node_id":"MDEyOklzc3VlQ29tbWVudDM5NTA4MjM3MQ==","user":{"login":"kwilcox","id":13939,"node_id":"MDQ6VXNlcjEzOTM5","avatar_url":"https://avatars2.githubusercontent.com/u/13939?v=4","gravatar_id":"","url":"https://api.github.com/users/kwilcox","html_url":"https://github.com/kwilcox","followers_url":"https://api.github.com/users/kwilcox/followers","following_url":"https://api.github.com/users/kwilcox/following{/other_user}","gists_url":"https://api.github.com/users/kwilcox/gists{/gist_id}","starred_url":"https://api.github.com/users/kwilcox/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kwilcox/subscriptions","organizations_url":"https://api.github.com/users/kwilcox/orgs","repos_url":"https://api.github.com/users/kwilcox/repos","events_url":"https://api.github.com/users/kwilcox/events{/privacy}","received_events_url":"https://api.github.com/users/kwilcox/received_events","type":"User","site_admin":false},"created_at":"2018-06-06T14:10:18Z","updated_at":"2018-06-06T14:10:18Z","author_association":"MEMBER","body":"@MBARIMike I just uploaded `1.5.4` to pypi. Let me know if you have troubles."}}
{"actor":{"display_login":"kwilcox"}}