{"action":"opened","issue":{"url":"https://api.github.com/repos/willettk/rgz-analysis/issues/42","repository_url":"https://api.github.com/repos/willettk/rgz-analysis","labels_url":"https://api.github.com/repos/willettk/rgz-analysis/issues/42/labels{/name}","comments_url":"https://api.github.com/repos/willettk/rgz-analysis/issues/42/comments","events_url":"https://api.github.com/repos/willettk/rgz-analysis/issues/42/events","html_url":"https://github.com/willettk/rgz-analysis/issues/42","id":156657044,"number":42,"title":"Log of hangups during pipeline sessions with Kyle, Julie, Avery & Ivy","user":{"login":"ivyw","id":6211345,"avatar_url":"https://avatars.githubusercontent.com/u/6211345?v=3","gravatar_id":"","url":"https://api.github.com/users/ivyw","html_url":"https://github.com/ivyw","followers_url":"https://api.github.com/users/ivyw/followers","following_url":"https://api.github.com/users/ivyw/following{/other_user}","gists_url":"https://api.github.com/users/ivyw/gists{/gist_id}","starred_url":"https://api.github.com/users/ivyw/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ivyw/subscriptions","organizations_url":"https://api.github.com/users/ivyw/orgs","repos_url":"https://api.github.com/users/ivyw/repos","events_url":"https://api.github.com/users/ivyw/events{/privacy}","received_events_url":"https://api.github.com/users/ivyw/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2016-05-25T03:44:27Z","updated_at":"2016-05-25T03:44:27Z","closed_at":null,"body":"\"RGZcatalog.py\" stopped at the 668 entry and spat\r\nout the following statement:\r\n...\r\n668\r\nTraceback (most recent call last):\r\n   File \"RGZcatalog.py\", line 223, in <module>\r\n     output = '%i entries added.' % RGZcatalog()\r\n   File \"RGZcatalog.py\", line 157, in RGZcatalog\r\n     compressed = urllib2.urlopen(str(link_s3)).read() #reads contents\r\nof url to str\r\n   File \"/usr/lib/python2.7/socket.py\", line 351, in read\r\n     data = self._sock.recv(rbufsize)\r\n   File \"/usr/lib/python2.7/httplib.py\", line 573, in read\r\n     s = self.fp.read(amt)\r\n   File \"/usr/lib/python2.7/socket.py\", line 380, in read\r\n     data = self._sock.recv(left)\r\nsocket.error: [Errno 104] Connection reset by peer\r\n\r\n------------------\r\nMeanwhile, a quick check on mongo via >db.catalog.count() revealed a\r\ncatalog of 667 sources.\r\n\r\nAlso the 668th source is CI0781 and the .fits file is in the usual place\r\nso then I googled the issue and found that this could be a\r\n\"reconnect-on-failure\" and this is a sporadic event that is unlikely to\r\nreplicate.\r\n---------------------\r\nSo as a solution, I re-ran RGZcatalog.py again and this is now going for\r\na bit.   It ran for a bit and then encountered the following error message:\r\n...\r\n854\r\nTraceback (most recent call last):\r\n   File \"RGZcatalog.py\", line 223, in <module>\r\n     output = '%i entries added.' % RGZcatalog()\r\n   File \"RGZcatalog.py\", line 129, in RGZcatalog\r\n     sdss_match = p.getSDSS(entry)\r\n   File\r\n\"/media/iwong/19c3c716-e6e3-44f1-95f5-79c1822cedc7/RGZ-PIPE/rgz-analysis/RGZcatalogCode/processing.py\",\r\nline 112, in getSDSS\r\n     df = SDSS_select(query)\r\n   File\r\n\"/media/iwong/19c3c716-e6e3-44f1-95f5-79c1822cedc7/RGZ-PIPE/rgz-analysis/RGZcatalogCode/processing.py\",\r\nline 98, in SDSS_select\r\n     return pd.read_csv(file_like, skiprows=1)\r\n   File \"/usr/local/lib/python2.7/dist-packages/pandas/io/parsers.py\",\r\nline 562, in parser_f\r\n     return _read(filepath_or_buffer, kwds)\r\n   File \"/usr/local/lib/python2.7/dist-packages/pandas/io/parsers.py\",\r\nline 325, in _read\r\n     return parser.read()\r\n   File \"/usr/local/lib/python2.7/dist-packages/pandas/io/parsers.py\",\r\nline 815, in read\r\n     ret = self._engine.read(nrows)\r\n   File \"/usr/local/lib/python2.7/dist-packages/pandas/io/parsers.py\",\r\nline 1314, in read\r\n     data = self._reader.read(nrows)\r\n   File \"pandas/parser.pyx\", line 805, in pandas.parser.TextReader.read\r\n(pandas/parser.c:8748)\r\n   File \"pandas/parser.pyx\", line 827, in\r\npandas.parser.TextReader._read_low_memory (pandas/parser.c:9003)\r\n   File \"pandas/parser.pyx\", line 881, in\r\npandas.parser.TextReader._read_rows (pandas/parser.c:9731)\r\n   File \"pandas/parser.pyx\", line 868, in\r\npandas.parser.TextReader._tokenize_rows (pandas/parser.c:9602)\r\n   File \"pandas/parser.pyx\", line 1865, in\r\npandas.parser.raise_parser_error (pandas/parser.c:23325)\r\npandas.io.common.CParserError: Error tokenizing data. C error: Expected\r\n1 fields in line 61, saw 4\r\n----------------------\r\n\r\nSOLUTION:  Re-run RGZcatalog.py again until it finished.  This work for compiling the ATLAS db.\r\n\r\n"}}
{"actor":{"display_login":"ivyw"}}