{"action":"created","issue":{"url":"https://api.github.com/repos/weecology/retriever/issues/575","repository_url":"https://api.github.com/repos/weecology/retriever","labels_url":"https://api.github.com/repos/weecology/retriever/issues/575/labels{/name}","comments_url":"https://api.github.com/repos/weecology/retriever/issues/575/comments","events_url":"https://api.github.com/repos/weecology/retriever/issues/575/events","html_url":"https://github.com/weecology/retriever/issues/575","id":166063193,"number":575,"title":"Creation of Raw data files in integration test needs improvement","user":{"login":"henrykironde","id":5192965,"avatar_url":"https://avatars.githubusercontent.com/u/5192965?v=3","gravatar_id":"","url":"https://api.github.com/users/henrykironde","html_url":"https://github.com/henrykironde","followers_url":"https://api.github.com/users/henrykironde/followers","following_url":"https://api.github.com/users/henrykironde/following{/other_user}","gists_url":"https://api.github.com/users/henrykironde/gists{/gist_id}","starred_url":"https://api.github.com/users/henrykironde/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/henrykironde/subscriptions","organizations_url":"https://api.github.com/users/henrykironde/orgs","repos_url":"https://api.github.com/users/henrykironde/repos","events_url":"https://api.github.com/users/henrykironde/events{/privacy}","received_events_url":"https://api.github.com/users/henrykironde/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/weecology/retriever/labels/Discussion","name":"Discussion","color":"207de5"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-07-18T10:24:42Z","updated_at":"2016-07-25T09:04:38Z","closed_at":null,"body":"In the [integration test](https://github.com/weecology/retriever/blob/master/test/test_integration.py), we convert text to a raw dataset file\r\n\r\n**for example:**  Given the data below,\r\n\r\n```\r\nsimple_csv = {'name': 'simple_csv',\r\n              'raw_data': \"a,b,c\\n1,2,3\\n4,5,6\\n\",\r\n              'script': \"shortname: simple_csv\\ntable: simple_csv, http://example.com/simple_csv.txt\",\r\n              'expect_out': 'a,b,c\\n1,2,3\\n4,5,6\\n'}\r\n```\r\n\r\nwe create a file; `simple_csv` and the raw_data is written to this file as : \r\n```\r\na,b,c\r\n1,2,3\r\n4,5,6\r\n```\r\n\r\nAt times this does not happen as expected. Extra `endofline` characters are added causing wrong data when bulk inserting. \r\nAn easy way out is by setting `*do_not_bulk_insert: True` in the script"},"comment":{"url":"https://api.github.com/repos/weecology/retriever/issues/comments/234897097","html_url":"https://github.com/weecology/retriever/issues/575#issuecomment-234897097","issue_url":"https://api.github.com/repos/weecology/retriever/issues/575","id":234897097,"user":{"login":"goelakash","id":6972804,"avatar_url":"https://avatars.githubusercontent.com/u/6972804?v=3","gravatar_id":"","url":"https://api.github.com/users/goelakash","html_url":"https://github.com/goelakash","followers_url":"https://api.github.com/users/goelakash/followers","following_url":"https://api.github.com/users/goelakash/following{/other_user}","gists_url":"https://api.github.com/users/goelakash/gists{/gist_id}","starred_url":"https://api.github.com/users/goelakash/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/goelakash/subscriptions","organizations_url":"https://api.github.com/users/goelakash/orgs","repos_url":"https://api.github.com/users/goelakash/repos","events_url":"https://api.github.com/users/goelakash/events{/privacy}","received_events_url":"https://api.github.com/users/goelakash/received_events","type":"User","site_admin":false},"created_at":"2016-07-25T09:04:38Z","updated_at":"2016-07-25T09:04:38Z","body":"@henrykironde Why do extra `endofline` characters get added?"}}
{"actor":{"display_login":"goelakash"}}