{"action":"created","issue":{"url":"https://api.github.com/repos/dimroc/etl-language-comparison/issues/34","repository_url":"https://api.github.com/repos/dimroc/etl-language-comparison","labels_url":"https://api.github.com/repos/dimroc/etl-language-comparison/issues/34/labels{/name}","comments_url":"https://api.github.com/repos/dimroc/etl-language-comparison/issues/34/comments","events_url":"https://api.github.com/repos/dimroc/etl-language-comparison/issues/34/events","html_url":"https://github.com/dimroc/etl-language-comparison/pull/34","id":157562872,"number":34,"title":"add haskell implementations","user":{"login":"tippenein","id":1235263,"avatar_url":"https://avatars.githubusercontent.com/u/1235263?v=3","gravatar_id":"","url":"https://api.github.com/users/tippenein","html_url":"https://github.com/tippenein","followers_url":"https://api.github.com/users/tippenein/followers","following_url":"https://api.github.com/users/tippenein/following{/other_user}","gists_url":"https://api.github.com/users/tippenein/gists{/gist_id}","starred_url":"https://api.github.com/users/tippenein/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tippenein/subscriptions","organizations_url":"https://api.github.com/users/tippenein/orgs","repos_url":"https://api.github.com/users/tippenein/repos","events_url":"https://api.github.com/users/tippenein/events{/privacy}","received_events_url":"https://api.github.com/users/tippenein/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-05-30T22:30:03Z","updated_at":"2016-06-09T20:04:06Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/dimroc/etl-language-comparison/pulls/34","html_url":"https://github.com/dimroc/etl-language-comparison/pull/34","diff_url":"https://github.com/dimroc/etl-language-comparison/pull/34.diff","patch_url":"https://github.com/dimroc/etl-language-comparison/pull/34.patch"},"body":"Adds 2 implementations\r\n1. using a bytestring indice search\r\n2. with regex (regex-tdfa)\r\n\r\nThe results are included in `benchmark.prof` and on my machine are:\r\n`regex - 7.652 s    (7.358 s .. 7.819 s)`\r\n`indice - 2.887 s    (2.830 s .. 2.919 s)`\r\n\r\nThe Makefile includes the commands needed to run these benchmarks yourself. (`make benchmark`)\r\n\r\nThanks to @Gabriel439 for the majority of this implementation - [here](https://www.reddit.com/r/haskell/comments/4lhydt/rfc_improving_speed_of_a_map_reduce_using_pipes/d3oettx)\r\n\r\nedit: Added `memory` command to makefile to show memory usage.\r\nindice: 28 MB total memory in use \r\nregex: 9 MB total memory in use "},"comment":{"url":"https://api.github.com/repos/dimroc/etl-language-comparison/issues/comments/225010002","html_url":"https://github.com/dimroc/etl-language-comparison/pull/34#issuecomment-225010002","issue_url":"https://api.github.com/repos/dimroc/etl-language-comparison/issues/34","id":225010002,"user":{"login":"dimroc","id":635121,"avatar_url":"https://avatars.githubusercontent.com/u/635121?v=3","gravatar_id":"","url":"https://api.github.com/users/dimroc","html_url":"https://github.com/dimroc","followers_url":"https://api.github.com/users/dimroc/followers","following_url":"https://api.github.com/users/dimroc/following{/other_user}","gists_url":"https://api.github.com/users/dimroc/gists{/gist_id}","starred_url":"https://api.github.com/users/dimroc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dimroc/subscriptions","organizations_url":"https://api.github.com/users/dimroc/orgs","repos_url":"https://api.github.com/users/dimroc/repos","events_url":"https://api.github.com/users/dimroc/events{/privacy}","received_events_url":"https://api.github.com/users/dimroc/received_events","type":"User","site_admin":false},"created_at":"2016-06-09T20:04:06Z","updated_at":"2016-06-09T20:04:06Z","body":"Thanks for the contribution guys. I especially love the memory consumption data. I've been hoping to do that on quite a few other implementations.\r\n\r\nTwo things to note:\r\n\r\n1. Output isn't sorted. All other implementations sort the output in descending order, with highest matching neighborhood being at the top. This does affect benchmarks.\r\n2. regex results seem off. According to `tmp/haskell_regex_results.txt`, park-slope-gowanus mentioned the `knicks` 119016 times. Not in out universe guys. The regex results don't match the index result. haskell_indice_results.txt shows park-slope-gowanus has 258 matches which is correct.\r\n\r\nFeel free to run one of the other implementations and compare results. Once you have the output sorted, you can just diff against the other outputs. I've attached the regex result below for you to see what I see.\r\n\r\n[haskell_regex_results.txt](https://github.com/dimroc/etl-language-comparison/files/307807/haskell_regex_results.txt)\r\n\r\nLooking forward to the next commit."}}
{"actor":{"display_login":"dimroc"}}