{"action":"created","issue":{"url":"https://api.github.com/repos/hammerlab/magic-rdds/issues/9","repository_url":"https://api.github.com/repos/hammerlab/magic-rdds","labels_url":"https://api.github.com/repos/hammerlab/magic-rdds/issues/9/labels{/name}","comments_url":"https://api.github.com/repos/hammerlab/magic-rdds/issues/9/comments","events_url":"https://api.github.com/repos/hammerlab/magic-rdds/issues/9/events","html_url":"https://github.com/hammerlab/magic-rdds/pull/9","id":171858662,"number":9,"title":"Add lazy zipWithIndex","user":{"login":"sadikovi","id":7788766,"avatar_url":"https://avatars.githubusercontent.com/u/7788766?v=3","gravatar_id":"","url":"https://api.github.com/users/sadikovi","html_url":"https://github.com/sadikovi","followers_url":"https://api.github.com/users/sadikovi/followers","following_url":"https://api.github.com/users/sadikovi/following{/other_user}","gists_url":"https://api.github.com/users/sadikovi/gists{/gist_id}","starred_url":"https://api.github.com/users/sadikovi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sadikovi/subscriptions","organizations_url":"https://api.github.com/users/sadikovi/orgs","repos_url":"https://api.github.com/users/sadikovi/repos","events_url":"https://api.github.com/users/sadikovi/events{/privacy}","received_events_url":"https://api.github.com/users/sadikovi/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2016-08-18T09:36:20Z","updated_at":"2016-08-20T06:18:51Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/hammerlab/magic-rdds/pulls/9","html_url":"https://github.com/hammerlab/magic-rdds/pull/9","diff_url":"https://github.com/hammerlab/magic-rdds/pull/9.diff","patch_url":"https://github.com/hammerlab/magic-rdds/pull/9.patch"},"body":"This PR is essentially copy of of `org.apache.spark.rdd.ZippedWithIndexRDD` with some minor modification of computing length of each partition only when `partitions` are called or action is invoked on RDD (which does compute partitions). \r\n\r\nHad to move/reimplement some functionality for reasons of keeping under `org.hammerlab.magic.rdd`. \r\n\r\nUsage:\r\n```shell\r\nscala> import org.hammerlab.magic.rdd.LazyZippedWithIndexRDD._\r\nscala> val rdd = sc.parallelize(0 until 10).filter(_ % 2 == 0).lazyZipWithIndex\r\nscala> rdd.collect\r\nres1: Array[(Int, Long)] = Array((0,0), (2,1), (4,2), (6,3), (8,4))\r\n\r\n```"},"comment":{"url":"https://api.github.com/repos/hammerlab/magic-rdds/issues/comments/241182447","html_url":"https://github.com/hammerlab/magic-rdds/pull/9#issuecomment-241182447","issue_url":"https://api.github.com/repos/hammerlab/magic-rdds/issues/9","id":241182447,"user":{"login":"ryan-williams","id":465045,"avatar_url":"https://avatars.githubusercontent.com/u/465045?v=3","gravatar_id":"","url":"https://api.github.com/users/ryan-williams","html_url":"https://github.com/ryan-williams","followers_url":"https://api.github.com/users/ryan-williams/followers","following_url":"https://api.github.com/users/ryan-williams/following{/other_user}","gists_url":"https://api.github.com/users/ryan-williams/gists{/gist_id}","starred_url":"https://api.github.com/users/ryan-williams/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ryan-williams/subscriptions","organizations_url":"https://api.github.com/users/ryan-williams/orgs","repos_url":"https://api.github.com/users/ryan-williams/repos","events_url":"https://api.github.com/users/ryan-williams/events{/privacy}","received_events_url":"https://api.github.com/users/ryan-williams/received_events","type":"User","site_admin":false},"created_at":"2016-08-20T06:18:51Z","updated_at":"2016-08-20T06:18:51Z","body":"This looks great, thanks @sadikovi. One comment, about `Iterator.size`"}}
{"actor":{"display_login":"ryan-williams"}}