{"action":"created","issue":{"url":"https://api.github.com/repos/twitter/scalding/issues/1583","repository_url":"https://api.github.com/repos/twitter/scalding","labels_url":"https://api.github.com/repos/twitter/scalding/issues/1583/labels{/name}","comments_url":"https://api.github.com/repos/twitter/scalding/issues/1583/comments","events_url":"https://api.github.com/repos/twitter/scalding/issues/1583/events","html_url":"https://github.com/twitter/scalding/pull/1583","id":167247172,"number":1583,"title":"Experimental Graph API for Scalding","user":{"login":"richwhitjr","id":202552,"avatar_url":"https://avatars.githubusercontent.com/u/202552?v=3","gravatar_id":"","url":"https://api.github.com/users/richwhitjr","html_url":"https://github.com/richwhitjr","followers_url":"https://api.github.com/users/richwhitjr/followers","following_url":"https://api.github.com/users/richwhitjr/following{/other_user}","gists_url":"https://api.github.com/users/richwhitjr/gists{/gist_id}","starred_url":"https://api.github.com/users/richwhitjr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/richwhitjr/subscriptions","organizations_url":"https://api.github.com/users/richwhitjr/orgs","repos_url":"https://api.github.com/users/richwhitjr/repos","events_url":"https://api.github.com/users/richwhitjr/events{/privacy}","received_events_url":"https://api.github.com/users/richwhitjr/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-07-24T18:41:36Z","updated_at":"2016-07-25T19:01:05Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/twitter/scalding/pulls/1583","html_url":"https://github.com/twitter/scalding/pull/1583","diff_url":"https://github.com/twitter/scalding/pull/1583.diff","patch_url":"https://github.com/twitter/scalding/pull/1583.patch"},"body":"I had been using the GraphX library in Spark and realized that scalding does a much better job with very large graphs with heavy skew.  Some of the features in the GraphX library were really nice though and abstracted away some of the complexity of graph work.  \r\n\r\nThis review is a first pass at creating a similar API in scalding.  Currently I have only been thinking about directed graphs but undirected graphs should also be supported in a reasonable library.  The tests also need further work but I want to give people a chance to comment on the API."},"comment":{"url":"https://api.github.com/repos/twitter/scalding/issues/comments/235050887","html_url":"https://github.com/twitter/scalding/pull/1583#issuecomment-235050887","issue_url":"https://api.github.com/repos/twitter/scalding/issues/1583","id":235050887,"user":{"login":"richwhitjr","id":202552,"avatar_url":"https://avatars.githubusercontent.com/u/202552?v=3","gravatar_id":"","url":"https://api.github.com/users/richwhitjr","html_url":"https://github.com/richwhitjr","followers_url":"https://api.github.com/users/richwhitjr/followers","following_url":"https://api.github.com/users/richwhitjr/following{/other_user}","gists_url":"https://api.github.com/users/richwhitjr/gists{/gist_id}","starred_url":"https://api.github.com/users/richwhitjr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/richwhitjr/subscriptions","organizations_url":"https://api.github.com/users/richwhitjr/orgs","repos_url":"https://api.github.com/users/richwhitjr/repos","events_url":"https://api.github.com/users/richwhitjr/events{/privacy}","received_events_url":"https://api.github.com/users/richwhitjr/received_events","type":"User","site_admin":false},"created_at":"2016-07-25T19:01:05Z","updated_at":"2016-07-25T19:01:05Z","body":"Seems like most of those algorithms could be written in terms of the Graph structure.  The nice thing of this new abstraction is working natively with vertices and minimizing data duplication across edges.  Collecting neighbors has many useful properties for doing efficient graph calculations. \r\n\r\nLet me see what I can come up with. \r\n\r\n"}}
{"actor":{"display_login":"richwhitjr"}}