{"action":"created","comment":{"url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/comments/54496089","id":54496089,"diff_hunk":"@@ -1,59 +1,29 @@\n # sparkmagic\n-IPython magics for working with remote Spark clusters\n \n-## Development team and Advocate\n+Sparkmagic is a set of tools for interactively working with remote Spark clusters through [Livy](https://github.com/cloudera/hue/tree/master/apps/spark/java), a Spark REST server, in [Jupyter](http://jupyter.org) notebooks.\n+The Sparkmagic project includes a set of IPython magics for interactively running Spark code in multiple languages, as well as some kernels that you can use to turn Jupyter into an integrated Spark environment.\n \n-Subproject development team:\n+## Features\n \n-* Alejandro Guerrero Gonzalez, Microsoft (`@aggFTW`)\n-* Auberon Lopez, Cal Poly (`@alope107`)\n-* Sangeetha Shekar, Microsoft (`@sangeethashekar`)\n+* Run Spark code in multiple languages against any remote Spark cluster through Livy\n \n-Steering Council Advocate\n+* Automatic [Zeppelin](https://zeppelin.incubator.apache.org/)-like visualization of SQL queries with the `%%sql` magic in the PySpark and Spark kernels\n \n-* Brian Granger (`@ellisonbg`)\n+* Capture the output of SQL queries as Pandas dataframes to work with them on your local machine","path":"README.md","position":20,"original_position":20,"commit_id":"e9849035ce9f9fd7a8a0105a5692f807afd04c01","original_commit_id":"e9849035ce9f9fd7a8a0105a5692f807afd04c01","user":{"login":"aggFTW","id":654204,"avatar_url":"https://avatars.githubusercontent.com/u/654204?v=3","gravatar_id":"","url":"https://api.github.com/users/aggFTW","html_url":"https://github.com/aggFTW","followers_url":"https://api.github.com/users/aggFTW/followers","following_url":"https://api.github.com/users/aggFTW/following{/other_user}","gists_url":"https://api.github.com/users/aggFTW/gists{/gist_id}","starred_url":"https://api.github.com/users/aggFTW/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aggFTW/subscriptions","organizations_url":"https://api.github.com/users/aggFTW/orgs","repos_url":"https://api.github.com/users/aggFTW/repos","events_url":"https://api.github.com/users/aggFTW/events{/privacy}","received_events_url":"https://api.github.com/users/aggFTW/received_events","type":"User","site_admin":false},"body":"This is super powerful! Let's give some examples/screenshots.","created_at":"2016-02-29T23:09:12Z","updated_at":"2016-02-29T23:09:12Z","html_url":"https://github.com/jupyter-incubator/sparkmagic/pull/177#discussion_r54496089","pull_request_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/177","_links":{"self":{"href":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/comments/54496089"},"html":{"href":"https://github.com/jupyter-incubator/sparkmagic/pull/177#discussion_r54496089"},"pull_request":{"href":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/177"}}},"pull_request":{"url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/177","id":61160172,"html_url":"https://github.com/jupyter-incubator/sparkmagic/pull/177","diff_url":"https://github.com/jupyter-incubator/sparkmagic/pull/177.diff","patch_url":"https://github.com/jupyter-incubator/sparkmagic/pull/177.patch","issue_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/177","number":177,"state":"open","locked":false,"title":"Installation & documentation improvements","user":{"login":"msftristew","id":13972471,"avatar_url":"https://avatars.githubusercontent.com/u/13972471?v=3","gravatar_id":"","url":"https://api.github.com/users/msftristew","html_url":"https://github.com/msftristew","followers_url":"https://api.github.com/users/msftristew/followers","following_url":"https://api.github.com/users/msftristew/following{/other_user}","gists_url":"https://api.github.com/users/msftristew/gists{/gist_id}","starred_url":"https://api.github.com/users/msftristew/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/msftristew/subscriptions","organizations_url":"https://api.github.com/users/msftristew/orgs","repos_url":"https://api.github.com/users/msftristew/repos","events_url":"https://api.github.com/users/msftristew/events{/privacy}","received_events_url":"https://api.github.com/users/msftristew/received_events","type":"User","site_admin":false},"body":"Closes #167 \r\nCloses #63\r\n\r\n* Add project dependencies to setup.py so they are installed automatically when you pip-install the project\r\n\r\n* Change README.md to be a more straightforward document explaining the goals of the project and how to install.\r\n\r\nI welcome your input on what kind of content should go into the README.md before we merge (we can also supplement it with more info later).","created_at":"2016-02-29T22:48:47Z","updated_at":"2016-02-29T23:09:12Z","closed_at":null,"merged_at":null,"merge_commit_sha":"169ab4169c76dc6a8f199783e96688a0a6aec110","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/177/commits","review_comments_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/177/comments","review_comment_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/comments{/number}","comments_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/177/comments","statuses_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/statuses/e9849035ce9f9fd7a8a0105a5692f807afd04c01","head":{"label":"msftristew:installation","ref":"installation","sha":"e9849035ce9f9fd7a8a0105a5692f807afd04c01","user":{"login":"msftristew","id":13972471,"avatar_url":"https://avatars.githubusercontent.com/u/13972471?v=3","gravatar_id":"","url":"https://api.github.com/users/msftristew","html_url":"https://github.com/msftristew","followers_url":"https://api.github.com/users/msftristew/followers","following_url":"https://api.github.com/users/msftristew/following{/other_user}","gists_url":"https://api.github.com/users/msftristew/gists{/gist_id}","starred_url":"https://api.github.com/users/msftristew/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/msftristew/subscriptions","organizations_url":"https://api.github.com/users/msftristew/orgs","repos_url":"https://api.github.com/users/msftristew/repos","events_url":"https://api.github.com/users/msftristew/events{/privacy}","received_events_url":"https://api.github.com/users/msftristew/received_events","type":"User","site_admin":false},"repo":{"id":46371305,"name":"sparkmagic","full_name":"msftristew/sparkmagic","owner":{"login":"msftristew","id":13972471,"avatar_url":"https://avatars.githubusercontent.com/u/13972471?v=3","gravatar_id":"","url":"https://api.github.com/users/msftristew","html_url":"https://github.com/msftristew","followers_url":"https://api.github.com/users/msftristew/followers","following_url":"https://api.github.com/users/msftristew/following{/other_user}","gists_url":"https://api.github.com/users/msftristew/gists{/gist_id}","starred_url":"https://api.github.com/users/msftristew/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/msftristew/subscriptions","organizations_url":"https://api.github.com/users/msftristew/orgs","repos_url":"https://api.github.com/users/msftristew/repos","events_url":"https://api.github.com/users/msftristew/events{/privacy}","received_events_url":"https://api.github.com/users/msftristew/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/msftristew/sparkmagic","description":"IPython magics for working with remote Spark clusters","fork":true,"url":"https://api.github.com/repos/msftristew/sparkmagic","forks_url":"https://api.github.com/repos/msftristew/sparkmagic/forks","keys_url":"https://api.github.com/repos/msftristew/sparkmagic/keys{/key_id}","collaborators_url":"https://api.github.com/repos/msftristew/sparkmagic/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/msftristew/sparkmagic/teams","hooks_url":"https://api.github.com/repos/msftristew/sparkmagic/hooks","issue_events_url":"https://api.github.com/repos/msftristew/sparkmagic/issues/events{/number}","events_url":"https://api.github.com/repos/msftristew/sparkmagic/events","assignees_url":"https://api.github.com/repos/msftristew/sparkmagic/assignees{/user}","branches_url":"https://api.github.com/repos/msftristew/sparkmagic/branches{/branch}","tags_url":"https://api.github.com/repos/msftristew/sparkmagic/tags","blobs_url":"https://api.github.com/repos/msftristew/sparkmagic/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/msftristew/sparkmagic/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/msftristew/sparkmagic/git/refs{/sha}","trees_url":"https://api.github.com/repos/msftristew/sparkmagic/git/trees{/sha}","statuses_url":"https://api.github.com/repos/msftristew/sparkmagic/statuses/{sha}","languages_url":"https://api.github.com/repos/msftristew/sparkmagic/languages","stargazers_url":"https://api.github.com/repos/msftristew/sparkmagic/stargazers","contributors_url":"https://api.github.com/repos/msftristew/sparkmagic/contributors","subscribers_url":"https://api.github.com/repos/msftristew/sparkmagic/subscribers","subscription_url":"https://api.github.com/repos/msftristew/sparkmagic/subscription","commits_url":"https://api.github.com/repos/msftristew/sparkmagic/commits{/sha}","git_commits_url":"https://api.github.com/repos/msftristew/sparkmagic/git/commits{/sha}","comments_url":"https://api.github.com/repos/msftristew/sparkmagic/comments{/number}","issue_comment_url":"https://api.github.com/repos/msftristew/sparkmagic/issues/comments{/number}","contents_url":"https://api.github.com/repos/msftristew/sparkmagic/contents/{+path}","compare_url":"https://api.github.com/repos/msftristew/sparkmagic/compare/{base}...{head}","merges_url":"https://api.github.com/repos/msftristew/sparkmagic/merges","archive_url":"https://api.github.com/repos/msftristew/sparkmagic/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/msftristew/sparkmagic/downloads","issues_url":"https://api.github.com/repos/msftristew/sparkmagic/issues{/number}","pulls_url":"https://api.github.com/repos/msftristew/sparkmagic/pulls{/number}","milestones_url":"https://api.github.com/repos/msftristew/sparkmagic/milestones{/number}","notifications_url":"https://api.github.com/repos/msftristew/sparkmagic/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/msftristew/sparkmagic/labels{/name}","releases_url":"https://api.github.com/repos/msftristew/sparkmagic/releases{/id}","deployments_url":"https://api.github.com/repos/msftristew/sparkmagic/deployments","created_at":"2015-11-17T19:49:34Z","updated_at":"2016-01-13T00:32:42Z","pushed_at":"2016-02-29T23:06:20Z","git_url":"git://github.com/msftristew/sparkmagic.git","ssh_url":"git@github.com:msftristew/sparkmagic.git","clone_url":"https://github.com/msftristew/sparkmagic.git","svn_url":"https://github.com/msftristew/sparkmagic","homepage":null,"size":506,"stargazers_count":0,"watchers_count":0,"language":"Python","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"jupyter-incubator:master","ref":"master","sha":"164da9388aa31aa5f112042bdfd1d2720d1c0a85","user":{"login":"jupyter-incubator","id":14002361,"avatar_url":"https://avatars.githubusercontent.com/u/14002361?v=3","gravatar_id":"","url":"https://api.github.com/users/jupyter-incubator","html_url":"https://github.com/jupyter-incubator","followers_url":"https://api.github.com/users/jupyter-incubator/followers","following_url":"https://api.github.com/users/jupyter-incubator/following{/other_user}","gists_url":"https://api.github.com/users/jupyter-incubator/gists{/gist_id}","starred_url":"https://api.github.com/users/jupyter-incubator/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jupyter-incubator/subscriptions","organizations_url":"https://api.github.com/users/jupyter-incubator/orgs","repos_url":"https://api.github.com/users/jupyter-incubator/repos","events_url":"https://api.github.com/users/jupyter-incubator/events{/privacy}","received_events_url":"https://api.github.com/users/jupyter-incubator/received_events","type":"Organization","site_admin":false},"repo":{"id":42875585,"name":"sparkmagic","full_name":"jupyter-incubator/sparkmagic","owner":{"login":"jupyter-incubator","id":14002361,"avatar_url":"https://avatars.githubusercontent.com/u/14002361?v=3","gravatar_id":"","url":"https://api.github.com/users/jupyter-incubator","html_url":"https://github.com/jupyter-incubator","followers_url":"https://api.github.com/users/jupyter-incubator/followers","following_url":"https://api.github.com/users/jupyter-incubator/following{/other_user}","gists_url":"https://api.github.com/users/jupyter-incubator/gists{/gist_id}","starred_url":"https://api.github.com/users/jupyter-incubator/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jupyter-incubator/subscriptions","organizations_url":"https://api.github.com/users/jupyter-incubator/orgs","repos_url":"https://api.github.com/users/jupyter-incubator/repos","events_url":"https://api.github.com/users/jupyter-incubator/events{/privacy}","received_events_url":"https://api.github.com/users/jupyter-incubator/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/jupyter-incubator/sparkmagic","description":"IPython magics for working with remote Spark clusters","fork":false,"url":"https://api.github.com/repos/jupyter-incubator/sparkmagic","forks_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/forks","keys_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/keys{/key_id}","collaborators_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/teams","hooks_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/hooks","issue_events_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/events{/number}","events_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/events","assignees_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/assignees{/user}","branches_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/branches{/branch}","tags_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/tags","blobs_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/git/refs{/sha}","trees_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/git/trees{/sha}","statuses_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/statuses/{sha}","languages_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/languages","stargazers_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/stargazers","contributors_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/contributors","subscribers_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/subscribers","subscription_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/subscription","commits_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/commits{/sha}","git_commits_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/git/commits{/sha}","comments_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/comments{/number}","issue_comment_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/comments{/number}","contents_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/contents/{+path}","compare_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/compare/{base}...{head}","merges_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/merges","archive_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/downloads","issues_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues{/number}","pulls_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls{/number}","milestones_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/milestones{/number}","notifications_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/labels{/name}","releases_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/releases{/id}","deployments_url":"https://api.github.com/repos/jupyter-incubator/sparkmagic/deployments","created_at":"2015-09-21T15:35:25Z","updated_at":"2016-02-24T18:42:46Z","pushed_at":"2016-02-29T23:07:49Z","git_url":"git://github.com/jupyter-incubator/sparkmagic.git","ssh_url":"git@github.com:jupyter-incubator/sparkmagic.git","clone_url":"https://github.com/jupyter-incubator/sparkmagic.git","svn_url":"https://github.com/jupyter-incubator/sparkmagic","homepage":null,"size":527,"stargazers_count":38,"watchers_count":38,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":6,"mirror_url":null,"open_issues_count":18,"forks":6,"open_issues":18,"watchers":38,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/177"},"html":{"href":"https://github.com/jupyter-incubator/sparkmagic/pull/177"},"issue":{"href":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/177"},"comments":{"href":"https://api.github.com/repos/jupyter-incubator/sparkmagic/issues/177/comments"},"review_comments":{"href":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/177/comments"},"review_comment":{"href":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/jupyter-incubator/sparkmagic/pulls/177/commits"},"statuses":{"href":"https://api.github.com/repos/jupyter-incubator/sparkmagic/statuses/e9849035ce9f9fd7a8a0105a5692f807afd04c01"}}}}