{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/16061","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/16061/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/16061/comments","events_url":"https://api.github.com/repos/apache/spark/issues/16061/events","html_url":"https://github.com/apache/spark/pull/16061","id":192326277,"number":16061,"title":"[SPARK-18278] [Scheduler] Support native submission of spark jobs to a kubernetes cluster","user":{"login":"erikerlandson","id":259898,"avatar_url":"https://avatars.githubusercontent.com/u/259898?v=3","gravatar_id":"","url":"https://api.github.com/users/erikerlandson","html_url":"https://github.com/erikerlandson","followers_url":"https://api.github.com/users/erikerlandson/followers","following_url":"https://api.github.com/users/erikerlandson/following{/other_user}","gists_url":"https://api.github.com/users/erikerlandson/gists{/gist_id}","starred_url":"https://api.github.com/users/erikerlandson/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/erikerlandson/subscriptions","organizations_url":"https://api.github.com/users/erikerlandson/orgs","repos_url":"https://api.github.com/users/erikerlandson/repos","events_url":"https://api.github.com/users/erikerlandson/events{/privacy}","received_events_url":"https://api.github.com/users/erikerlandson/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":12,"created_at":"2016-11-29T16:14:30Z","updated_at":"2016-12-02T00:25:07Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/16061","html_url":"https://github.com/apache/spark/pull/16061","diff_url":"https://github.com/apache/spark/pull/16061.diff","patch_url":"https://github.com/apache/spark/pull/16061.patch"},"body":"## What changes were proposed in this pull request?\r\nAdd support for native submission of spark jobs to a kubernetes cluster, as a first-class scheduler back-end.\r\n\r\n## How was this patch tested?\r\nCurrently, testing has been mostly informal.  Integration tests will be added before completion.\r\n\r\n## Notes\r\nThe initial branch on this PR is intended to serve as an \"MVP\" base for integrating various contributions to a \"k8s-native\" effort being conducted by several interested community members, including:\r\n\r\n@foxish, @erikerlandson, @iyanuobidele\r\nhttps://github.com/foxish/spark/tree/k8s-support/kubernetes\r\n\r\n@mccheah \r\nhttps://github.com/foxish/spark/pull/7\r\n\r\nGoals for integrating features include:\r\n\r\n- build of docker image (or images) for spark\r\n- integration tests\r\n- publishing of third-party resources\r\n- resource constraints\r\n- external shuffle service via daemon-sets\r\n- possible hooks for control of executor scale by kubernetes control plane\r\n\r\n## Instructions\r\n\r\nCurrent instructions for building at the time of this submission are here:\r\nhttps://github.com/foxish/spark/tree/k8s-support/kubernetes"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/264337949","html_url":"https://github.com/apache/spark/pull/16061#issuecomment-264337949","issue_url":"https://api.github.com/repos/apache/spark/issues/16061","id":264337949,"user":{"login":"foxish","id":906471,"avatar_url":"https://avatars.githubusercontent.com/u/906471?v=3","gravatar_id":"","url":"https://api.github.com/users/foxish","html_url":"https://github.com/foxish","followers_url":"https://api.github.com/users/foxish/followers","following_url":"https://api.github.com/users/foxish/following{/other_user}","gists_url":"https://api.github.com/users/foxish/gists{/gist_id}","starred_url":"https://api.github.com/users/foxish/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/foxish/subscriptions","organizations_url":"https://api.github.com/users/foxish/orgs","repos_url":"https://api.github.com/users/foxish/repos","events_url":"https://api.github.com/users/foxish/events{/privacy}","received_events_url":"https://api.github.com/users/foxish/received_events","type":"User","site_admin":false},"created_at":"2016-12-02T00:25:07Z","updated_at":"2016-12-02T00:25:07Z","body":"I would think that it would be easier if we continue to keep PRs and issues in foxish/spark since we have the previous PRs and issues over there. It should be easy enough to pick those commits up and update this branch once we review and merge them. It doesn't matter where it lives really, except that it seems like most of it is already on one place. "}}
{"actor":{"display_login":"foxish"}}