{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/15137","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/15137/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/15137/comments","events_url":"https://api.github.com/repos/apache/spark/issues/15137/events","html_url":"https://github.com/apache/spark/pull/15137","id":177636195,"number":15137,"title":"[SPARK-17512][Core] Avoid formatting to python path for yarn and mesos cluster mode","user":{"login":"jerryshao","id":850797,"avatar_url":"https://avatars.githubusercontent.com/u/850797?v=3","gravatar_id":"","url":"https://api.github.com/users/jerryshao","html_url":"https://github.com/jerryshao","followers_url":"https://api.github.com/users/jerryshao/followers","following_url":"https://api.github.com/users/jerryshao/following{/other_user}","gists_url":"https://api.github.com/users/jerryshao/gists{/gist_id}","starred_url":"https://api.github.com/users/jerryshao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jerryshao/subscriptions","organizations_url":"https://api.github.com/users/jerryshao/orgs","repos_url":"https://api.github.com/users/jerryshao/repos","events_url":"https://api.github.com/users/jerryshao/events{/privacy}","received_events_url":"https://api.github.com/users/jerryshao/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2016-09-18T07:38:18Z","updated_at":"2016-09-22T12:38:46Z","closed_at":"2016-09-21T21:55:34Z","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/15137","html_url":"https://github.com/apache/spark/pull/15137","diff_url":"https://github.com/apache/spark/pull/15137.diff","patch_url":"https://github.com/apache/spark/pull/15137.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nYarn and mesos cluster mode support remote python path (HDFS/S3 scheme) by their own mechanism, it is not necessary to check and format the python when running on these modes. This is a potential regression compared to 1.6, so here propose to fix it.\r\n\r\n## How was this patch tested?\r\n\r\nUnit test to verify SparkSubmit arguments, also with local cluster verification. Because of lack of `MiniDFSCluster` support in Spark unit test, there's no integration test added.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/248891953","html_url":"https://github.com/apache/spark/pull/15137#issuecomment-248891953","issue_url":"https://api.github.com/repos/apache/spark/issues/15137","id":248891953,"user":{"login":"andrewor14","id":2133137,"avatar_url":"https://avatars.githubusercontent.com/u/2133137?v=3","gravatar_id":"","url":"https://api.github.com/users/andrewor14","html_url":"https://github.com/andrewor14","followers_url":"https://api.github.com/users/andrewor14/followers","following_url":"https://api.github.com/users/andrewor14/following{/other_user}","gists_url":"https://api.github.com/users/andrewor14/gists{/gist_id}","starred_url":"https://api.github.com/users/andrewor14/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andrewor14/subscriptions","organizations_url":"https://api.github.com/users/andrewor14/orgs","repos_url":"https://api.github.com/users/andrewor14/repos","events_url":"https://api.github.com/users/andrewor14/events{/privacy}","received_events_url":"https://api.github.com/users/andrewor14/received_events","type":"User","site_admin":false},"created_at":"2016-09-22T12:38:46Z","updated_at":"2016-09-22T12:38:46Z","body":"Got it. I think back then when I wrote that comment we still haven't supported cluster mode with python yet. It's just a little confusing if we're reading that comment in isolation."}}
{"actor":{"display_login":"andrewor14"}}