{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/10770","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/10770/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/10770/comments","events_url":"https://api.github.com/repos/apache/spark/issues/10770/events","html_url":"https://github.com/apache/spark/pull/10770","id":126851449,"number":10770,"title":"[SPARK-12836][CORE] Fix spark enable both driver run executor & write…","user":{"login":"Astralidea","id":4392280,"avatar_url":"https://avatars.githubusercontent.com/u/4392280?v=3","gravatar_id":"","url":"https://api.github.com/users/Astralidea","html_url":"https://github.com/Astralidea","followers_url":"https://api.github.com/users/Astralidea/followers","following_url":"https://api.github.com/users/Astralidea/following{/other_user}","gists_url":"https://api.github.com/users/Astralidea/gists{/gist_id}","starred_url":"https://api.github.com/users/Astralidea/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Astralidea/subscriptions","organizations_url":"https://api.github.com/users/Astralidea/orgs","repos_url":"https://api.github.com/users/Astralidea/repos","events_url":"https://api.github.com/users/Astralidea/events{/privacy}","received_events_url":"https://api.github.com/users/Astralidea/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":9,"created_at":"2016-01-15T10:59:37Z","updated_at":"2016-02-15T08:36:32Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/10770","html_url":"https://github.com/apache/spark/pull/10770","diff_url":"https://github.com/apache/spark/pull/10770.diff","patch_url":"https://github.com/apache/spark/pull/10770.patch"},"body":"… to HDFS\r\n\r\nwhen spark set env HADOOP_USER_NAME CoarseMesosSchedulerBackend will set sparkuser from this env, but in my cluster run spark must be root, write HDFS must set HADOOP_USER_NAME, need a configuration set run executor by root & write hdfs by another."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/184111929","html_url":"https://github.com/apache/spark/pull/10770#issuecomment-184111929","issue_url":"https://api.github.com/repos/apache/spark/issues/10770","id":184111929,"user":{"login":"Astralidea","id":4392280,"avatar_url":"https://avatars.githubusercontent.com/u/4392280?v=3","gravatar_id":"","url":"https://api.github.com/users/Astralidea","html_url":"https://github.com/Astralidea","followers_url":"https://api.github.com/users/Astralidea/followers","following_url":"https://api.github.com/users/Astralidea/following{/other_user}","gists_url":"https://api.github.com/users/Astralidea/gists{/gist_id}","starred_url":"https://api.github.com/users/Astralidea/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Astralidea/subscriptions","organizations_url":"https://api.github.com/users/Astralidea/orgs","repos_url":"https://api.github.com/users/Astralidea/repos","events_url":"https://api.github.com/users/Astralidea/events{/privacy}","received_events_url":"https://api.github.com/users/Astralidea/received_events","type":"User","site_admin":false},"created_at":"2016-02-15T08:36:32Z","updated_at":"2016-02-15T08:36:32Z","body":"@dragos Sorry about reply late. In my system spark running as \"root\". it is configuration mistakes。\r\nbut if I do not use root. I use user such as, sparkstat1,sparkstat2,sparkstat3.for hadoop directory use dir1,dir2,dir3.**spark could running in every machine configurationed by mesos**, so I set HADOOP_USER_NAME to sparkstat1,sparkstat2,sparkstat3, and mesos could deploy spark use user sparkstat1,sparkstat2,sparkstat3. after a time. hadoop manager add new user sparkstat4 for dir4, but I could not let mesos deploy spark use user sparkstat4, because if I change mesos config I need to restart mesos to do this. but there are many job already running in cluster. **hadoop-clint allowed set a user not running by another user **, so I think spark should allow set different user read data & running by another user.If not give me another method to set user or do not restart mesos is ok."}}