{"action":"created","issue":{"url":"https://api.github.com/repos/Microsoft/Mobius/issues/473","repository_url":"https://api.github.com/repos/Microsoft/Mobius","labels_url":"https://api.github.com/repos/Microsoft/Mobius/issues/473/labels{/name}","comments_url":"https://api.github.com/repos/Microsoft/Mobius/issues/473/comments","events_url":"https://api.github.com/repos/Microsoft/Mobius/issues/473/events","html_url":"https://github.com/Microsoft/Mobius/pull/473","id":160091651,"number":473,"title":"Fix needless quotes to arguments (well on Spark 1.6 but causes \"input line too long\" error on Spark 2.0).","user":{"login":"qualiu","id":18525294,"avatar_url":"https://avatars.githubusercontent.com/u/18525294?v=3","gravatar_id":"","url":"https://api.github.com/users/qualiu","html_url":"https://github.com/qualiu","followers_url":"https://api.github.com/users/qualiu/followers","following_url":"https://api.github.com/users/qualiu/following{/other_user}","gists_url":"https://api.github.com/users/qualiu/gists{/gist_id}","starred_url":"https://api.github.com/users/qualiu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/qualiu/subscriptions","organizations_url":"https://api.github.com/users/qualiu/orgs","repos_url":"https://api.github.com/users/qualiu/repos","events_url":"https://api.github.com/users/qualiu/events{/privacy}","received_events_url":"https://api.github.com/users/qualiu/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/Microsoft/Mobius/labels/cla-not-required","name":"cla-not-required","color":"fef2c0"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-06-14T03:46:12Z","updated_at":"2016-06-16T03:57:33Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/Microsoft/Mobius/pulls/473","html_url":"https://github.com/Microsoft/Mobius/pull/473","diff_url":"https://github.com/Microsoft/Mobius/pull/473.diff","patch_url":"https://github.com/Microsoft/Mobius/pull/473.patch"},"body":"Fix needless quotes to arguments (well on Spark 1.6 but causes \"input line too long\" error on Spark 2.0).\r\n   \r\nError repro : (quotes \"Pi*\" cause error)\r\n    set HADOOP_HOME=d:\\msgit\\skaarthikMobius\\build\\tools\\winutils\r\n    set SPARKCLR_HOME=d:\\msgit\\skaarthikMobius\\build\\runtime\r\n    set SPARK_HOME=d:\\msgit\\skaarthikMobius\\build\\tools\\spark-2.0.0-preview-bin-hadoop2.6\r\n    cd /d d:\\msgit\\skaarthikMobius\\build\\runtime\\samples\r\n    %SPARKCLR_HOME%\\scripts\\sparkclr-submit.cmd --exe SparkCLRSamples.exe %CD% --torun Pi* --data d:\\tmp\\skdata"},"comment":{"url":"https://api.github.com/repos/Microsoft/Mobius/issues/comments/226382464","html_url":"https://github.com/Microsoft/Mobius/pull/473#issuecomment-226382464","issue_url":"https://api.github.com/repos/Microsoft/Mobius/issues/473","id":226382464,"user":{"login":"qualiu","id":18525294,"avatar_url":"https://avatars.githubusercontent.com/u/18525294?v=3","gravatar_id":"","url":"https://api.github.com/users/qualiu","html_url":"https://github.com/qualiu","followers_url":"https://api.github.com/users/qualiu/followers","following_url":"https://api.github.com/users/qualiu/following{/other_user}","gists_url":"https://api.github.com/users/qualiu/gists{/gist_id}","starred_url":"https://api.github.com/users/qualiu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/qualiu/subscriptions","organizations_url":"https://api.github.com/users/qualiu/orgs","repos_url":"https://api.github.com/users/qualiu/repos","events_url":"https://api.github.com/users/qualiu/events{/privacy}","received_events_url":"https://api.github.com/users/qualiu/received_events","type":"User","site_admin":false},"created_at":"2016-06-16T03:57:33Z","updated_at":"2016-06-16T03:57:33Z","body":"Repro “**The input line is too long**” error from Spark 2.0 to Spark-1.6  is simple : \r\nCopy, Paste to run following commands  (just change the first line **_d:\\msgit\\lzMobius_** to yours )\r\n```\r\nset MOBIUS_CODE_ROOT=d:\\msgit\\lzMobius\r\nset SPARK_HOME=%MOBIUS_CODE_ROOT%\\build\\tools\\spark-1.6.1-bin-hadoop2.6\r\nset HADOOP_HOME=%MOBIUS_CODE_ROOT%\\build\\tools\\winutils\r\nset SPARKCLR_HOME=%MOBIUS_CODE_ROOT%\\build\\runtime\r\ncd /d %SPARKCLR_HOME%\\samples\r\n%SPARKCLR_HOME%\\scripts\\sparkclr-submit.cmd --exe SparkCLRSamples.exe %CD% --torun Pi* --data d:\\tmp\\skdata%SPARKCLR_HOME%\\scripts\\sparkclr-submit.cmd --exe SparkCLRSamples.exe %CD% --torun Pi* --data d:\\tmp\\skdata\r\n\r\n```\r\n\r\n①**To repro it, add quotes** just like Spark-2.0  by following command (you can also modify the file manually) :\r\n`lzmw -p %MOBIUS_CODE_ROOT%\\build\\tools\\spark-1.6.1-bin-hadoop2.6\\bin\\spark-submit.cmd -t \"(%~dp0spark-submit2.cmd)\" -o \"\\\"$1\\\"\" -R`\r\nThen run the **last submit command** again, you’ll got the error : “**The input line is too long**”.\r\n\r\n②**To restore it back** (eliminate the error) :\r\n`lzmw -p %MOBIUS_CODE_ROOT%\\build\\tools\\spark-1.6.1-bin-hadoop2.6\\bin\\spark-submit.cmd -t \"\\\"(%~dp0spark-submit2.cmd)\\\"\" -o \"$1\" -R\r\n`\r\nlzmw is a standalone exe (versions : Windows/Cygwin/CentOS/Ubuntu/Fedora) : search \"lzshare\" in OneNote.\r\n"}}
{"actor":{"display_login":"qualiu"}}