{"action":"created","issue":{"url":"https://api.github.com/repos/eljefe6a/beamexample/issues/3","repository_url":"https://api.github.com/repos/eljefe6a/beamexample","labels_url":"https://api.github.com/repos/eljefe6a/beamexample/issues/3/labels{/name}","comments_url":"https://api.github.com/repos/eljefe6a/beamexample/issues/3/comments","events_url":"https://api.github.com/repos/eljefe6a/beamexample/issues/3/events","html_url":"https://github.com/eljefe6a/beamexample/issues/3","id":178962793,"number":3,"title":"Spark dependencies are provided by design, not a bug.","user":{"login":"amitsela","id":4245753,"avatar_url":"https://avatars.githubusercontent.com/u/4245753?v=3","gravatar_id":"","url":"https://api.github.com/users/amitsela","html_url":"https://github.com/amitsela","followers_url":"https://api.github.com/users/amitsela/followers","following_url":"https://api.github.com/users/amitsela/following{/other_user}","gists_url":"https://api.github.com/users/amitsela/gists{/gist_id}","starred_url":"https://api.github.com/users/amitsela/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amitsela/subscriptions","organizations_url":"https://api.github.com/users/amitsela/orgs","repos_url":"https://api.github.com/users/amitsela/repos","events_url":"https://api.github.com/users/amitsela/events{/privacy}","received_events_url":"https://api.github.com/users/amitsela/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2016-09-23T20:07:29Z","updated_at":"2016-09-23T20:36:55Z","closed_at":null,"body":"In https://github.com/eljefe6a/beamexample/blob/master/BeamTutorial/pom.xml#L93 it says that the dependencies need to be explicitly added because of a bug. That is wrong. They need to be explicitly added because they are scope `provided` in the runner pom.\r\n\r\nSpark is **usually** deployed in production clusters and applications depend on it with scope `provided` or `runtime`.\r\nOne good reason is the fact that the Spark distribution used needs to match the backend: `YARN`, `Mesos`, `Stand Alone`.\r\nAnother reason is the fact that if using Spark with Hadoop, you have to use a Hadoop-specific build - see [here](http://spark.apache.org/downloads.html)."},"comment":{"url":"https://api.github.com/repos/eljefe6a/beamexample/issues/comments/249296215","html_url":"https://github.com/eljefe6a/beamexample/issues/3#issuecomment-249296215","issue_url":"https://api.github.com/repos/eljefe6a/beamexample/issues/3","id":249296215,"user":{"login":"amitsela","id":4245753,"avatar_url":"https://avatars.githubusercontent.com/u/4245753?v=3","gravatar_id":"","url":"https://api.github.com/users/amitsela","html_url":"https://github.com/amitsela","followers_url":"https://api.github.com/users/amitsela/followers","following_url":"https://api.github.com/users/amitsela/following{/other_user}","gists_url":"https://api.github.com/users/amitsela/gists{/gist_id}","starred_url":"https://api.github.com/users/amitsela/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amitsela/subscriptions","organizations_url":"https://api.github.com/users/amitsela/orgs","repos_url":"https://api.github.com/users/amitsela/repos","events_url":"https://api.github.com/users/amitsela/events{/privacy}","received_events_url":"https://api.github.com/users/amitsela/received_events","type":"User","site_admin":false},"created_at":"2016-09-23T20:36:55Z","updated_at":"2016-09-23T20:36:55Z","body":"Spark have separate builds just for that... out choice is to have custom builds for their custom builds, that's a bad road to go down... "}}
{"actor":{"display_login":"amitsela"}}