{"action":"created","issue":{"url":"https://api.github.com/repos/databricks/spark-csv/issues/302","repository_url":"https://api.github.com/repos/databricks/spark-csv","labels_url":"https://api.github.com/repos/databricks/spark-csv/issues/302/labels{/name}","comments_url":"https://api.github.com/repos/databricks/spark-csv/issues/302/comments","events_url":"https://api.github.com/repos/databricks/spark-csv/issues/302/events","html_url":"https://github.com/databricks/spark-csv/issues/302","id":142392739,"number":302,"title":"java.lang.classnotfound","user":{"login":"krishnat3","id":17987508,"avatar_url":"https://avatars.githubusercontent.com/u/17987508?v=3","gravatar_id":"","url":"https://api.github.com/users/krishnat3","html_url":"https://github.com/krishnat3","followers_url":"https://api.github.com/users/krishnat3/followers","following_url":"https://api.github.com/users/krishnat3/following{/other_user}","gists_url":"https://api.github.com/users/krishnat3/gists{/gist_id}","starred_url":"https://api.github.com/users/krishnat3/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/krishnat3/subscriptions","organizations_url":"https://api.github.com/users/krishnat3/orgs","repos_url":"https://api.github.com/users/krishnat3/repos","events_url":"https://api.github.com/users/krishnat3/events{/privacy}","received_events_url":"https://api.github.com/users/krishnat3/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-03-21T15:57:14Z","updated_at":"2016-03-22T14:06:17Z","closed_at":null,"body":"Hey - I am trying to use databricks spark-csv as per your example in my java program. When i do a spark-submit --class \"SSQL\" /data/testapp.jar --master yarn --driver-class-path /data/spark-csv_2.10-1.4.0.jar --packages com.databricks:spark-csv_2.10:1.4.0\r\n\r\nI get the following error. Please help!!!\r\n\r\nException in thread \"main\" java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.csv. Please find packages at http://spark-packages.org\r\n        at org.apache.spark.sql.execution.datasources.ResolvedDataSource$.lookupDataSource(ResolvedDataSource.scala:77)\r\n        at org.apache.spark.sql.execution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:102)\r\n        at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:119)\r\n        at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:109)\r\n        at SSQL.main(SSQL.java:26)\r\n        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\r\n        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)\r\n        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)\r\n        at java.lang.reflect.Method.invoke(Unknown Source)\r\n        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)\r\n        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)\r\n        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)\r\n        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)\r\n        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)\r\nCaused by: java.lang.ClassNotFoundException: com.databricks.spark.csv.DefaultSource\r\n        at java.net.URLClassLoader.findClass(Unknown Source)\r\n        at java.lang.ClassLoader.loadClass(Unknown Source)\r\n        at java.lang.ClassLoader.loadClass(Unknown Source)\r\n        at org.apache.spark.sql.execution.datasources.ResolvedDataSource$$anonfun$4$$anonfun$apply$1.apply(ResolvedDataSource.scala:62)\r\n        at org.apache.spark.sql.execution.datasources.ResolvedDataSource$$anonfun$4$$anonfun$apply$1.apply(ResolvedDataSource.scala:62)\r\n        at scala.util.Try$.apply(Try.scala:161)\r\n        at org.apache.spark.sql.execution.datasources.ResolvedDataSource$$anonfun$4.apply(ResolvedDataSource.scala:62)\r\n        at org.apache.spark.sql.execution.datasources.ResolvedDataSource$$anonfun$4.apply(ResolvedDataSource.scala:62)\r\n        at scala.util.Try.orElse(Try.scala:82)\r\n        at org.apache.spark.sql.execution.datasources.ResolvedDataSource$.lookupDataSource(ResolvedDataSource.scala:62)\r\n        ... 13 more\r\n"},"comment":{"url":"https://api.github.com/repos/databricks/spark-csv/issues/comments/199830514","html_url":"https://github.com/databricks/spark-csv/issues/302#issuecomment-199830514","issue_url":"https://api.github.com/repos/databricks/spark-csv/issues/302","id":199830514,"user":{"login":"krishnat3","id":17987508,"avatar_url":"https://avatars.githubusercontent.com/u/17987508?v=3","gravatar_id":"","url":"https://api.github.com/users/krishnat3","html_url":"https://github.com/krishnat3","followers_url":"https://api.github.com/users/krishnat3/followers","following_url":"https://api.github.com/users/krishnat3/following{/other_user}","gists_url":"https://api.github.com/users/krishnat3/gists{/gist_id}","starred_url":"https://api.github.com/users/krishnat3/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/krishnat3/subscriptions","organizations_url":"https://api.github.com/users/krishnat3/orgs","repos_url":"https://api.github.com/users/krishnat3/repos","events_url":"https://api.github.com/users/krishnat3/events{/privacy}","received_events_url":"https://api.github.com/users/krishnat3/received_events","type":"User","site_admin":false},"created_at":"2016-03-22T14:06:17Z","updated_at":"2016-03-22T14:06:17Z","body":"I have tried that too, same error - Exception in thread \"main\" java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.csv. Please find packages at http://spark-packages.org\r\nat \r\n\r\nDo I need to do something to allow Spark-submit to be able to download packages? \r\n\r\n\r\nPS: When I do spark-shell with --package, and its downloading the required jar.\r\n"}}