{"action":"opened","issue":{"url":"https://api.github.com/repos/dmwm/CMSSpark/issues/17","repository_url":"https://api.github.com/repos/dmwm/CMSSpark","labels_url":"https://api.github.com/repos/dmwm/CMSSpark/issues/17/labels{/name}","comments_url":"https://api.github.com/repos/dmwm/CMSSpark/issues/17/comments","events_url":"https://api.github.com/repos/dmwm/CMSSpark/issues/17/events","html_url":"https://github.com/dmwm/CMSSpark/issues/17","id":370671148,"node_id":"MDU6SXNzdWUzNzA2NzExNDg=","number":17,"title":"Reading Avro files as Dataframes instead of RDD?","user":{"login":"sciaba","id":12764525,"node_id":"MDQ6VXNlcjEyNzY0NTI1","avatar_url":"https://avatars3.githubusercontent.com/u/12764525?v=4","gravatar_id":"","url":"https://api.github.com/users/sciaba","html_url":"https://github.com/sciaba","followers_url":"https://api.github.com/users/sciaba/followers","following_url":"https://api.github.com/users/sciaba/following{/other_user}","gists_url":"https://api.github.com/users/sciaba/gists{/gist_id}","starred_url":"https://api.github.com/users/sciaba/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sciaba/subscriptions","organizations_url":"https://api.github.com/users/sciaba/orgs","repos_url":"https://api.github.com/users/sciaba/repos","events_url":"https://api.github.com/users/sciaba/events{/privacy}","received_events_url":"https://api.github.com/users/sciaba/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-10-16T15:30:42Z","updated_at":"2018-10-16T15:30:42Z","closed_at":null,"author_association":"NONE","body":"Hi,\r\nwould it be a good idea to modernize the code by reading Avro files as dataframes instead of RDD?\r\nLook for example at https://github.com/databricks/spark-avro: it is enough to use\r\n\r\n--packages com.databricks:spark-avro_2.11:4.0.0\r\n\r\nto be able to use\r\n\r\ndf = spark.read.format(\"com.databricks.spark.avro\").load(file)\r\n\r\nSo one could completely bypass the creation of an RDD which is then converted to a dataframe (this is my understanding at least)."}}
{"actor":{"display_login":"sciaba"}}