{"action":"created","issue":{"url":"https://api.github.com/repos/uber/hudi/issues/401","repository_url":"https://api.github.com/repos/uber/hudi","labels_url":"https://api.github.com/repos/uber/hudi/issues/401/labels{/name}","comments_url":"https://api.github.com/repos/uber/hudi/issues/401/comments","events_url":"https://api.github.com/repos/uber/hudi/issues/401/events","html_url":"https://github.com/uber/hudi/issues/401","id":328608326,"node_id":"MDU6SXNzdWUzMjg2MDgzMjY=","number":401,"title":"HoodieDeltaStreamer doesn't support parquet files as source","user":{"login":"cb149","id":35238779,"node_id":"MDQ6VXNlcjM1MjM4Nzc5","avatar_url":"https://avatars0.githubusercontent.com/u/35238779?v=4","gravatar_id":"","url":"https://api.github.com/users/cb149","html_url":"https://github.com/cb149","followers_url":"https://api.github.com/users/cb149/followers","following_url":"https://api.github.com/users/cb149/following{/other_user}","gists_url":"https://api.github.com/users/cb149/gists{/gist_id}","starred_url":"https://api.github.com/users/cb149/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cb149/subscriptions","organizations_url":"https://api.github.com/users/cb149/orgs","repos_url":"https://api.github.com/users/cb149/repos","events_url":"https://api.github.com/users/cb149/events{/privacy}","received_events_url":"https://api.github.com/users/cb149/received_events","type":"User","site_admin":false},"labels":[{"id":500769014,"node_id":"MDU6TGFiZWw1MDA3NjkwMTQ=","url":"https://api.github.com/repos/uber/hudi/labels/enhancement","name":"enhancement","color":"84b6eb","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-06-01T17:55:50Z","updated_at":"2018-06-04T17:35:22Z","closed_at":null,"author_association":"NONE","body":"I noticed that the option --source-format for the deltastreamer has the possible values: [AVRO, JSON, ROW, CUSTOM]. So my questions/problems are:\r\n\r\n- Is there parquet support planned in the future or is there already an implementation/some workaround that I can use? \r\n\r\n- The comment for SourceDataFormat.ROW states that it will be added later, but the one for CUSTOM does not, even though I cannot see an implementation for that.\r\n\r\n- Trying to change the source-format by adding the option --source-format AVRO always throws an Exception for me:\r\n\r\n`Exception in thread \"main\" java.lang.NullPointerException\r\nat com.beust.jcommander.JCommander.convertValue(JCommander.java:1305)\r\nat com.beust.jcommander.JCommander.convertValue(JCommander.java:1228)\r\n...\r\nat com.uber.hoodie.utilities.deltastreamer.HoodieDeltaStreamer.main(HoodieDeltaStreamer.java:415)\r\n`"},"comment":{"url":"https://api.github.com/repos/uber/hudi/issues/comments/394436593","html_url":"https://github.com/uber/hudi/issues/401#issuecomment-394436593","issue_url":"https://api.github.com/repos/uber/hudi/issues/401","id":394436593,"node_id":"MDEyOklzc3VlQ29tbWVudDM5NDQzNjU5Mw==","user":{"login":"cb149","id":35238779,"node_id":"MDQ6VXNlcjM1MjM4Nzc5","avatar_url":"https://avatars0.githubusercontent.com/u/35238779?v=4","gravatar_id":"","url":"https://api.github.com/users/cb149","html_url":"https://github.com/cb149","followers_url":"https://api.github.com/users/cb149/followers","following_url":"https://api.github.com/users/cb149/following{/other_user}","gists_url":"https://api.github.com/users/cb149/gists{/gist_id}","starred_url":"https://api.github.com/users/cb149/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cb149/subscriptions","organizations_url":"https://api.github.com/users/cb149/orgs","repos_url":"https://api.github.com/users/cb149/repos","events_url":"https://api.github.com/users/cb149/events{/privacy}","received_events_url":"https://api.github.com/users/cb149/received_events","type":"User","site_admin":false},"created_at":"2018-06-04T17:35:22Z","updated_at":"2018-06-04T17:35:22Z","author_association":"NONE","body":"Thanks for the reply. I can also use avro as a source-format, I just wanted to check whether there is parquet support, so I don't do any unnecessary work. "}}
{"actor":{"display_login":"cb149"}}