{"action":"created","issue":{"url":"https://api.github.com/repos/HuaweiBigData/carbondata/issues/420","repository_url":"https://api.github.com/repos/HuaweiBigData/carbondata","labels_url":"https://api.github.com/repos/HuaweiBigData/carbondata/issues/420/labels{/name}","comments_url":"https://api.github.com/repos/HuaweiBigData/carbondata/issues/420/comments","events_url":"https://api.github.com/repos/HuaweiBigData/carbondata/issues/420/events","html_url":"https://github.com/HuaweiBigData/carbondata/pull/420","id":155213239,"number":420,"title":"[Issue 85][Issue 262][Issue 418] Pushup aggregation to spark layer and implement Record reader for CarbonInputFormat and support HadoopFSRelation","user":{"login":"ravipesala","id":8134086,"avatar_url":"https://avatars.githubusercontent.com/u/8134086?v=3","gravatar_id":"","url":"https://api.github.com/users/ravipesala","html_url":"https://github.com/ravipesala","followers_url":"https://api.github.com/users/ravipesala/followers","following_url":"https://api.github.com/users/ravipesala/following{/other_user}","gists_url":"https://api.github.com/users/ravipesala/gists{/gist_id}","starred_url":"https://api.github.com/users/ravipesala/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ravipesala/subscriptions","organizations_url":"https://api.github.com/users/ravipesala/orgs","repos_url":"https://api.github.com/users/ravipesala/repos","events_url":"https://api.github.com/users/ravipesala/events{/privacy}","received_events_url":"https://api.github.com/users/ravipesala/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2016-05-17T09:22:22Z","updated_at":"2016-05-30T08:17:26Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/HuaweiBigData/carbondata/pulls/420","html_url":"https://github.com/HuaweiBigData/carbondata/pull/420","diff_url":"https://github.com/HuaweiBigData/carbondata/pull/420.diff","patch_url":"https://github.com/HuaweiBigData/carbondata/pull/420.patch"},"body":"Pushup aggregation to spark layer \r\n1. Using \"spark.carbon.push.aggregation\" configuration to push the aggregation to carbon layer or not.\r\n2. Spark will do computation on dictionary data and will be converted to actual data as per need in the plan. At the finishing of query all data would be decoded.\r\n\r\nImplemented Record reader for CarbonInputFormat.\r\n1. Record reader is implemented with ReadSupport interface.\r\n2. User can provide the ReadSupport interface to control the output key. Even Raw data / dictionary decoded data also can be controlled from this interface.\r\n\r\nImplemented HadoopFSRelation and supported read data from store.\r\n`cc.read.format(\"org.apache.spark.sql.CarbonSource\") .load(\"storepath\")`\r\n"},"comment":{"url":"https://api.github.com/repos/HuaweiBigData/carbondata/issues/comments/222438377","html_url":"https://github.com/HuaweiBigData/carbondata/pull/420#issuecomment-222438377","issue_url":"https://api.github.com/repos/HuaweiBigData/carbondata/issues/420","id":222438377,"user":{"login":"jackylk","id":6500698,"avatar_url":"https://avatars.githubusercontent.com/u/6500698?v=3","gravatar_id":"","url":"https://api.github.com/users/jackylk","html_url":"https://github.com/jackylk","followers_url":"https://api.github.com/users/jackylk/followers","following_url":"https://api.github.com/users/jackylk/following{/other_user}","gists_url":"https://api.github.com/users/jackylk/gists{/gist_id}","starred_url":"https://api.github.com/users/jackylk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jackylk/subscriptions","organizations_url":"https://api.github.com/users/jackylk/orgs","repos_url":"https://api.github.com/users/jackylk/repos","events_url":"https://api.github.com/users/jackylk/events{/privacy}","received_events_url":"https://api.github.com/users/jackylk/received_events","type":"User","site_admin":false},"created_at":"2016-05-30T08:17:26Z","updated_at":"2016-05-30T08:17:26Z","body":"LGTM\r\n"}}
{"actor":{"display_login":"jackylk"}}