{"action":"created","issue":{"url":"https://api.github.com/repos/apache/carbondata/issues/2127","repository_url":"https://api.github.com/repos/apache/carbondata","labels_url":"https://api.github.com/repos/apache/carbondata/issues/2127/labels{/name}","comments_url":"https://api.github.com/repos/apache/carbondata/issues/2127/comments","events_url":"https://api.github.com/repos/apache/carbondata/issues/2127/events","html_url":"https://github.com/apache/carbondata/pull/2127","id":310318286,"number":2127,"title":"[CARBONDATA-2301][SDK] CarbonStore interface and two implementations (Spark and Local)","user":{"login":"jackylk","id":6500698,"avatar_url":"https://avatars3.githubusercontent.com/u/6500698?v=4","gravatar_id":"","url":"https://api.github.com/users/jackylk","html_url":"https://github.com/jackylk","followers_url":"https://api.github.com/users/jackylk/followers","following_url":"https://api.github.com/users/jackylk/following{/other_user}","gists_url":"https://api.github.com/users/jackylk/gists{/gist_id}","starred_url":"https://api.github.com/users/jackylk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jackylk/subscriptions","organizations_url":"https://api.github.com/users/jackylk/orgs","repos_url":"https://api.github.com/users/jackylk/repos","events_url":"https://api.github.com/users/jackylk/events{/privacy}","received_events_url":"https://api.github.com/users/jackylk/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":15,"created_at":"2018-04-01T11:58:14Z","updated_at":"2018-04-02T10:38:19Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/carbondata/pulls/2127","html_url":"https://github.com/apache/carbondata/pull/2127","diff_url":"https://github.com/apache/carbondata/pull/2127.diff","patch_url":"https://github.com/apache/carbondata/pull/2127.patch"},"body":"This PR is on top of #2099 \r\nUser should be able to query carbondata using CarbonStore interface.\r\n1. Get API: It can be used for filter query. It accepts projection column names and filter expression, and returns matched rows.\r\n2. SQL API: it accepts SQL statement and return query result set.\r\n\r\n```\r\npublic interface CarbonStore {\r\n\r\n  /**\r\n   * Scan query on data in the table path\r\n   * @param path table path\r\n   * @param projectColumns column names to read\r\n   * @param filter filter condition\r\n   * @return rows that satisfy filter condition\r\n   * @throws IOException if unable to read files in table path\r\n   */\r\n  CarbonRow[] scan(\r\n      String path,\r\n      String[] projectColumns,\r\n      Expression filter) throws IOException;\r\n\r\n  /**\r\n   * SQL query, table should be created before calling this function\r\n   * @param sqlString SQL statement\r\n   * @return rows\r\n   * @throws IOException if unable to read files in table path\r\n   */\r\n  CarbonRow[] sql(String sqlString) throws IOException;\r\n\r\n}\r\n```\r\n\r\nTwo implementations are provided in this PR:\r\n1. SparkCarbonStore: A CarbonStore implementation that uses Spark as underlying compute engine\r\n with CarbonData query optimization capability\r\n2. LocalCarbonStore: A CarbonStore implementation that works locally, without other compute framework dependency. It can be used to read data in local disk.\r\n\r\n - [ ] Any interfaces changed?\r\n \r\n - [ ] Any backward compatibility impacted?\r\n \r\n - [ ] Document update required?\r\n\r\n - [ ] Testing done\r\n        Please provide details on \r\n        - Whether new unit test cases have been added or why no new tests are required?\r\n        - How it is tested? Please attach test report.\r\n        - Is it a performance related change? Please attach the performance test report.\r\n        - Any additional information to help reviewers in testing this change.\r\n       \r\n - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. \r\n"},"comment":{"url":"https://api.github.com/repos/apache/carbondata/issues/comments/377904333","html_url":"https://github.com/apache/carbondata/pull/2127#issuecomment-377904333","issue_url":"https://api.github.com/repos/apache/carbondata/issues/2127","id":377904333,"user":{"login":"CarbonDataQA","id":24402133,"avatar_url":"https://avatars0.githubusercontent.com/u/24402133?v=4","gravatar_id":"","url":"https://api.github.com/users/CarbonDataQA","html_url":"https://github.com/CarbonDataQA","followers_url":"https://api.github.com/users/CarbonDataQA/followers","following_url":"https://api.github.com/users/CarbonDataQA/following{/other_user}","gists_url":"https://api.github.com/users/CarbonDataQA/gists{/gist_id}","starred_url":"https://api.github.com/users/CarbonDataQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/CarbonDataQA/subscriptions","organizations_url":"https://api.github.com/users/CarbonDataQA/orgs","repos_url":"https://api.github.com/users/CarbonDataQA/repos","events_url":"https://api.github.com/users/CarbonDataQA/events{/privacy}","received_events_url":"https://api.github.com/users/CarbonDataQA/received_events","type":"User","site_admin":false},"created_at":"2018-04-02T10:38:19Z","updated_at":"2018-04-02T10:38:19Z","author_association":"NONE","body":"Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3520/\n"}}
{"actor":{"display_login":"CarbonDataQA"}}