{"push_id":2702708865,"size":48,"distinct_size":48,"ref":"refs/heads/primitive_adaptive","head":"c0b8cbff58c8e7be33cf02347a4491d7b93f0b5c","before":"1ac8879116e7e1d25eabf07b6b336eeefaf39795","commits":[{"sha":"133ec17e527c22d8de1353f723fb6d77cd404eeb","author":{"name":"Indhumathi27","email":"64e95f1c0d1c3e5c2c9f9570b887e7e0a1ee8ec3@gmail.com"},"message":"[CARBONDATA-2606][Complex DataType Enhancements]Fix for ComplexDataType Projection PushDown\n\nProblem1: Fix for ComplexDataType Projection PushDown when Table Schema contains\nColumnName in UpperCase\n\nSolution: Change ColumnName to Lowercase\n\nProblem2: If Struct contains Array, pushdown only parent column\n\nSolution: Check for ArrayType or GetArrayItem in the Complex Column,\nif any ArrayType is found, then pushdown parent column\n\nThis closes #2421","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/133ec17e527c22d8de1353f723fb6d77cd404eeb"},{"sha":"cd7c2102c6e4517fd4fd6907a93aac9ff1ece47e","author":{"name":"xuchuanyin","email":"ea7e5e16c33472e7ca342c18fae68881a3d50cda@hust.edu.cn"},"message":"[CARBONDATA-2633][BloomDataMap] Fix bugs in bloomfilter for dictionary/sort/date/TimeStamp column\n\nfor dictionary column, carbon convert literal value to dict value, then\nconvert dict value to mdk value, at last it stores the mdk value as\ninternal value in carbonfile.\n\nfor other columns, carbon convert literal value to internal value using\nfield-converter.\n\nSince bloomfilter datamap stores the internal value, during query we\nshould convert the literal value in filter to internal value in order to\nmatch the value stored in bloomfilter datamap.\n\nChanges are made:\n\n1.FieldConverters were refactored to extract common value convert methods.\n2.BloomQueryModel was optimized to support converting literal value to\ninternal value.\n3.fix bugs for int/float/date/timestamp as bloom index column\n4.fix bugs in dictionary/sort column as bloom index column\n5.add tests\n6.block (deferred) rebuild for bloom datamap (contains bugs that does\nnot fix in this commit)\n\nThis closes #2403","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/cd7c2102c6e4517fd4fd6907a93aac9ff1ece47e"},{"sha":"5195d7f506eb5b74272d100afb08d55daf129be6","author":{"name":"akashrn5","email":"e895d8ea0ba28b59e83fc930aa49fb689668ab5c@gmail.com"},"message":"[HOTFIX][32K]maintain proper mapping for varChar Columns and noDictionary Columns\nfor all the dimensions while creating sort data rows instance\n\nProblem: when creating the column mapping for varChar columns and no dictionary\n columns for existing dimensions, the mapping is incorrect.\n\nSolution: remove unwanted variable counter and map correct index to varChar columns\n and noDictionary columns based on the number of dimensions\n\nThis closes #2395","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/5195d7f506eb5b74272d100afb08d55daf129be6"},{"sha":"aeb2ec4cde000531806cbec4f726f039c935a495","author":{"name":"xuchuanyin","email":"ea7e5e16c33472e7ca342c18fae68881a3d50cda@hust.edu.cn"},"message":"[CARBONDATA-2650][Datamap] Fix bugs in negative number of skipped blocklets\n\nCurrently in carbondata, default blocklet datamap will be used to prune\nblocklets. Then other indexdatamap will be used.\nBut the other index datamap works for segment scope, which in some\nscenarios, the size of pruned result will be bigger than that of default\ndatamap, thus causing negative number of skipped blocklets in explain\nquery output.\n\nHere we add intersection after pruning. If the pruned result size is\nzero, we will finish the pruning.\n\nThis closes #2410","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/aeb2ec4cde000531806cbec4f726f039c935a495"},{"sha":"c0de9f16010e0cb83db1dbd89e94e8bd3681dda7","author":{"name":"xuchuanyin","email":"ea7e5e16c33472e7ca342c18fae68881a3d50cda@hust.edu.cn"},"message":"[CARBONDATA-2654][Datamap] Optimize output for explaining querying with datamap\n\nCurrently if we have multiple datamaps and the query hits all the\ndatamaps, carbondata explain command will only show the first datamap\nand all the datamaps are not shown. In this commit, we show all the\ndatamaps that are hitted in this query.\n\nThis closes #2411","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/c0de9f16010e0cb83db1dbd89e94e8bd3681dda7"},{"sha":"020335a8ce03073f3c1f749f031ab29478c5e454","author":{"name":"xuchuanyin","email":"ea7e5e16c33472e7ca342c18fae68881a3d50cda@hust.edu.cn"},"message":"[CARBONDATA-2687][BloomDataMap][Doc] Update document for bloomfilter datamap\n\nIn previous PR, cache behaviour for bloomfilter datamap has been changed: changed from guava-cache to carbon-cache. This PR update the document for bloomfilter datamap and remove the description for cache.\n\nThis closes #2446","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/020335a8ce03073f3c1f749f031ab29478c5e454"},{"sha":"cbecadfad2408c18322e87aa5ac054d6d190d34c","author":{"name":"Indhumathi27","email":"64e95f1c0d1c3e5c2c9f9570b887e7e0a1ee8ec3@gmail.com"},"message":"Code Generator Error is thrown when Select filter contains more than one count of distinct of ComplexColumn with group by Clause","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/cbecadfad2408c18322e87aa5ac054d6d190d34c"},{"sha":"19a99e15e5c9489ded3013cbc6bb02cab38d0720","author":{"name":"ravipesala","email":"91945906bea52811e7073548837ad854f8cc2b37@gmail.com"},"message":"[CARBONDATA-2684] [PR-2442] Distinct count fails on complex columns\n\nThis PR fixes Code Generator Error thrown when Select filter contains more than one count of distinct of ComplexColumn with group by Clause\n\nThis closes #2449","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/19a99e15e5c9489ded3013cbc6bb02cab38d0720"},{"sha":"61187115c7587c97c7849826596704f6c55d6482","author":{"name":"manishgupta88","email":"4820017a5fb7db80256b43a7ddce74c044934b5e@gmail.com"},"message":"[CARBONDATA-2645] Segregate block and blocklet cache\n\nThings done as part of this PR\n\nSegregate block and blocklet cache. In this driver will cache the metadata based on CACHE_LEVEL.\nIf CACHE_LEVEL is set to BLOCK then only carbondata files metadata will be cached in driver.\nIf CACHE_LEVEL is set to BLOCKLET thenmetadata for number of carbondata files * number of blocklets in each carbondata file will be cached in driver.\n\nThis closes #2437","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/61187115c7587c97c7849826596704f6c55d6482"},{"sha":"5159abfc312942b4796667e9d509eb5152cc0566","author":{"name":"Manhua","email":"9342ca58f48b7865f769c68504b4d3060a00abf5@qq.com"},"message":"[CARBONDATA-2675][32K] Support config long_string_columns when create datamap\n\nCreate datamap use select statement, but long string column is defined with StringType in the result dataframe if this column is selected. This PR allows to set long_string_columns property in dmproperties.\n\nThis closes #2432","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/5159abfc312942b4796667e9d509eb5152cc0566"},{"sha":"3e88858a2145102b78f44d7a744ec4a34823f29e","author":{"name":"Manhua","email":"9342ca58f48b7865f769c68504b4d3060a00abf5@qq.com"},"message":"[CARBONDATA-2683][32K] fix data convertion problem for Varchar\n\nSpark uses org.apache.spark.unsafe.types.UTF8String for string datatype internally.\nIn carbon, varchar datatype should do the same convertion as string datatype. Or it may throw exception\n\nThis closes #2438","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/3e88858a2145102b78f44d7a744ec4a34823f29e"},{"sha":"a7c4b4878fd6b8e960d688329ecc4c2a846bfaa4","author":{"name":"xuchuanyin","email":"ea7e5e16c33472e7ca342c18fae68881a3d50cda@hust.edu.cn"},"message":"[CARBONDATA-2657][BloomDataMap] Fix bugs in loading and querying on bloom column with empty values\n\nFix bugs in loading and querying on bloom column …\nFix bugs in loading and querying with empty values on bloom index\ncolumns. Convert null values to corresponding values.\n\nThis closes #2413","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/a7c4b4878fd6b8e960d688329ecc4c2a846bfaa4"},{"sha":"806e9b5a83ba03098a0c4bf42f335016adca5c68","author":{"name":"brijoobopanna","email":"3d8e946f591145825ac8468ec927daca5ef22283@huawei.com"},"message":"[CARBONDATA-2585][CARBONDATA-2586][Local Dictionary]Added test cases for\n local dictionary support for alter table, set, unset and preaggregate\n\nAdded test cases for local dictionary support for alter table, set, unset and pre-aggregate\nAll the validations related to above features are taken care in this PR\n\nThis closes #2422","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/806e9b5a83ba03098a0c4bf42f335016adca5c68"},{"sha":"c82e3e85f95f8c5af8a6ff92c980235435f79954","author":{"name":"Indhumathi27","email":"64e95f1c0d1c3e5c2c9f9570b887e7e0a1ee8ec3@gmail.com"},"message":"[CARBONDATA-2606][Complex DataType Enhancements] Fixed Projection Pushdown when\nSelect filter contains Struct column.\n\nProblem:\nIf Select filter contains Struct Column which is not in Projection list,\nthen only null value is stored for struct column given in filter and select query result is null.\nSolution:\nPushdown Parent column of corresponding struct type if any struct column is present in Filter list.\n\nThis closes #2439","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/c82e3e85f95f8c5af8a6ff92c980235435f79954"},{"sha":"cb10d03a79ae0aed7367250f5f7c2a0d50ea4dc7","author":{"name":"kunal642","email":"bac7ac9c9ca7e148bdbb2223b3935baa7fdb4b72@gmail.com"},"message":"[CARBONDATA-2642] Added configurable Lock path property\n\nA new property is being exposed which will allow the user to configure the lock path \"carbon.lock.path\"\nRefactored code to create a separate implementation for S3CarbonFile.\n\nThis closes #2642","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/cb10d03a79ae0aed7367250f5f7c2a0d50ea4dc7"},{"sha":"21b56dfd84cb7ad207b8f0122adbed2ffdbb3e72","author":{"name":"eychih","email":"c6281dd13dad67f64c188a0ab89aa2eb1b1f9a65@hotmail.com"},"message":"[CARBONDATA-2686] Implement Left join on MV datamap\n\nThis closes #2444","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/21b56dfd84cb7ad207b8f0122adbed2ffdbb3e72"},{"sha":"7924d5e379d056dc8eede6e926dc2d39a16fefcf","author":{"name":"xuchuanyin","email":"ea7e5e16c33472e7ca342c18fae68881a3d50cda@hust.edu.cn"},"message":"[CARBONDATA-2660][BloomDataMap] Add test for querying on longstring bloom index column\n\nFiltering on longstring bloom index column is already supported in PR #2403, here we only add test for it.\n\nThis closes #2416","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/7924d5e379d056dc8eede6e926dc2d39a16fefcf"},{"sha":"ef049510dc3dcd7c0bdac9e85c281493a98be153","author":{"name":"ajantha-bhat","email":"283c3d84fb3be3fbb2c689671922b0c4ff69adf9@gmail.com"},"message":"backup","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/ef049510dc3dcd7c0bdac9e85c281493a98be153"},{"sha":"7d83a738009b6fe600911d99f9c09340beffe73b","author":{"name":"ajantha-bhat","email":"283c3d84fb3be3fbb2c689671922b0c4ff69adf9@gmail.com"},"message":"some more","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/7d83a738009b6fe600911d99f9c09340beffe73b"},{"sha":"b2f6bf6ce7dccb8f8c2d83fb7a2208f69e74c4eb","author":{"name":"sounakr","email":"a6186e5f8e547a5c2a71cbe5f372f6a05fb4a96a@gmail.com"},"message":"Read","distinct":true,"url":"https://api.github.com/repos/sounakr/incubator-carbondata/commits/b2f6bf6ce7dccb8f8c2d83fb7a2208f69e74c4eb"}]}
{"actor":{"display_login":"sounakr"}}