{"push_id":2386090270,"size":232,"distinct_size":7,"ref":"refs/heads/concurrentTestOptimize","head":"d00d41c13d1b21c3e0dab06253750fc3c5804fcc","before":"ce9c69b2fa4e271803e24c0eef8f6af8b7c56cd3","commits":[{"sha":"910d496cf2a668dc10b40c202889003fe5cfb556","author":{"name":"xuchuanyin","email":"07615d366e16861317e575c1a01f6c5b6368acc6@hust.edu.cn"},"message":"[CARBONDATA-1903] Remove unused FileUtil and Optimize code\n\nThis closes #1678","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/910d496cf2a668dc10b40c202889003fe5cfb556"},{"sha":"0b0473c5f15fd7ff92fe7a2b42399817e534f349","author":{"name":"dhatchayani","email":"1095e96b4d1b5c17764849a888d71c77a7c0cfe1@gmail.com"},"message":"[CARBONDATA-1975] Wrong input metrics displayed for carbon\n\nModified code to correct the number of records as input metrics in the spark UI\n\nThis closes #1754","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/0b0473c5f15fd7ff92fe7a2b42399817e534f349"},{"sha":"a83d0291d1cee5f459946388c17551585d9c049f","author":{"name":"Zhang Zhichao","email":"f62c0077ff24b8ed62f956e1d7ea2877e4639bff@qq.com"},"message":"[CARBONDATA-1970](Carbon1.3.0 - Spark 2.2) Use Spark 2.2.1 as default version for Profile Spark-2.2\n\nSpark 2.2.1 had released for a while, and there were more than 200+ issues fixed, so it's better to upgrade spark 2.2.0 to 2.2.1 for profile spark-2.2\n\nThis closes #1753","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/a83d0291d1cee5f459946388c17551585d9c049f"},{"sha":"45787fb99bd9327f180b40b288794edcaed5296c","author":{"name":"ravipesala","email":"211f939df56dff0e750847847dde28ca643346c1@gmail.com"},"message":"[CARBONDATA-1944][PARTITION]Special character like comma (,) cannot be loaded on partition columns\n\nThere is an issue while setting the partition information to the CarbonTableInputFormat , it is fixed in this PR.\nAnd also removed the old CarbonInputFormat class and its references.\n\nThis closes #1733","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/45787fb99bd9327f180b40b288794edcaed5296c"},{"sha":"d7852abeaa8915055bbad92e250662320b090bbc","author":{"name":"ravipesala","email":"211f939df56dff0e750847847dde28ca643346c1@gmail.com"},"message":"[CARBONDATA-1967][PARTITION] Fix autocompaction and auto merge index in partition tables\n\nAuto compaction is not working in case of the partition table and merge index files are merging always even though it is configured as false.\n\nSolution:\nAuto compaction code is added after finishing of partition loading. And also merge index configuration is checked before going for index merging.\n\nThis closes #1748","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/d7852abeaa8915055bbad92e250662320b090bbc"},{"sha":"deabeffd91584d531f577492ea49d870e44999a1","author":{"name":"Jacky Li","email":"772aaae7e64642e85db284971c5833fac0a4e42e@huawei.com"},"message":"[HOTFIX] Remove unnecessary object creation in writer\n\nThis closes #1756","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/deabeffd91584d531f577492ea49d870e44999a1"},{"sha":"e2f19979b6be2a38de936da316ed91d9b9f6bfee","author":{"name":"anubhav100","email":"0673fec795c9e0a4f68a50c783a54a4975d06816@knoldus.in"},"message":"[CARBONDATA-1774] [PrestoIntegration] Not able to fetch data from a table with Boolean data type in presto\n\nNot able to fetch data from a Carbon table with Boolean data type in presto\n\nThis closes #1709","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/e2f19979b6be2a38de936da316ed91d9b9f6bfee"},{"sha":"aee5213b8a6f137e14d1b902c523f836224a1953","author":{"name":"rahulforallp","email":"a0d0e2ccc4e0432d696f899e27f18ac43c731996@knoldus.in"},"message":"[CARBONDATA-1979] ][IMPLICIT COLUMN] Modified implicit column filtering logic to directly validate the blocklet ID\n\nAs BlockletDataMap directly identified the blocklets after pruning, implict column filter should validate directly for blocklet id instead of block Id\n\nThis closes #1760","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/aee5213b8a6f137e14d1b902c523f836224a1953"},{"sha":"852b1a412026d6e206b4ac774f3ea04b1c7d3531","author":{"name":"Geetika Gupta","email":"4ca59f4559304f89c2c4f530513908d064c240cc@knoldus.in"},"message":"[CARBONDATA-1949, CARBONDATA-1950] Fixed bug related to describe formatted command as sort_scope was displayed twice\n\nModified code to fix the issue for SORT_SCOPE getting displayed twice in describe formatted command\n\nThis closes #1740","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/852b1a412026d6e206b4ac774f3ea04b1c7d3531"},{"sha":"0c65aba0d4a27b3a31231e28c51577edc6e7e3f8","author":{"name":"Geetika Gupta","email":"4ca59f4559304f89c2c4f530513908d064c240cc@knoldus.in"},"message":"[CARBONDATA-1949, CARBONDATA-1950] Fixed bug related to describe formatted command as sort_scope was displayed twice\n\nModified code to fix the issue for SORT_SCOPE getting displayed twice in describe formatted command\n\nThis closes #1740","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/0c65aba0d4a27b3a31231e28c51577edc6e7e3f8"},{"sha":"69de3874a5ebb6031bea5e5c3f61ce2d6aba69d5","author":{"name":"SangeetaGulia","email":"96ef6aba875a613851b006ac21893260eb9a1257@knoldus.in"},"message":"[CARBONDATA-1719][Pre-Aggregate][Bug] Fixed bug to handle data inconsistency on concurrent data load and pre-aggregate table creation\n\nProblem: On concurrent data load and pre-aggregate table creation, datamap was not getting populated with the load data even after data load completes.\n\nThis closes #1697","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/69de3874a5ebb6031bea5e5c3f61ce2d6aba69d5"},{"sha":"38038add7065a05957f84d884298c901253f3d4d","author":{"name":"mohammadshahidkhan","email":"28874019c3747eabecd6f0acb548bead70358833@gmail.com"},"message":"[CARBONDATA-1955] Delta DataType calculation is incorrect for long type\n\nProblem:\nIn case of Long type, the delta data type is always choosing the Long type.\nBut it should choose the datatype based on diff (max-min) of max and min values.\nSolution:\nCorrected to choose the delta data type based on max and min values.\n\nThis closes #1744","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/38038add7065a05957f84d884298c901253f3d4d"},{"sha":"1f54c47282bc201f2071bc8c9cc1be19baf0c9a1","author":{"name":"manishgupta88","email":"338f0afd13613fb4e042e9c6a322a16c6ea5a17c@gmail.com"},"message":"[CARBONDATA-1946] Exception thrown after alter data type change operation on dictionary exclude integer type column\n\nProblem: After restructure change data type operation (INT to BIGINT) on dictionary exclude INT type column if select query is triggered then exception is thrown.\n\nAnalysis: This is happening because while retrieving the data the vector is created for BIGINT type (size 8 bytes) which but the actual length of each data is 4 bytes and there is length check while reading the data which is failing.\n\nSolution: Added a new restructuredType variable in vector and assigned the block dimension data type to it.\n\nThis closes #1732","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/1f54c47282bc201f2071bc8c9cc1be19baf0c9a1"},{"sha":"e40b34b08210981cbe3bffe73cacff2577fbd8cb","author":{"name":"mohammadshahidkhan","email":"28874019c3747eabecd6f0acb548bead70358833@gmail.com"},"message":"[CARBONDATA-1249] Wrong order of columns in redirected csv for bad records\n\nProblem:\nWrong order of columns in redirected csv for bad records\nThe RowParser rearrage the csv raw data based on the inputMapping & outputMapping.\nSo the converter step does not have actual raw csv record to log or redirect the bad record details.\n\nSteps to repprodcue:\n\nCreate employee(Name string, age int, project string) stored by 'carbondata'\n\nLOAD DATA LOCAL INPATH '' INTO table employee options('BAD_RECORDS_ACTION'='REDIRECT')\nData:\n\nName,age,Project\nSam,27,Carbon\nRuhi,23x,Hadoop\n\nThe second record is bad record so it will be writtern to the csv file at the bad record loation.\n\nExpected:\n\nRuhi,23x,Hadoop\n\nThis closes #1116","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/e40b34b08210981cbe3bffe73cacff2577fbd8cb"},{"sha":"6f10c4127914c94fdd6f7af16512e0758f2bb146","author":{"name":"ravipesala","email":"211f939df56dff0e750847847dde28ca643346c1@gmail.com"},"message":"[CARBONDATA-1936][PARTITION] Corrected bad record and avoid double conversion of data in Partitioning table\n\nCurrently, one time data conversion happens while loading data while creating RDD to make sure the partitions are added with the right format. But this approach creates an issue in case of bad record handling as the writing of bad records not possible from RDD.\nIn this PR we don't convert the data in RDD but convert the data while adding the partition information to hive.\n\nThis closes #1729","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/6f10c4127914c94fdd6f7af16512e0758f2bb146"},{"sha":"7a4bd2298557ff76ee29d6c8efa37c604b548a07","author":{"name":"Manohar","email":"3a3f252cd4574ce8e81661333bcd035aa7d61c0f@gmail.com"},"message":"[CARBONDATA-1912] Handling lock issues for alter rename operation\n\nModified code to release all old table acquired locks in case of any exception. So release all old table locks only in case of any exception instead of unlocking in finally block\n\nThis closes #1734","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/7a4bd2298557ff76ee29d6c8efa37c604b548a07"},{"sha":"bcf3ca3feda544dcbc1b5c096b98369c8a27f4e3","author":{"name":"mohammadshahidkhan","email":"28874019c3747eabecd6f0acb548bead70358833@gmail.com"},"message":"[CARBONDATA-1929][Validation]carbon property configuration validation + Fixed test case\n\nAdded validation for below parameter:\ncarbon.timestamp.format\ncarbon.date.format\ncarbon.sort.file.write.buffer.size (minValue = 10 KB, maxValue=10MB, defaultValue =16 KB )\ncarbon.sort.intermediate.files.limit (minValue = 2, maxValue=50, defaultValue =20 )\n\nThis closes #1718","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/bcf3ca3feda544dcbc1b5c096b98369c8a27f4e3"},{"sha":"837fdd2cb91780c9193efb5b37cd107c9fa36591","author":{"name":"mohammadshahidkhan","email":"28874019c3747eabecd6f0acb548bead70358833@gmail.com"},"message":"[CARBONDATA-1218] In case of data-load failure the BadRecordsLogger.badRecordEntry map holding the task Status is not removing the task Entry\n\nProblem\nFor GLOBAL_SORT scope option in case of data-load failure the BadRecordsLogger.badRecordEntry map holding the task Status is not removing the task Entry.\nBecause of this the next load is getting failed even though the data being loaded has no bad records.\n\nSolution\nThe map entry must be removed after load completion either success or fail.\nRefactored the Bad record logger.\n\nThis closes #1082","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/837fdd2cb91780c9193efb5b37cd107c9fa36591"},{"sha":"c9e58429af5f78e4001d90d6e3c90a0d48ed2bcf","author":{"name":"Jacky Li","email":"772aaae7e64642e85db284971c5833fac0a4e42e@qq.com"},"message":"[CARBONDATA-1983] Remove unnecessary WriterVo object\n\nThis closes #1761","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/c9e58429af5f78e4001d90d6e3c90a0d48ed2bcf"},{"sha":"08b8af7b044fa761caf58da2875935d40d4ca13b","author":{"name":"sounakr","email":"e87ebe86cb40b37dc223da64c3079ce93875e852@gmail.com"},"message":"[CARBONDATA-1984][Compression Codec] Double Compression Codec Rectification.\n\nThis closes #1763","distinct":false,"url":"https://api.github.com/repos/xubo245/carbondata/commits/08b8af7b044fa761caf58da2875935d40d4ca13b"}]}
{"actor":{"display_login":"xubo245"}}