{"push_id":1375943455,"size":3,"distinct_size":3,"ref":"refs/heads/master","head":"29faca5680e34d9211eb8d551385b671198f626b","before":"6d1a130d85562aad694ef78522e471b7cf025c30","commits":[{"sha":"12e34b4c10e0685a24ad96ddbc82cd7a395474be","author":{"name":"Lars Volker","email":"fbc719167085de35c816d73bcd0c022b53b37429@cloudera.com"},"message":"IMPALA-4223: Handle truncated file read from HDFS cache\n\nWhile overwriting files on HDFS via Hive it can happen that Impala sees\na partially written, cached file. In these cases we did not correctly\nhandle the partial cached read.\n\nThis change adds a check and triggers a fall back to disk reads for such\nerrors. If the file is partially written to disk, too, then the query\nwill report a file corruption warning through the disk read path.\n\nChange-Id: Id1e1fdb0211819c5938956abb13b512350a46f1a\nReviewed-on: http://gerrit.cloudera.org:8080/4828\nReviewed-by: Dan Hecht <dhecht@cloudera.com>\nReviewed-by: Tim Armstrong <tarmstrong@cloudera.com>\nTested-by: Marcel Kornacker <marcel@cloudera.com>","distinct":true,"url":"https://api.github.com/repos/apache/incubator-impala/commits/12e34b4c10e0685a24ad96ddbc82cd7a395474be"},{"sha":"9f3f4b713d78e8dcf02c02def447195a04f408e6","author":{"name":"Alex Behm","email":"1d65425ff20ce21b68f426794449955d15dd30a4@cloudera.com"},"message":"IMPALA-3346: DeepCopy() Kudu rows into Impala tuples.\n\nImplements additional changes to make the memory layout\nof Kudu rows identical to Impala tuples.\nIn particular, Kudu rows allocate a null bit even for\nnon-nullable columns, and Impala now does the same\nfor Kudu scan tuples.\n\nThis change exploits the now-identical Kudu and Impala\ntuple layouts to avoid the expensive translation.\n\nPerf: Mostafa reported a 50% efficiency gain on full\ntable scans.\n\nTesting: A private core/hdfs run passed.\n\nTODO:\n1) Test cases with nullable/nonnullable non-PK slots.\n2) Specify mem layout to client (depends on KUDU-1694)\n3) Avoid mem copies (depends on KUDU-1695)\n\nChange-Id: Ic911e4eff9fe98bf28d8a1bab5c9d7e9ab66d9cb\nReviewed-on: http://gerrit.cloudera.org:8080/4862\nReviewed-by: Dan Hecht <dhecht@cloudera.com>\nTested-by: Marcel Kornacker <marcel@cloudera.com>","distinct":true,"url":"https://api.github.com/repos/apache/incubator-impala/commits/9f3f4b713d78e8dcf02c02def447195a04f408e6"},{"sha":"29faca5680e34d9211eb8d551385b671198f626b","author":{"name":"Sailesh Mukil","email":"878eaa34c439eddee78b063b5443e5722b0c42a6@cloudera.com"},"message":"IMPALA-3823: Add timer to measure Parquet footer reads\n\nIt's been observed that Parquet footer reads perform poorly especially\nwhen reading from S3. This patch adds a timer \"FooterProcessingTimer\"\nwhich keeps a track of the average time each split of each scan node\nspends in reading and processing the parquet footer.\n\nAdded a new utility counter called SummaryStatsCounter which keeps\ntrack of the min, max and average values seen so far from a set of\nvalues. This counter is used to calculate the min, max and average\ntime taken to scan and process Parquet footers per query per node.\n\nThe RuntimeProfile has also been updated to keep a track of, display\nand serialize this new counter to thrift.\n\nBE tests have been added to verify that this counter works fine.\n\nChange-Id: Icf87bad90037dd0cea63b10c537382ec0f980cbf\nReviewed-on: http://gerrit.cloudera.org:8080/4371\nReviewed-by: Sailesh Mukil <sailesh@cloudera.com>\nTested-by: Marcel Kornacker <marcel@cloudera.com>","distinct":true,"url":"https://api.github.com/repos/apache/incubator-impala/commits/29faca5680e34d9211eb8d551385b671198f626b"}]}
{"actor":{"display_login":"asfgit"}}