{"push_id":1366295802,"size":12,"distinct_size":12,"ref":"refs/heads/dev","head":"7b5948cca7301305121bbce94cf88b45bae5bdfd","before":"37d130031d63a21d99344fad22bbc417e255537e","commits":[{"sha":"ccfcc643da9e9f1dbf957731d2d4fc1f3150a98f","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Check if dict is empty before reading first byte","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/ccfcc643da9e9f1dbf957731d2d4fc1f3150a98f"},{"sha":"4db751668fbf72cd23205fb1ecd582149a0db210","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Fix buffer overrun in ZSTD_loadEntropy()\n\nThe table log set by `FSE_readNCount()` was not checked in\n`ZSTD_loadEntropy()`.  This caused `FSE_buildDTable(dctx->MLTable, ...)`\nto overwrite the beginning of `dctx->hufTable`.\n\nThe benchmarks look good, there is no obvious performance regression:\n\n  > ./zstds/zstd.opt.0 -i10 -b1 -e5 ~/bench/silesia.tar\n   1#silesia.tar       : 211988480 ->  73656930 (2.878), 268.2 MB/s , 701.0 MB/s\n   2#silesia.tar       : 211988480 ->  70162842 (3.021), 199.5 MB/s , 666.9 MB/s\n   3#silesia.tar       : 211988480 ->  66997986 (3.164), 154.9 MB/s , 655.6 MB/s\n   4#silesia.tar       : 211988480 ->  66002591 (3.212), 128.9 MB/s , 648.4 MB/s\n   5#silesia.tar       : 211988480 ->  65008480 (3.261),  98.4 MB/s , 633.4 MB/s\n\n  > ./zstds/zstd.opt.2 -i10 -b1 -e5 ~/bench/silesia.tar\n   1#silesia.tar       : 211988480 ->  73656930 (2.878), 266.1 MB/s , 703.7 MB/s\n   2#silesia.tar       : 211988480 ->  70162842 (3.021), 199.0 MB/s , 666.6 MB/s\n   3#silesia.tar       : 211988480 ->  66997986 (3.164), 156.2 MB/s , 656.2 MB/s\n   4#silesia.tar       : 211988480 ->  66002591 (3.212), 133.2 MB/s , 647.4 MB/s\n   5#silesia.tar       : 211988480 ->  65008480 (3.261),  96.3 MB/s , 633.3 MB/s","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/4db751668fbf72cd23205fb1ecd582149a0db210"},{"sha":"bfd943ace5ff23d12501a744d719cb0e306513b4","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Fix buffer overrun in ZSTD_loadDictEntropyStats()\n\nThe table log set by `FSE_readNCount()` was not checked in\n`ZSTD_loadDictEntropyStats()`.  This caused `FSE_buildCTable()`\nto stack/heap overflow in a few places.\n\nThe benchmarks look good, there is no obvious compression performance regression:\n\n  > ./zstds/zstd.opt.0 -i10 -b1 -e10 ~/bench/silesia.tar\n   1#silesia.tar       : 211988480 ->  73656930 (2.878), 271.6 MB/s , 716.8 MB/s\n   2#silesia.tar       : 211988480 ->  70162842 (3.021), 204.8 MB/s , 671.1 MB/s\n   3#silesia.tar       : 211988480 ->  66997986 (3.164), 156.8 MB/s , 658.6 MB/s\n   4#silesia.tar       : 211988480 ->  66002591 (3.212), 136.4 MB/s , 665.3 MB/s\n   5#silesia.tar       : 211988480 ->  65008480 (3.261),  98.9 MB/s , 647.0 MB/s\n   6#silesia.tar       : 211988480 ->  62979643 (3.366),  65.2 MB/s , 670.4 MB/s\n   7#silesia.tar       : 211988480 ->  61974560 (3.421),  44.9 MB/s , 688.2 MB/s\n   8#silesia.tar       : 211988480 ->  61028308 (3.474),  32.4 MB/s , 711.9 MB/s\n   9#silesia.tar       : 211988480 ->  60416751 (3.509),  21.1 MB/s , 718.1 MB/s\n  10#silesia.tar       : 211988480 ->  60174239 (3.523),  22.2 MB/s , 721.8 MB/s\n\n  > ./compress_zstds/zstd.opt.1 -i10 -b1 -e10 ~/bench/silesia.tar\n   1#silesia.tar       : 211988480 ->  73656930 (2.878), 273.8 MB/s , 722.0 MB/s\n   2#silesia.tar       : 211988480 ->  70162842 (3.021), 203.2 MB/s , 666.6 MB/s\n   3#silesia.tar       : 211988480 ->  66997986 (3.164), 157.4 MB/s , 666.5 MB/s\n   4#silesia.tar       : 211988480 ->  66002591 (3.212), 132.1 MB/s , 661.9 MB/s\n   5#silesia.tar       : 211988480 ->  65008480 (3.261),  96.8 MB/s , 641.6 MB/s\n   6#silesia.tar       : 211988480 ->  62979643 (3.366),  63.1 MB/s , 677.0 MB/s\n   7#silesia.tar       : 211988480 ->  61974560 (3.421),  44.3 MB/s , 678.2 MB/s\n   8#silesia.tar       : 211988480 ->  61028308 (3.474),  33.1 MB/s , 708.9 MB/s\n   9#silesia.tar       : 211988480 ->  60416751 (3.509),  21.5 MB/s , 710.1 MB/s\n  10#silesia.tar       : 211988480 ->  60174239 (3.523),  21.9 MB/s , 723.9 MB/s","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/bfd943ace5ff23d12501a744d719cb0e306513b4"},{"sha":"fd9808704799f74a30246754ebf239ac1e8cafc9","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Fix stack buffer overflow in HUF_readCTable()\n\nIf `w ==0` on line 153, then `CTable[n].nbBits == tableLog + 1`.\nThen `nbPerRank[CTable[n].nbBits]` and `valPerRank[CTable[n].nbBits]`\nare stack buffer overflows.","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/fd9808704799f74a30246754ebf239ac1e8cafc9"},{"sha":"f45b157d956e083c16a5c2b1f5793476a1df9081","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Backport fix from commit 9e8b09a\n\nFixes uninitialized memory reads.\nFull commit hash: 9e8b09a7bd42dd06ee62b33aff215fbb52708d7b","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/f45b157d956e083c16a5c2b1f5793476a1df9081"},{"sha":"7b06ad7a05eabf1e03a9eeff4d6fea7fe63eb0f1","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Backport fix from commit 125d817\n\nThis fixes a read of unitialized memory.\nFull commit hash: 125d81774fe87a2bc18023d999d8e510678c38fb.","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/7b06ad7a05eabf1e03a9eeff4d6fea7fe63eb0f1"},{"sha":"bb68062c590dbd46905907dd2a63a658040a79d4","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Unitialized memory read in ZSTD_decodeSeqHeaders()\n\nCaused by two things:\n1. Not checking that `ip` is in range except for the first byte.\n2. `ZSTDv0{5,6}_decodeLiteralsBlock()` could return a value larger than `srcSize`.","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/bb68062c590dbd46905907dd2a63a658040a79d4"},{"sha":"d760529a058e38bb7a24b5be31060d4b2a020f6f","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Fix stack buffer overrun when weightTotal == 0\n\nIf `weightTotal == 0`, then `BIT_highbit32(weightTotal)` is\nundefined behavior in the case that it calls `__builtin_clz()`.\nIf `tableLog == HUF_TABLELOG_ABSOLUTEMAX` then we will access one\nbyte beyond the end of the buffer.","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/d760529a058e38bb7a24b5be31060d4b2a020f6f"},{"sha":"f9c9af3c2e84bb61841ff41aa8e5afbd2ca83d7d","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Reject dictionaries with incomplete entropy tables\n\nIf a dictionary specifies that a symbol has probability zero in its\n`matchLength`, `literalLength`, or `offset` FSE table, but the symbol\nappears when compressing input, the compressor fails.\n\nEnsure that dictionaries support all `matchLength`, and `literalLength`\ncodes.  They must also support all of the `offset` codes required to\nrepresent every possible offset that can appear in the first block.","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/f9c9af3c2e84bb61841ff41aa8e5afbd2ca83d7d"},{"sha":"f698ad6deb2279b38744ef61f9954da2f0213c94","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Merge remote-tracking branch 'upstream/dev' into fixes\n\n* upstream/dev:\n  added doc\\zstd_manual.html\n  added contrib\\gen_html\n  zstd_compression_format.md moved to doc/\n  Fix small bug in ZSTD_execSequence()\n  improved ZSTD_compressBlock_opt_extDict_generic\n  protect ZSTD_decodeFrameHeader() from invalid usage, as suggested by @spaskob\n  zstd_opt.h: small improvement in compression ratio\n  improved dicitonary segment merge\n  use implicit rules to compile zstd_decompress.c\n  detect early impossible decompression scenario in legacy decoder v0.5\n  no repeat mode in legacy v0.5\n  fixed invalid invocation of dictionary in legacy decoder v0.5\n  fix edge case\n  fix command line interpretation\n  fixed minor corner case\n  zstd.h: added the Introduction section\n  fixed clang 3.5 warnings\n  zstd.h: updated comments","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/f698ad6deb2279b38744ef61f9954da2f0213c94"},{"sha":"b2c39a22b028cd4d7967e233e2bf8e1d0bdc4a44","author":{"name":"Nick Terrell","email":"5daa27ddf62cd18900c587bff78b5ed81174ca71@fb.com"},"message":"Fix compiler narrowing warning","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/b2c39a22b028cd4d7967e233e2bf8e1d0bdc4a44"},{"sha":"7b5948cca7301305121bbce94cf88b45bae5bdfd","author":{"name":"Yann Collet","email":"2a64e10dfd58391a45c6779589bcfc1d5d451569@users.noreply.github.com"},"message":"Merge pull request #426 from terrelln/fixes\n\nFix various {A, M}SAN bugs","distinct":true,"url":"https://api.github.com/repos/facebook/zstd/commits/7b5948cca7301305121bbce94cf88b45bae5bdfd"}]}
{"actor":{"display_login":"Cyan4973"}}