{"push_id":2719405614,"size":1,"distinct_size":1,"ref":"refs/heads/master","head":"bbff28d92a81f587a504e32cb895a55e4d44c2e6","before":"d06914e41f81020e0616f643899664e092ef5796","commits":[{"sha":"bbff28d92a81f587a504e32cb895a55e4d44c2e6","author":{"name":"Andrew C. Dvorak","email":"bc993edc747f329843bb65d6d7b62a913f970863@gmail.com"},"message":"chore(infrastructure): Automatically retry screenshots up to 3 times to reduce flakes (#3072)\n\n### How to test\r\n\r\nRun this command over and over, and scan the console output for lines that start with \"Retry\":\r\n\r\n```bash\r\nnpm run screenshot:test -- \\\r\n  --url=mdc-button/classes/baseline-button-with-icons.html \\\r\n  --browser=desktop_windows_ie@11\r\n```\r\n\r\n### What it does\r\n\r\n- Automatically retries screenshots that have diffs up to 3 times\r\n    - Minimizes noisy diffs due to flaky browser rendering\r\n    - Significantly reduces noise across all 4 browsers, especially IE 11 💩\r\n- Compares each screenshot to its golden counterpart immediately after capturing it, instead of waiting until all screenshots have been captured\r\n- Adds `--retries` and `--max-parallels` CLI options\r\n- Fixes buggy parsing of `--diff-base` local `golden.json` files\r\n- Increases the minimum pixel diff threshold from 10 pixels to 15 pixels\r\n    - Avoids noisy FAB diffs in Edge\r\n- Changes the `min-width` button label text from `是` to `+`\r\n    - Fixes flaky font rendering in Firefox\r\n- Updates `golden.json` with new `min-width` button screenshots\r\n- Returns a non-zero exit code from the `npm run screenshot:test` if there are any screenshot changes (diffs/added/removed)\r\n    - Necessary for Travis CI (and to be consistent with UNIX conventions)\r\n- Removes `fixture.js` from `.eslintignore`\r\n- Renames `resemble.json` to `diffing.json`\r\n- Updates example report links and console output in README\r\n\r\n### Example output\r\n\r\nReport page:\r\n\r\n- https://storage.googleapis.com/mdc-web-screenshot-tests/advorak/2018/07/14/07_08_26_379/report/report.html\r\n\r\nConsole output:\r\n\r\n```\r\nGET https://storage.googleapis.com/mdc-web-screenshot-tests/advorak/2018/07/14/07_25_45_444/mdc-button/classes/baseline-button-with-icons.html > desktop_windows_ie@11...\r\nCropped https://storage.googleapis.com/mdc-web-screenshot-tests/advorak/2018/07/14/07_25_45_444/mdc-button/classes/baseline-button-with-icons.html > desktop_windows_ie@11 image from 384x687 to 348x628\r\nRetrying mdc-button/classes/baseline-button-with-icons.html > desktop_windows_ie@11 (attempt 1 of 3). 1,873 pixels differed (0.9% of 348x628)\r\n```","distinct":true,"url":"https://api.github.com/repos/material-components/material-components-web/commits/bbff28d92a81f587a504e32cb895a55e4d44c2e6"}]}
{"actor":{"display_login":"acdvorak"}}