{"action":"created","issue":{"url":"https://api.github.com/repos/paulirish/pwmetrics/issues/181","repository_url":"https://api.github.com/repos/paulirish/pwmetrics","labels_url":"https://api.github.com/repos/paulirish/pwmetrics/issues/181/labels{/name}","comments_url":"https://api.github.com/repos/paulirish/pwmetrics/issues/181/comments","events_url":"https://api.github.com/repos/paulirish/pwmetrics/issues/181/events","html_url":"https://github.com/paulirish/pwmetrics/issues/181","id":334915943,"node_id":"MDU6SXNzdWUzMzQ5MTU5NDM=","number":181,"title":"Expectation errors should be based on median run values","user":{"login":"tshen8","id":7621746,"node_id":"MDQ6VXNlcjc2MjE3NDY=","avatar_url":"https://avatars3.githubusercontent.com/u/7621746?v=4","gravatar_id":"","url":"https://api.github.com/users/tshen8","html_url":"https://github.com/tshen8","followers_url":"https://api.github.com/users/tshen8/followers","following_url":"https://api.github.com/users/tshen8/following{/other_user}","gists_url":"https://api.github.com/users/tshen8/gists{/gist_id}","starred_url":"https://api.github.com/users/tshen8/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tshen8/subscriptions","organizations_url":"https://api.github.com/users/tshen8/orgs","repos_url":"https://api.github.com/users/tshen8/repos","events_url":"https://api.github.com/users/tshen8/events{/privacy}","received_events_url":"https://api.github.com/users/tshen8/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-06-22T15:13:13Z","updated_at":"2018-09-12T20:09:52Z","closed_at":"2018-09-12T20:09:52Z","author_association":"NONE","body":"When performing multiple runs on a page with expectation set, the entire testing process will fail if _any_ one of the runs exceeds any expectation value.\r\n\r\nIf the purpose of doing multiple runs is to gather several data points for performance metrics in order to rule out outliers and unrepresentative numbers, I think it makes sense that the pass/fail should be based on the median numbers for the runs (which are displayed at the end anyways).\r\n\r\nWhat do you guys think? I'm happy to make a PR if we're okay with this."},"comment":{"url":"https://api.github.com/repos/paulirish/pwmetrics/issues/comments/420780594","html_url":"https://github.com/paulirish/pwmetrics/issues/181#issuecomment-420780594","issue_url":"https://api.github.com/repos/paulirish/pwmetrics/issues/181","id":420780594,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMDc4MDU5NA==","user":{"login":"denar90","id":6231516,"node_id":"MDQ6VXNlcjYyMzE1MTY=","avatar_url":"https://avatars0.githubusercontent.com/u/6231516?v=4","gravatar_id":"","url":"https://api.github.com/users/denar90","html_url":"https://github.com/denar90","followers_url":"https://api.github.com/users/denar90/followers","following_url":"https://api.github.com/users/denar90/following{/other_user}","gists_url":"https://api.github.com/users/denar90/gists{/gist_id}","starred_url":"https://api.github.com/users/denar90/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/denar90/subscriptions","organizations_url":"https://api.github.com/users/denar90/orgs","repos_url":"https://api.github.com/users/denar90/repos","events_url":"https://api.github.com/users/denar90/events{/privacy}","received_events_url":"https://api.github.com/users/denar90/received_events","type":"User","site_admin":false},"created_at":"2018-09-12T20:09:52Z","updated_at":"2018-09-12T20:09:52Z","author_association":"COLLABORATOR","body":"closing since #178 merged"}}
{"actor":{"display_login":"denar90"}}