{"action":"created","issue":{"url":"https://api.github.com/repos/eslint/eslint/issues/6577","repository_url":"https://api.github.com/repos/eslint/eslint","labels_url":"https://api.github.com/repos/eslint/eslint/issues/6577/labels{/name}","comments_url":"https://api.github.com/repos/eslint/eslint/issues/6577/comments","events_url":"https://api.github.com/repos/eslint/eslint/issues/6577/events","html_url":"https://github.com/eslint/eslint/issues/6577","id":163498436,"number":6577,"title":"Add regression build","user":{"login":"ilyavolodin","id":1380062,"avatar_url":"https://avatars.githubusercontent.com/u/1380062?v=3","gravatar_id":"","url":"https://api.github.com/users/ilyavolodin","html_url":"https://github.com/ilyavolodin","followers_url":"https://api.github.com/users/ilyavolodin/followers","following_url":"https://api.github.com/users/ilyavolodin/following{/other_user}","gists_url":"https://api.github.com/users/ilyavolodin/gists{/gist_id}","starred_url":"https://api.github.com/users/ilyavolodin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ilyavolodin/subscriptions","organizations_url":"https://api.github.com/users/ilyavolodin/orgs","repos_url":"https://api.github.com/users/ilyavolodin/repos","events_url":"https://api.github.com/users/ilyavolodin/events{/privacy}","received_events_url":"https://api.github.com/users/ilyavolodin/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/eslint/eslint/labels/accepted","name":"accepted","color":"0052cc"},{"url":"https://api.github.com/repos/eslint/eslint/labels/build","name":"build","color":"fad8c7"},{"url":"https://api.github.com/repos/eslint/eslint/labels/feature","name":"feature","color":"bfd4f2"}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":18,"created_at":"2016-07-02T02:43:03Z","updated_at":"2016-07-20T00:40:38Z","closed_at":"2016-07-20T00:40:38Z","body":"Given that bugs slip through code reviews from time to time, I think it would be worth creating regression build that we would run before the release. The idea would be to find a few large repositories that are already using ESLint (hopefully with variety of rules, plugins and parsers), have them automatically cloned, reset to a specified tag, and linted using version that is about to be released. Then output should be verified against baseline.\r\nThis have potential for a bunch of false positives and will most likely require manual verification, however, it can be used as early warning system if the output would allow to easily compare changes between baseline output and new.\r\nWe could even try to set it up to run once a day, and open an issue if there are major differences with output. (although I don't think Travis allows for scheduled builds)."},"comment":{"url":"https://api.github.com/repos/eslint/eslint/issues/comments/233807686","html_url":"https://github.com/eslint/eslint/issues/6577#issuecomment-233807686","issue_url":"https://api.github.com/repos/eslint/eslint/issues/6577","id":233807686,"user":{"login":"ilyavolodin","id":1380062,"avatar_url":"https://avatars.githubusercontent.com/u/1380062?v=3","gravatar_id":"","url":"https://api.github.com/users/ilyavolodin","html_url":"https://github.com/ilyavolodin","followers_url":"https://api.github.com/users/ilyavolodin/followers","following_url":"https://api.github.com/users/ilyavolodin/following{/other_user}","gists_url":"https://api.github.com/users/ilyavolodin/gists{/gist_id}","starred_url":"https://api.github.com/users/ilyavolodin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ilyavolodin/subscriptions","organizations_url":"https://api.github.com/users/ilyavolodin/orgs","repos_url":"https://api.github.com/users/ilyavolodin/repos","events_url":"https://api.github.com/users/ilyavolodin/events{/privacy}","received_events_url":"https://api.github.com/users/ilyavolodin/received_events","type":"User","site_admin":false},"created_at":"2016-07-20T00:40:38Z","updated_at":"2016-07-20T00:40:38Z","body":"Regression build is setup and running. It will send an email to eslint-team google group whenever there's a broken build. In the future we should add more projects to it, as well as automate it to open up a new issue in this repository on the broken build, instead of sending an email.\r\nClosing for now, since we are doing some regression testing now."}}
{"actor":{"display_login":"ilyavolodin"}}