{"action":"created","issue":{"url":"https://api.github.com/repos/spotify/luigi/issues/1916","repository_url":"https://api.github.com/repos/spotify/luigi","labels_url":"https://api.github.com/repos/spotify/luigi/issues/1916/labels{/name}","comments_url":"https://api.github.com/repos/spotify/luigi/issues/1916/comments","events_url":"https://api.github.com/repos/spotify/luigi/issues/1916/events","html_url":"https://github.com/spotify/luigi/pull/1916","id":187825943,"number":1916,"title":"Enables e-mail batching in the scheduler","user":{"login":"daveFNbuck","id":2091885,"avatar_url":"https://avatars.githubusercontent.com/u/2091885?v=3","gravatar_id":"","url":"https://api.github.com/users/daveFNbuck","html_url":"https://github.com/daveFNbuck","followers_url":"https://api.github.com/users/daveFNbuck/followers","following_url":"https://api.github.com/users/daveFNbuck/following{/other_user}","gists_url":"https://api.github.com/users/daveFNbuck/gists{/gist_id}","starred_url":"https://api.github.com/users/daveFNbuck/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/daveFNbuck/subscriptions","organizations_url":"https://api.github.com/users/daveFNbuck/orgs","repos_url":"https://api.github.com/users/daveFNbuck/repos","events_url":"https://api.github.com/users/daveFNbuck/events{/privacy}","received_events_url":"https://api.github.com/users/daveFNbuck/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-11-07T20:57:46Z","updated_at":"2016-11-08T02:39:12Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/spotify/luigi/pulls/1916","html_url":"https://github.com/spotify/luigi/pull/1916","diff_url":"https://github.com/spotify/luigi/pull/1916.diff","patch_url":"https://github.com/spotify/luigi/pull/1916.patch"},"body":"## Description\r\nEnables sending periodic batch e-mails from the scheduler rather than sending immediate failure/disable/scheduling failure e-mails on every event.\r\n\r\n## Motivation and Context\r\nWith a large pipeline, it's fairly easy to get hundreds of e-mails an hour when something goes wrong. This translates to thousands of e-mails per day. While this is a great resource for tracking down error messages of a particular task in your e-mail history, it's not nearly as great for understanding what the current issues are in your pipeline.\r\n\r\nIn order to make it more manageable, this groups together failures and shows sample error messages. Failures are ordered by how often they occur and it's easier to see from e-mail subject lines how many failures are occurring over time. Failure message history is preserved enough for most uses by including snippets for each task.\r\n\r\n## Have you tested this? If so, how?\r\nI have included unit tests for all the pieces of this and have been running it for the last week or so, reducing my luigi e-mail volume by two orders of magnitude and making it easier to find and fix issues, also reducing the error volume. So the feature and its usefulness have both survived testing."},"comment":{"url":"https://api.github.com/repos/spotify/luigi/issues/comments/259029138","html_url":"https://github.com/spotify/luigi/pull/1916#issuecomment-259029138","issue_url":"https://api.github.com/repos/spotify/luigi/issues/1916","id":259029138,"user":{"login":"Tarrasch","id":294349,"avatar_url":"https://avatars.githubusercontent.com/u/294349?v=3","gravatar_id":"","url":"https://api.github.com/users/Tarrasch","html_url":"https://github.com/Tarrasch","followers_url":"https://api.github.com/users/Tarrasch/followers","following_url":"https://api.github.com/users/Tarrasch/following{/other_user}","gists_url":"https://api.github.com/users/Tarrasch/gists{/gist_id}","starred_url":"https://api.github.com/users/Tarrasch/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Tarrasch/subscriptions","organizations_url":"https://api.github.com/users/Tarrasch/orgs","repos_url":"https://api.github.com/users/Tarrasch/repos","events_url":"https://api.github.com/users/Tarrasch/events{/privacy}","received_events_url":"https://api.github.com/users/Tarrasch/received_events","type":"User","site_admin":false},"created_at":"2016-11-08T02:39:12Z","updated_at":"2016-11-08T02:39:12Z","body":"Wow, this is a huge patch. I'll try to get to reviewing it soon :)"}}
{"actor":{"display_login":"Tarrasch"}}