{"action":"created","issue":{"url":"https://api.github.com/repos/rackerlabs/blueflood/issues/691","repository_url":"https://api.github.com/repos/rackerlabs/blueflood","labels_url":"https://api.github.com/repos/rackerlabs/blueflood/issues/691/labels{/name}","comments_url":"https://api.github.com/repos/rackerlabs/blueflood/issues/691/comments","events_url":"https://api.github.com/repos/rackerlabs/blueflood/issues/691/events","html_url":"https://github.com/rackerlabs/blueflood/pull/691","id":153279131,"number":691,"title":"Delayed metrics part2","user":{"login":"ChandraAddala","id":1525859,"avatar_url":"https://avatars.githubusercontent.com/u/1525859?v=3","gravatar_id":"","url":"https://api.github.com/users/ChandraAddala","html_url":"https://github.com/ChandraAddala","followers_url":"https://api.github.com/users/ChandraAddala/followers","following_url":"https://api.github.com/users/ChandraAddala/following{/other_user}","gists_url":"https://api.github.com/users/ChandraAddala/gists{/gist_id}","starred_url":"https://api.github.com/users/ChandraAddala/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ChandraAddala/subscriptions","organizations_url":"https://api.github.com/users/ChandraAddala/orgs","repos_url":"https://api.github.com/users/ChandraAddala/repos","events_url":"https://api.github.com/users/ChandraAddala/events{/privacy}","received_events_url":"https://api.github.com/users/ChandraAddala/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-05-05T17:19:43Z","updated_at":"2016-05-05T17:44:56Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/rackerlabs/blueflood/pulls/691","html_url":"https://github.com/rackerlabs/blueflood/pull/691","diff_url":"https://github.com/rackerlabs/blueflood/pull/691.diff","patch_url":"https://github.com/rackerlabs/blueflood/pull/691.patch"},"body":"This is step 2 of handling delayed metrics as described in the wiki page. https://one.rackspace.com/pages/viewpage.action?pageId=162810603#Delayedmetrics-Analysis&Design-Step2:Schedulingslotsofdelayedmetrics\r\n\r\nWe had decided to go with a combination of configs, one for metrics with short delay(DELAYED_METRICS_ROLLUP_DELAY_MILLIS) and another for metrics with long delay(DELAYED_METRICS_ROLLUP_WAIT_PERIOD_MILLIS)\r\n\r\nThe changes include\r\n- Adding new config DELAYED_METRICS_ROLLUP_WAIT_PERIOD_MILLIS\r\n- Logic to schedule metrics with longer dealy only after waiting certain time to prevent frequent re-rolls.\r\n- Added meters/graphs for identifying short/long delayed metrics, re-rolls waiting to happen. \r\n- Removing usage of config DELAYED_METRICS_MILLIS as we could use ROLLUP_DELAY_MILLIS\r\n\r\nI created a separate dashboard for delayed metrics. Here is the link for perf01 env.\r\nhttp://graphite00.dfw.perf01.bf.k1k.me/grafana/#/dashboard/db/delayed-metrics"},"comment":{"url":"https://api.github.com/repos/rackerlabs/blueflood/issues/comments/217223144","html_url":"https://github.com/rackerlabs/blueflood/pull/691#issuecomment-217223144","issue_url":"https://api.github.com/repos/rackerlabs/blueflood/issues/691","id":217223144,"user":{"login":"coveralls","id":2354108,"avatar_url":"https://avatars.githubusercontent.com/u/2354108?v=3","gravatar_id":"","url":"https://api.github.com/users/coveralls","html_url":"https://github.com/coveralls","followers_url":"https://api.github.com/users/coveralls/followers","following_url":"https://api.github.com/users/coveralls/following{/other_user}","gists_url":"https://api.github.com/users/coveralls/gists{/gist_id}","starred_url":"https://api.github.com/users/coveralls/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/coveralls/subscriptions","organizations_url":"https://api.github.com/users/coveralls/orgs","repos_url":"https://api.github.com/users/coveralls/repos","events_url":"https://api.github.com/users/coveralls/events{/privacy}","received_events_url":"https://api.github.com/users/coveralls/received_events","type":"User","site_admin":false},"created_at":"2016-05-05T17:44:56Z","updated_at":"2016-05-05T17:44:56Z","body":"\n[![Coverage Status](https://coveralls.io/builds/6064285/badge)](https://coveralls.io/builds/6064285)\n\nCoverage decreased (-0.2%) to 78.13% when pulling **5625ddbc4681ae1dc006fdd1c1af8216532ae9a3 on ChandraAddala:delayed-metrics-part2** into **3d920a1c5620953715de2b1af46b5da1b94736a3 on rackerlabs:master**.\n"}}