{"action":"created","issue":{"url":"https://api.github.com/repos/prometheus/prometheus/issues/1550","repository_url":"https://api.github.com/repos/prometheus/prometheus","labels_url":"https://api.github.com/repos/prometheus/prometheus/issues/1550/labels{/name}","comments_url":"https://api.github.com/repos/prometheus/prometheus/issues/1550/comments","events_url":"https://api.github.com/repos/prometheus/prometheus/issues/1550/events","html_url":"https://github.com/prometheus/prometheus/issues/1550","id":147791878,"number":1550,"title":"storage.local.retention killing prometheus?","user":{"login":"mokshpooja","id":8112117,"avatar_url":"https://avatars.githubusercontent.com/u/8112117?v=3","gravatar_id":"","url":"https://api.github.com/users/mokshpooja","html_url":"https://github.com/mokshpooja","followers_url":"https://api.github.com/users/mokshpooja/followers","following_url":"https://api.github.com/users/mokshpooja/following{/other_user}","gists_url":"https://api.github.com/users/mokshpooja/gists{/gist_id}","starred_url":"https://api.github.com/users/mokshpooja/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mokshpooja/subscriptions","organizations_url":"https://api.github.com/users/mokshpooja/orgs","repos_url":"https://api.github.com/users/mokshpooja/repos","events_url":"https://api.github.com/users/mokshpooja/events{/privacy}","received_events_url":"https://api.github.com/users/mokshpooja/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/prometheus/prometheus/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2016-04-12T15:42:31Z","updated_at":"2016-04-12T16:30:40Z","closed_at":null,"body":"Hi Guys,\r\nI have 2 setups, one on my local development setup (vagrant+vm+docker) and the other aws+docker. In both setups I have prometheus+cAdvisor+Alertmanager running as seperate containers.\r\nI want to clean the disk storage every 15 minutes so I added below in my prometheus dockerfile-\r\n`CMD \"-storage.local.retention=15m\"`\r\nIt seems like after 15 mins my prometheus container dies.\r\nMy aim is to clean the collected metrics+storage every 15 minutes and only persist and collected metrics from a timestamp if/when an error occurs.\r\n\r\nAny idea what might be doing wrong with storage.local.retention?"},"comment":{"url":"https://api.github.com/repos/prometheus/prometheus/issues/comments/208993018","html_url":"https://github.com/prometheus/prometheus/issues/1550#issuecomment-208993018","issue_url":"https://api.github.com/repos/prometheus/prometheus/issues/1550","id":208993018,"user":{"login":"juliusv","id":538008,"avatar_url":"https://avatars.githubusercontent.com/u/538008?v=3","gravatar_id":"","url":"https://api.github.com/users/juliusv","html_url":"https://github.com/juliusv","followers_url":"https://api.github.com/users/juliusv/followers","following_url":"https://api.github.com/users/juliusv/following{/other_user}","gists_url":"https://api.github.com/users/juliusv/gists{/gist_id}","starred_url":"https://api.github.com/users/juliusv/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/juliusv/subscriptions","organizations_url":"https://api.github.com/users/juliusv/orgs","repos_url":"https://api.github.com/users/juliusv/repos","events_url":"https://api.github.com/users/juliusv/events{/privacy}","received_events_url":"https://api.github.com/users/juliusv/received_events","type":"User","site_admin":false},"created_at":"2016-04-12T16:30:40Z","updated_at":"2016-04-12T16:30:40Z","body":"Seems rather like a bug to me - if a user configures a very short retention period that overlaps with chunks being in memory, of course it should not crash, it should just keep the chunks as long as absolutely needed (like when they're still involved in an ongoing query), then drop them from everywhere. This kind of panic is usually only guarding against programming mistakes."}}