{"action":"closed","issue":{"url":"https://api.github.com/repos/weaveworks/cortex/issues/61","repository_url":"https://api.github.com/repos/weaveworks/cortex","labels_url":"https://api.github.com/repos/weaveworks/cortex/issues/61/labels{/name}","comments_url":"https://api.github.com/repos/weaveworks/cortex/issues/61/comments","events_url":"https://api.github.com/repos/weaveworks/cortex/issues/61/events","html_url":"https://github.com/weaveworks/cortex/issues/61","id":184282291,"number":61,"title":"Frequently getting errors when querying cortex","user":{"login":"jml","id":125674,"avatar_url":"https://avatars.githubusercontent.com/u/125674?v=3","gravatar_id":"","url":"https://api.github.com/users/jml","html_url":"https://github.com/jml","followers_url":"https://api.github.com/users/jml/followers","following_url":"https://api.github.com/users/jml/following{/other_user}","gists_url":"https://api.github.com/users/jml/gists{/gist_id}","starred_url":"https://api.github.com/users/jml/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jml/subscriptions","organizations_url":"https://api.github.com/users/jml/orgs","repos_url":"https://api.github.com/users/jml/repos","events_url":"https://api.github.com/users/jml/events{/privacy}","received_events_url":"https://api.github.com/users/jml/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/weaveworks/cortex/milestones/3","html_url":"https://github.com/weaveworks/cortex/milestones/KubeCon%202016","labels_url":"https://api.github.com/repos/weaveworks/cortex/milestones/3/labels","id":2046631,"number":3,"title":"KubeCon 2016","description":"","creator":{"login":"jml","id":125674,"avatar_url":"https://avatars.githubusercontent.com/u/125674?v=3","gravatar_id":"","url":"https://api.github.com/users/jml","html_url":"https://github.com/jml","followers_url":"https://api.github.com/users/jml/followers","following_url":"https://api.github.com/users/jml/following{/other_user}","gists_url":"https://api.github.com/users/jml/gists{/gist_id}","starred_url":"https://api.github.com/users/jml/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jml/subscriptions","organizations_url":"https://api.github.com/users/jml/orgs","repos_url":"https://api.github.com/users/jml/repos","events_url":"https://api.github.com/users/jml/events{/privacy}","received_events_url":"https://api.github.com/users/jml/received_events","type":"User","site_admin":false},"open_issues":4,"closed_issues":5,"state":"open","created_at":"2016-10-04T12:26:43Z","updated_at":"2016-11-06T13:58:16Z","due_on":"2016-11-04T00:00:00Z","closed_at":null},"comments":14,"created_at":"2016-10-20T16:46:28Z","updated_at":"2016-11-06T13:58:16Z","closed_at":"2016-11-06T13:58:16Z","body":"On Weave Cloud dev & prod, getting:\n\n```\nError executing query: too few successful reads, last error was: <nil>\n```\n\nwhen executing queries.\n\nI haven't had a chance to investigate, but my guess is that deployments no longer visibly break the cluster (per #19) but they do silently break it, partly because we're not yet alerting on 500s for cortex at weaveworks (c.f. weaveworks/service#904).\n\nThis is probably something that will be fixed by clean shut-downs (which, at weaveworks, are blocked on weaveworks/service-conf#111), but I wanted to track something something symptom-oriented so I could have something to search for and also make notes on other things I found along the way.\n\nDebugging this would be made easier by addressing #57, #58, #59, and #60.\n"}}
{"actor":{"display_login":"tomwilkie"}}