{"action":"created","issue":{"url":"https://api.github.com/repos/dmwm/WMCore/issues/7072","repository_url":"https://api.github.com/repos/dmwm/WMCore","labels_url":"https://api.github.com/repos/dmwm/WMCore/issues/7072/labels{/name}","comments_url":"https://api.github.com/repos/dmwm/WMCore/issues/7072/comments","events_url":"https://api.github.com/repos/dmwm/WMCore/issues/7072/events","html_url":"https://github.com/dmwm/WMCore/issues/7072","id":171855209,"number":7072,"title":"Couchdb checkpoint failure","user":{"login":"amaltaro","id":1798520,"avatar_url":"https://avatars.githubusercontent.com/u/1798520?v=3","gravatar_id":"","url":"https://api.github.com/users/amaltaro","html_url":"https://github.com/amaltaro","followers_url":"https://api.github.com/users/amaltaro/followers","following_url":"https://api.github.com/users/amaltaro/following{/other_user}","gists_url":"https://api.github.com/users/amaltaro/gists{/gist_id}","starred_url":"https://api.github.com/users/amaltaro/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amaltaro/subscriptions","organizations_url":"https://api.github.com/users/amaltaro/orgs","repos_url":"https://api.github.com/users/amaltaro/repos","events_url":"https://api.github.com/users/amaltaro/events{/privacy}","received_events_url":"https://api.github.com/users/amaltaro/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-08-18T09:19:09Z","updated_at":"2016-08-18T12:26:50Z","closed_at":null,"body":"I've just found the following self-recovered error in vocms009\r\n```\r\n[Mon, 15 Aug 2016 16:05:01 GMT] [info] [<0.13799.44>] 127.0.0.1 - - POST /workqueue_inbox/_ensure_full_commit 201\r\n[Mon, 15 Aug 2016 16:05:01 GMT] [error] [<0.27077.40>] Replication `e25f4dcd286f372c2823a8503a8d503a+continuous` (`http://localhost:5984/workqueue_inbox/` -> `https://cmsweb-testbed.cern.ch/couchdb/workqueue/`) failed: {checkpoint_commit_failure,<<\"Target database out of sync. Try to increase max_dbs_open at the target's server.\">>}\r\n[Mon, 15 Aug 2016 16:05:01 GMT] [error] [<0.118.0>] Error in replication `e25f4dcd286f372c2823a8503a8d503a+continuous` (triggered by document `0ad51ed93098f765fd4faafd737f50a6`): {checkpoint_commit_failure,<<\"Target database out of sync. Try to increase max_dbs_open at the target's server.\">>}\r\nRestarting replication in 5 seconds.\r\n[Mon, 15 Aug 2016 16:05:01 GMT] [error] [<0.27077.40>] ** Generic server <0.27077.40> terminating \r\n** Last message in was {'$gen_cast',checkpoint}\r\n** When Server state == {rep_state,\r\n                         {rep,\r\n                          {\"e25f4dcd286f372c2823a8503a8d503a\",\"+continuous\"},\r\n                          {httpdb,\"http://localhost:5984/workqueue_inbox/\",\r\n                           nil,\r\n                           [{\"Accept\",\"application/json\"},\r\n                            {\"User-Agent\",\"CouchDB/1.6.1\"}],\r\n                           30000,\r\n                           [{socket_options,\r\n                             [{keepalive,true},{nodelay,true}]}],\r\n                           10,250,nil,10},\r\n                          {httpdb,\r\n                           \"https://cmsweb-testbed.cern.ch/couchdb/workqueue/\",\r\n                           nil,\r\n                           [{\"Accept\",\"application/json\"},\r\n                            {\"User-Agent\",\"CouchDB/1.6.1\"}],\r\n                           30000,\r\n                           [{is_ssl,true},\r\netc etc\r\n[Mon, 15 Aug 2016 16:05:01 GMT] [error] [<0.27104.40>] ** Generic server <0.27104.40> terminating \r\n** Last message in was {'EXIT',<0.27077.40>,\r\n                           {checkpoint_commit_failure,\r\n                               <<\"Target database out of sync. Try to increase max_dbs_open at the target's server.\">>}}\r\n```\r\n\r\nwhich is then automatically recovered after 30s or so."},"comment":{"url":"https://api.github.com/repos/dmwm/WMCore/issues/comments/240707754","html_url":"https://github.com/dmwm/WMCore/issues/7072#issuecomment-240707754","issue_url":"https://api.github.com/repos/dmwm/WMCore/issues/7072","id":240707754,"user":{"login":"ticoann","id":1247993,"avatar_url":"https://avatars.githubusercontent.com/u/1247993?v=3","gravatar_id":"","url":"https://api.github.com/users/ticoann","html_url":"https://github.com/ticoann","followers_url":"https://api.github.com/users/ticoann/followers","following_url":"https://api.github.com/users/ticoann/following{/other_user}","gists_url":"https://api.github.com/users/ticoann/gists{/gist_id}","starred_url":"https://api.github.com/users/ticoann/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ticoann/subscriptions","organizations_url":"https://api.github.com/users/ticoann/orgs","repos_url":"https://api.github.com/users/ticoann/repos","events_url":"https://api.github.com/users/ticoann/events{/privacy}","received_events_url":"https://api.github.com/users/ticoann/received_events","type":"User","site_admin":false},"created_at":"2016-08-18T12:26:50Z","updated_at":"2016-08-18T12:26:50Z","body":"Hmm, so it recovered by itself? If recovery is feature, it this still issue? Is this crashing often?"}}
{"actor":{"display_login":"ticoann"}}