{"action":"created","issue":{"url":"https://api.github.com/repos/howardjones/network-weathermap/issues/161","repository_url":"https://api.github.com/repos/howardjones/network-weathermap","labels_url":"https://api.github.com/repos/howardjones/network-weathermap/issues/161/labels{/name}","comments_url":"https://api.github.com/repos/howardjones/network-weathermap/issues/161/comments","events_url":"https://api.github.com/repos/howardjones/network-weathermap/issues/161/events","html_url":"https://github.com/howardjones/network-weathermap/issues/161","id":363368385,"node_id":"MDU6SXNzdWUzNjMzNjgzODU=","number":161,"title":"Weathermap plugin 1.0.0dev with 0 maps enabled causing master poller latency/timeouts","user":{"login":"ikorzha","id":11211789,"node_id":"MDQ6VXNlcjExMjExNzg5","avatar_url":"https://avatars1.githubusercontent.com/u/11211789?v=4","gravatar_id":"","url":"https://api.github.com/users/ikorzha","html_url":"https://github.com/ikorzha","followers_url":"https://api.github.com/users/ikorzha/followers","following_url":"https://api.github.com/users/ikorzha/following{/other_user}","gists_url":"https://api.github.com/users/ikorzha/gists{/gist_id}","starred_url":"https://api.github.com/users/ikorzha/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ikorzha/subscriptions","organizations_url":"https://api.github.com/users/ikorzha/orgs","repos_url":"https://api.github.com/users/ikorzha/repos","events_url":"https://api.github.com/users/ikorzha/events{/privacy}","received_events_url":"https://api.github.com/users/ikorzha/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-09-25T00:33:48Z","updated_at":"2018-09-25T08:58:29Z","closed_at":null,"author_association":"NONE","body":"Howie, please help I am absolutely desparate, I been fighting this issue for the last year and only recently realized that if I disable weathermap plugin, all polling problems and tholds checkup problems that I am experience right away dissapear.\r\nAttached is a screenshot when weathermap is installed and enabled, but 0 maps are enabled:\r\nNotice how weathermap is running twice on same minute and master server polling times 44 to 47sec\r\nI think this somehow **\"double weathermap run on same minute\"** is actually causing the problem but I have not idea what is the root cause:\r\n![enabled](https://user-images.githubusercontent.com/11211789/45986198-09357500-c038-11e8-9983-fd1d5d47bb04.PNG)\r\n\r\nIn this screenshot just 2minutes later, weathermap is still installed but disabled:\r\nPlease notice how consistent is master server polling.  20-23 sec polling times no duplicate polling on same minute that I often see with weathermap plugin enabled.\r\n\r\n![image](https://user-images.githubusercontent.com/11211789/45986295-a0023180-c038-11e8-9ee8-268445b98759.png)\r\n\r\n![image](https://user-images.githubusercontent.com/11211789/45986264-7b0dbe80-c038-11e8-99dc-024a7870864f.png)\r\n\r\nAs you suggested I checked \"weathermap_data\" table, it is not huge only 2600 items in it..\r\n\r\n![image](https://user-images.githubusercontent.com/11211789/45986342-f1122580-c038-11e8-8e11-9a66ceb7a2e3.png)\r\n\r\nPlease help Howie, you are my only hope to get this problem resolved once and for all.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/howardjones/network-weathermap/issues/comments/424261396","html_url":"https://github.com/howardjones/network-weathermap/issues/161#issuecomment-424261396","issue_url":"https://api.github.com/repos/howardjones/network-weathermap/issues/161","id":424261396,"node_id":"MDEyOklzc3VlQ29tbWVudDQyNDI2MTM5Ng==","user":{"login":"howardjones","id":912421,"node_id":"MDQ6VXNlcjkxMjQyMQ==","avatar_url":"https://avatars3.githubusercontent.com/u/912421?v=4","gravatar_id":"","url":"https://api.github.com/users/howardjones","html_url":"https://github.com/howardjones","followers_url":"https://api.github.com/users/howardjones/followers","following_url":"https://api.github.com/users/howardjones/following{/other_user}","gists_url":"https://api.github.com/users/howardjones/gists{/gist_id}","starred_url":"https://api.github.com/users/howardjones/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/howardjones/subscriptions","organizations_url":"https://api.github.com/users/howardjones/orgs","repos_url":"https://api.github.com/users/howardjones/repos","events_url":"https://api.github.com/users/howardjones/events{/privacy}","received_events_url":"https://api.github.com/users/howardjones/received_events","type":"User","site_admin":false},"created_at":"2018-09-25T08:58:29Z","updated_at":"2018-09-25T08:58:29Z","author_association":"OWNER","body":"That's (at least) 2600 database queries per poll that you don't need to be running. Truncate the weathermap_data table and see how that affects it.\r\n\r\nAs you can see from your logs, the actual poller_bottom hook (the one that actually creates maps) takes 0.02 seconds, so this time must be somewhere else. The only other place is poller_output - where the 'Boost support' stuff happens. That works by looking up EVERY piece of data collected against the weathermap_data table. When TARGETs are removed from maps, the entries in weathermap_data are not cleaned up, so this can build up over time.\r\n\r\nIf that *does* resolve it, then I guess we need to look at database indexes and maybe type=Memory for the weathermap_data table."}}
{"actor":{"display_login":"howardjones"}}