{"action":"created","issue":{"url":"https://api.github.com/repos/weaveworks/scope/issues/854","labels_url":"https://api.github.com/repos/weaveworks/scope/issues/854/labels{/name}","comments_url":"https://api.github.com/repos/weaveworks/scope/issues/854/comments","events_url":"https://api.github.com/repos/weaveworks/scope/issues/854/events","html_url":"https://github.com/weaveworks/scope/issues/854","id":128411833,"number":854,"title":"App using lots of CPU","user":{"login":"tomwilkie","id":444037,"avatar_url":"https://avatars.githubusercontent.com/u/444037?v=3","gravatar_id":"","url":"https://api.github.com/users/tomwilkie","html_url":"https://github.com/tomwilkie","followers_url":"https://api.github.com/users/tomwilkie/followers","following_url":"https://api.github.com/users/tomwilkie/following{/other_user}","gists_url":"https://api.github.com/users/tomwilkie/gists{/gist_id}","starred_url":"https://api.github.com/users/tomwilkie/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tomwilkie/subscriptions","organizations_url":"https://api.github.com/users/tomwilkie/orgs","repos_url":"https://api.github.com/users/tomwilkie/repos","events_url":"https://api.github.com/users/tomwilkie/events{/privacy}","received_events_url":"https://api.github.com/users/tomwilkie/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/weaveworks/scope/milestones/10","html_url":"https://github.com/weaveworks/scope/milestones/0.12.0","labels_url":"https://api.github.com/repos/weaveworks/scope/milestones/10/labels","id":1453899,"number":10,"title":"0.12.0","description":"Details panel redesign.","creator":{"login":"tomwilkie","id":444037,"avatar_url":"https://avatars.githubusercontent.com/u/444037?v=3","gravatar_id":"","url":"https://api.github.com/users/tomwilkie","html_url":"https://github.com/tomwilkie","followers_url":"https://api.github.com/users/tomwilkie/followers","following_url":"https://api.github.com/users/tomwilkie/following{/other_user}","gists_url":"https://api.github.com/users/tomwilkie/gists{/gist_id}","starred_url":"https://api.github.com/users/tomwilkie/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tomwilkie/subscriptions","organizations_url":"https://api.github.com/users/tomwilkie/orgs","repos_url":"https://api.github.com/users/tomwilkie/repos","events_url":"https://api.github.com/users/tomwilkie/events{/privacy}","received_events_url":"https://api.github.com/users/tomwilkie/received_events","type":"User","site_admin":false},"open_issues":2,"closed_issues":29,"state":"open","created_at":"2015-12-10T11:38:32Z","updated_at":"2016-01-28T22:25:43Z","due_on":"2016-01-18T00:00:00Z","closed_at":null},"comments":2,"created_at":"2016-01-24T17:24:42Z","updated_at":"2016-01-29T13:47:44Z","closed_at":"2016-01-28T22:24:51Z","body":""},"comment":{"url":"https://api.github.com/repos/weaveworks/scope/issues/comments/176761452","html_url":"https://github.com/weaveworks/scope/issues/854#issuecomment-176761452","issue_url":"https://api.github.com/repos/weaveworks/scope/issues/854","id":176761452,"user":{"login":"2opremio","id":2362916,"avatar_url":"https://avatars.githubusercontent.com/u/2362916?v=3","gravatar_id":"","url":"https://api.github.com/users/2opremio","html_url":"https://github.com/2opremio","followers_url":"https://api.github.com/users/2opremio/followers","following_url":"https://api.github.com/users/2opremio/following{/other_user}","gists_url":"https://api.github.com/users/2opremio/gists{/gist_id}","starred_url":"https://api.github.com/users/2opremio/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/2opremio/subscriptions","organizations_url":"https://api.github.com/users/2opremio/orgs","repos_url":"https://api.github.com/users/2opremio/repos","events_url":"https://api.github.com/users/2opremio/events{/privacy}","received_events_url":"https://api.github.com/users/2opremio/received_events","type":"User","site_admin":false},"created_at":"2016-01-29T13:47:44Z","updated_at":"2016-01-29T13:47:44Z","body":"While testing the 0.12 candidate ( d0d6cac) with the [ECS demo](http://www.weave.works/guides/service-discovery-and-load-balancing-with-weave-on-amazon-ecs-2/) I see that the app in one of the three hosts is consuming ~50% CPU with peaks of ~75% CPU. The other apps are running with less than 10% CPU consumption.\r\n\r\nThe app showing the problem is the only one whose UI I had opened in my browser\r\n\r\nIt doesn't happen systematically. I managed to reproduce it once yesterday and spent the rest of the day retrying without luck until I saw it happening today again.\r\n\r\n\r\nHere are two CPU profiles:\r\n\r\n http://filebin.ca/2V8B4tkAgwWP/pprof.ec2-52-28-149-93.eu-central-1.compute.amazonaws.com4040.samples.cpu.001.pb.gz\r\nhttp://filebin.ca/2V8Bmv9bJ5Xf/pprof.ec2-52-28-149-93.eu-central-1.compute.amazonaws.com4040.samples.cpu.002.pb.gz\r\n\r\nAnd here's the png from one of them:\r\n\r\n![profile](https://cloud.githubusercontent.com/assets/2362916/12676900/552abb52-c68d-11e5-913c-d0581a839984.png)\r\n\r\n\r\nWhich suggests it's the GC.\r\n\r\nHere's the memory consumption profile: http://filebin.ca/2V8F07Fc8QZr/pprof.ec2-52-28-149-93.eu-central-1.compute.amazonaws.com4040.inuse_objects.inuse_space.001.pb.gz\r\n\r\n![memory_profile](https://cloud.githubusercontent.com/assets/2362916/12677064/56ee3a44-c68e-11e5-914e-eb8c4a27026a.png)\r\n\r\nNote: This is happening in a node whose Scope probe is experiencing a bad memory leak (#881), that the time I took the measurements, the Probe was consuming ~176MB, which may be related"}}