{"action":"created","issue":{"url":"https://api.github.com/repos/cloudfoundry/bosh/issues/1491","repository_url":"https://api.github.com/repos/cloudfoundry/bosh","labels_url":"https://api.github.com/repos/cloudfoundry/bosh/issues/1491/labels{/name}","comments_url":"https://api.github.com/repos/cloudfoundry/bosh/issues/1491/comments","events_url":"https://api.github.com/repos/cloudfoundry/bosh/issues/1491/events","html_url":"https://github.com/cloudfoundry/bosh/issues/1491","id":185095062,"number":1491,"title":"bosh v258 & v259 director process constantly uses 100% cpu on Openstack","user":{"login":"paolostivanin","id":1040943,"avatar_url":"https://avatars.githubusercontent.com/u/1040943?v=3","gravatar_id":"","url":"https://api.github.com/users/paolostivanin","html_url":"https://github.com/paolostivanin","followers_url":"https://api.github.com/users/paolostivanin/followers","following_url":"https://api.github.com/users/paolostivanin/following{/other_user}","gists_url":"https://api.github.com/users/paolostivanin/gists{/gist_id}","starred_url":"https://api.github.com/users/paolostivanin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/paolostivanin/subscriptions","organizations_url":"https://api.github.com/users/paolostivanin/orgs","repos_url":"https://api.github.com/users/paolostivanin/repos","events_url":"https://api.github.com/users/paolostivanin/events{/privacy}","received_events_url":"https://api.github.com/users/paolostivanin/received_events","type":"User","site_admin":false},"labels":[{"id":307921029,"url":"https://api.github.com/repos/cloudfoundry/bosh/labels/problem","name":"problem","color":"eb6420","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":21,"created_at":"2016-10-25T11:54:32Z","updated_at":"2016-10-31T16:12:30Z","closed_at":null,"body":"After updating bosh from **v257.15** to **v258**, executing any task became very slow. I did some investigation and I found out that the process `/var/vcap/packages/director/bin/bosh-director -c /var/vcap/jobs/director/config/director.yml` was constantly using 100% cpu.\nThere are no tasks running, I double checked with `bosh tasks --no-filter`. The following is the output from `strace -f -c -p PID`\n\n```\n% time     seconds  usecs/call     calls    errors syscall\n------ ----------- ----------- --------- --------- ----------------\n 57.67    0.000947           0      5234           sendto\n 23.20    0.000381           0      6628           poll\n  9.99    0.000164           0     21858           clock_gettime\n  5.91    0.000097           0      5258           write\n  2.38    0.000039           0      7700       656 recvfrom\n  0.85    0.000014           0      5472        42 stat\n  0.00    0.000000           0        91        35 read\n  0.00    0.000000           0        84           close\n  0.00    0.000000           0        37           brk\n  0.00    0.000000           0        42           writev\n  0.00    0.000000           0       336           select\n  0.00    0.000000           0        42           socket\n  0.00    0.000000           0        81        39 accept\n  0.00    0.000000           0       168           recvmsg\n  0.00    0.000000           0        42         7 shutdown\n  0.00    0.000000           0        42           bind\n  0.00    0.000000           0        42           getsockname\n  0.00    0.000000           0        42           getpeername\n  0.00    0.000000           0        42           setsockopt\n  0.00    0.000000           0        42           uname\n  0.00    0.000000           0        84           fcntl\n  0.00    0.000000           0       756           gettimeofday\n------ ----------- ----------- --------- --------- ----------------\n100.00    0.001642                 54123       779 total\n```\n\nPS: of course I tried to restart the process, to recreate the director vm, etc. I was able \"to solve\" the problem by going back to v257.15.\n"},"comment":{"url":"https://api.github.com/repos/cloudfoundry/bosh/issues/comments/257338824","html_url":"https://github.com/cloudfoundry/bosh/issues/1491#issuecomment-257338824","issue_url":"https://api.github.com/repos/cloudfoundry/bosh/issues/1491","id":257338824,"user":{"login":"beyhan","id":517762,"avatar_url":"https://avatars.githubusercontent.com/u/517762?v=3","gravatar_id":"","url":"https://api.github.com/users/beyhan","html_url":"https://github.com/beyhan","followers_url":"https://api.github.com/users/beyhan/followers","following_url":"https://api.github.com/users/beyhan/following{/other_user}","gists_url":"https://api.github.com/users/beyhan/gists{/gist_id}","starred_url":"https://api.github.com/users/beyhan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/beyhan/subscriptions","organizations_url":"https://api.github.com/users/beyhan/orgs","repos_url":"https://api.github.com/users/beyhan/repos","events_url":"https://api.github.com/users/beyhan/events{/privacy}","received_events_url":"https://api.github.com/users/beyhan/received_events","type":"User","site_admin":false},"created_at":"2016-10-31T16:12:30Z","updated_at":"2016-10-31T16:12:30Z","body":"We can confirm that the issue is related to `expects_vm`. The implementation needs to create a deployment plan for this and apparently this operation is to expensive, when the manifests are rather big. Tomorrow is a public holiday in Germany and we will continue to work on a solution on Wednesday. So far we don't have an explanation why the issue doesn't occur on AWS.  "}}
{"actor":{"display_login":"beyhan"}}