{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/38273","repository_url":"https://api.github.com/repos/kubernetes/kubernetes","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/38273/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/38273/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/38273/events","html_url":"https://github.com/kubernetes/kubernetes/issues/38273","id":193994184,"number":38273,"title":"QPS limits in clients seem to not work in all situations","user":{"login":"wojtek-t","id":10743879,"avatar_url":"https://avatars.githubusercontent.com/u/10743879?v=3","gravatar_id":"","url":"https://api.github.com/users/wojtek-t","html_url":"https://github.com/wojtek-t","followers_url":"https://api.github.com/users/wojtek-t/followers","following_url":"https://api.github.com/users/wojtek-t/following{/other_user}","gists_url":"https://api.github.com/users/wojtek-t/gists{/gist_id}","starred_url":"https://api.github.com/users/wojtek-t/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wojtek-t/subscriptions","organizations_url":"https://api.github.com/users/wojtek-t/orgs","repos_url":"https://api.github.com/users/wojtek-t/repos","events_url":"https://api.github.com/users/wojtek-t/events{/privacy}","received_events_url":"https://api.github.com/users/wojtek-t/received_events","type":"User","site_admin":false},"labels":[{"id":125010198,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/area/performance","name":"area/performance","color":"d4c5f9","default":false},{"id":105146071,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/kind/bug","name":"kind/bug","color":"e11d21","default":false},{"id":114528068,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/P0","name":"priority/P0","color":"e11d21","default":false},{"id":435667038,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/release-blocker","name":"release-blocker","color":"d93f0b","default":false},{"id":173493835,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/CSI-API%20Machinery%20SIG","name":"team/CSI-API Machinery SIG","color":"d2b48c","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/kubernetes/kubernetes/milestones/23","html_url":"https://github.com/kubernetes/kubernetes/milestones/v1.5","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/milestones/23/labels","id":1945978,"number":23,"title":"v1.5","description":"","creator":{"login":"lavalamp","id":647318,"avatar_url":"https://avatars.githubusercontent.com/u/647318?v=3","gravatar_id":"","url":"https://api.github.com/users/lavalamp","html_url":"https://github.com/lavalamp","followers_url":"https://api.github.com/users/lavalamp/followers","following_url":"https://api.github.com/users/lavalamp/following{/other_user}","gists_url":"https://api.github.com/users/lavalamp/gists{/gist_id}","starred_url":"https://api.github.com/users/lavalamp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lavalamp/subscriptions","organizations_url":"https://api.github.com/users/lavalamp/orgs","repos_url":"https://api.github.com/users/lavalamp/repos","events_url":"https://api.github.com/users/lavalamp/events{/privacy}","received_events_url":"https://api.github.com/users/lavalamp/received_events","type":"User","site_admin":false},"open_issues":126,"closed_issues":979,"state":"open","created_at":"2016-08-16T21:47:28Z","updated_at":"2016-12-07T15:12:32Z","due_on":"2016-12-09T00:00:00Z","closed_at":null},"comments":7,"created_at":"2016-12-07T09:09:26Z","updated_at":"2016-12-07T15:27:16Z","closed_at":null,"body":"In kubemark-500, we are bumping QPS limits for clients in controller-amanger to 100.\r\nhttps://github.com/kubernetes/test-infra/blob/master/jobs/ci-kubernetes-kubemark-500-gce.sh#L42\r\n\r\nHowever, it seems the ReplicationController is creating pods significantly faster than 100 per second.\r\nFrom the logs from:\r\nhttps://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-kubemark-500-gce/642?log#log\r\n```\r\nI1207 00:19:24.543] I1207 00:19:24.543499    9233 runners.go:120] Created replication controller with name: density15000-0-dcd07081-bc55-11e6-9e64-0242ac110005, namespace: e2e-tests-density-100-1-c20xv, replica count: 0xc42e2ca34c\r\nI1207 00:19:24.549] I1207 00:19:24.549245    9233 runners.go:120] Created replication controller with name: density15000-3-dcd07081-bc55-11e6-9e64-0242ac110005, namespace: e2e-tests-density-100-4-brbqf, replica count: 0xc42c885ca4\r\nI1207 00:19:24.549] I1207 00:19:24.549350    9233 runners.go:120] Created replication controller with name: density15000-4-dcd07081-bc55-11e6-9e64-0242ac110005, namespace: e2e-tests-density-100-5-ph9b9, replica count: 0xc42d7b42ac\r\nI1207 00:19:24.549] I1207 00:19:24.549584    9233 runners.go:120] Created replication controller with name: density15000-2-dcd07081-bc55-11e6-9e64-0242ac110005, namespace: e2e-tests-density-100-3-tvqj3, replica count: 0xc42e86dc7c\r\nI1207 00:19:24.571] I1207 00:19:24.570795    9233 runners.go:120] Created replication controller with name: density15000-1-dcd07081-bc55-11e6-9e64-0242ac110005, namespace: e2e-tests-density-100-2-qm9px, replica count: 0xc42dc7fe7c\r\nI1207 00:19:34.527] Dec  7 00:19:34.526: INFO: Density Pods: 1178 out of 15000 created, 883 running, 141 pending, 154 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady \r\nI1207 00:19:44.529] Dec  7 00:19:44.528: INFO: Density Pods: 2182 out of 15000 created, 1880 running, 137 pending, 165 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady \r\nI1207 00:19:54.530] Dec  7 00:19:54.530: INFO: Density Pods: 3489 out of 15000 created, 2876 running, 136 pending, 477 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady \r\nI1207 00:20:04.532] Dec  7 00:20:04.532: INFO: Density Pods: 5857 out of 15000 created, 3878 running, 131 pending, 1848 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady \r\nI1207 00:20:14.534] Dec  7 00:20:14.534: INFO: Density Pods: 8718 out of 15000 created, 4872 running, 135 pending, 3711 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady \r\nI1207 00:20:24.537] Dec  7 00:20:24.536: INFO: Density Pods: 11044 out of 15000 created, 5876 running, 131 pending, 5037 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady \r\nI1207 00:20:34.538] Dec  7 00:20:34.538: INFO: Density Pods: 12943 out of 15000 created, 6865 running, 141 pending, 5937 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady \r\nI1207 00:20:44.543] Dec  7 00:20:44.542: INFO: Density Pods: 14328 out of 15000 created, 7878 running, 126 pending, 6324 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady \r\nI1207 00:20:54.541] Dec  7 00:20:54.540: INFO: Density Pods: 14998 out of 15000 created, 8883 running, 121 pending, 5994 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotR\r\n```\r\n\r\nThis pretty much means that we created 15000 pods within 90s which gives more than 100 pods/s on average.\r\n\r\nSeems like a bug.\r\n\r\n@kubernetes/sig-api-machinery "},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/265476830","html_url":"https://github.com/kubernetes/kubernetes/issues/38273#issuecomment-265476830","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/38273","id":265476830,"user":{"login":"wojtek-t","id":10743879,"avatar_url":"https://avatars.githubusercontent.com/u/10743879?v=3","gravatar_id":"","url":"https://api.github.com/users/wojtek-t","html_url":"https://github.com/wojtek-t","followers_url":"https://api.github.com/users/wojtek-t/followers","following_url":"https://api.github.com/users/wojtek-t/following{/other_user}","gists_url":"https://api.github.com/users/wojtek-t/gists{/gist_id}","starred_url":"https://api.github.com/users/wojtek-t/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wojtek-t/subscriptions","organizations_url":"https://api.github.com/users/wojtek-t/orgs","repos_url":"https://api.github.com/users/wojtek-t/repos","events_url":"https://api.github.com/users/wojtek-t/events{/privacy}","received_events_url":"https://api.github.com/users/wojtek-t/received_events","type":"User","site_admin":false},"created_at":"2016-12-07T15:27:16Z","updated_at":"2016-12-07T15:27:16Z","body":"@lavalamp "}}
{"actor":{"display_login":"wojtek-t"}}