{"action":"created","issue":{"url":"https://api.github.com/repos/istio/istio/issues/1484","repository_url":"https://api.github.com/repos/istio/istio","labels_url":"https://api.github.com/repos/istio/istio/issues/1484/labels{/name}","comments_url":"https://api.github.com/repos/istio/istio/issues/1484/comments","events_url":"https://api.github.com/repos/istio/istio/issues/1484/events","html_url":"https://github.com/istio/istio/issues/1484","id":271140439,"node_id":"MDU6SXNzdWUyNzExNDA0Mzk=","number":1484,"title":"Tracking: perf profiling for Pilot Ingress","user":{"login":"kyessenov","id":9537734,"node_id":"MDQ6VXNlcjk1Mzc3MzQ=","avatar_url":"https://avatars2.githubusercontent.com/u/9537734?v=4","gravatar_id":"","url":"https://api.github.com/users/kyessenov","html_url":"https://github.com/kyessenov","followers_url":"https://api.github.com/users/kyessenov/followers","following_url":"https://api.github.com/users/kyessenov/following{/other_user}","gists_url":"https://api.github.com/users/kyessenov/gists{/gist_id}","starred_url":"https://api.github.com/users/kyessenov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kyessenov/subscriptions","organizations_url":"https://api.github.com/users/kyessenov/orgs","repos_url":"https://api.github.com/users/kyessenov/repos","events_url":"https://api.github.com/users/kyessenov/events{/privacy}","received_events_url":"https://api.github.com/users/kyessenov/received_events","type":"User","site_admin":false},"labels":[{"id":750614917,"node_id":"MDU6TGFiZWw3NTA2MTQ5MTc=","url":"https://api.github.com/repos/istio/istio/labels/area/perf%20and%20scalability","name":"area/perf and scalability","color":"0e8a16","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-11-03T22:58:22Z","updated_at":"2018-06-26T04:32:22Z","closed_at":null,"author_association":"MEMBER","body":"@rshriram commented on [Mon Sep 11 2017](https://github.com/istio/old_pilot_repo/issues/1237)\n\nUse this issue to track all perf profiling aspects of Istio pilot.\r\nSample app: acme air (diagram below)\r\n![pasted image at 2017_09_11 12_25 pm](https://user-images.githubusercontent.com/8202871/30287152-04011f1e-96f2-11e7-970d-ef7d0b3c2bba.png)\r\n\r\nFirst tested with Istio 0.1.6. Big performance jump when refresh interval was increased from 10ms to 60s. CPU Usage still seems high (2 cores - not visible in the CPU figure below). This needs to be tested with Istio 0.2.x series and we need to set the defaults, logging levels, etc. correctly before making the release. Turning on pprof in pilot - nothing useful at all in the profiling data. Next step is to use linux perf tests..\r\n\r\ncc @kyessenov @ayj \r\n\r\n![pasted image at 2017_09_11 09_53 am](https://user-images.githubusercontent.com/8202871/30287203-3a910788-96f2-11e7-8540-58eb0bcb3c75.png)\r\n\r\n![pasted image at 2017_09_11 09_57 am](https://user-images.githubusercontent.com/8202871/30287214-450859be-96f2-11e7-9584-7e797a40ba24.png)\r\n\n\n---\n\n@suryadu commented on [Mon Sep 11 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-328605263)\n\nHere is the Istio Ingress Contoller CPU usage chart\r\n![image](https://user-images.githubusercontent.com/13684010/30288689-488b28ee-96ef-11e7-84c5-b940b6d11d28.png)\r\n\n\n---\n\n@kyessenov commented on [Mon Sep 11 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-328609571)\n\nIngress has entirely different performance requirements than the sidecar. Let's focus on the ingress here and not mix the two.\n\n---\n\n@suryadu commented on [Mon Sep 11 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-328614350)\n\nThat makes sense! I will open a separate issue for each area of Istio from performance point of view as we see performance degradation from logging, Mixer, Ingress etc.,\n\n---\n\n@rshriram commented on [Mon Sep 11 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-328615015)\n\ncc @louiscryan FYI, since you were asking about this.\n\n---\n\n@rshriram commented on [Wed Sep 27 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-332646408)\n\nThis is with Istio 0.2.4 (which includes mixerclient caching). \r\ncc @douglas-reid \r\n![istio-0 2 4](https://user-images.githubusercontent.com/8202871/30936303-674fd7ac-a3a1-11e7-803b-dd324849131c.png)\r\n\r\nArmada ingress is nginx\r\nIstio ingress is Envoy, no mixer, and no sidecar Envoys.\r\nIstio full is ingress plus sidecar envoys (with or without mixer checks, but reports are always on)\r\n4vCPU and 16GB RAM per node. \n\n---\n\n@suryadu commented on [Wed Sep 27 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-332648747)\n\nHere is the view from response time (Latency) perspective.\r\n![image](https://user-images.githubusercontent.com/13684010/30936709-5340b5e4-a39a-11e7-833e-d4f6cad659b3.png)\r\n\n\n---\n\n@ldemailly commented on [Wed Sep 27 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-332655612)\n\nSubscribe\n\n---\n\n@linsun commented on [Wed Sep 27 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-332657822)\n\nsubscribe\n\n---\n\n@kyessenov commented on [Mon Oct 02 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-333612877)\n\ncc @ldemailly @andraxylia @smawson \n\n---\n\n@suryadu commented on [Mon Oct 02 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-333629659)\n\nHere is the improvement once we disable the sidecars\r\n![image](https://user-images.githubusercontent.com/13684010/31093932-f5b9880a-a778-11e7-861a-372e48eb43aa.png)\r\n\n\n---\n\n@sdake commented on [Tue Oct 10 2017](https://github.com/istio/old_pilot_repo/issues/1237#issuecomment-335481657)\n\nsubscribe\n\n"},"comment":{"url":"https://api.github.com/repos/istio/istio/issues/comments/400175146","html_url":"https://github.com/istio/istio/issues/1484#issuecomment-400175146","issue_url":"https://api.github.com/repos/istio/istio/issues/1484","id":400175146,"node_id":"MDEyOklzc3VlQ29tbWVudDQwMDE3NTE0Ng==","user":{"login":"stale[bot]","id":26384082,"node_id":"MDM6Qm90MjYzODQwODI=","avatar_url":"https://avatars3.githubusercontent.com/in/1724?v=4","gravatar_id":"","url":"https://api.github.com/users/stale%5Bbot%5D","html_url":"https://github.com/apps/stale","followers_url":"https://api.github.com/users/stale%5Bbot%5D/followers","following_url":"https://api.github.com/users/stale%5Bbot%5D/following{/other_user}","gists_url":"https://api.github.com/users/stale%5Bbot%5D/gists{/gist_id}","starred_url":"https://api.github.com/users/stale%5Bbot%5D/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/stale%5Bbot%5D/subscriptions","organizations_url":"https://api.github.com/users/stale%5Bbot%5D/orgs","repos_url":"https://api.github.com/users/stale%5Bbot%5D/repos","events_url":"https://api.github.com/users/stale%5Bbot%5D/events{/privacy}","received_events_url":"https://api.github.com/users/stale%5Bbot%5D/received_events","type":"Bot","site_admin":false},"created_at":"2018-06-26T04:32:22Z","updated_at":"2018-06-26T04:32:22Z","author_association":"NONE","body":"This issue has been automatically marked as stale because it has not had activity in the last 30 days. It will be closed in the next 2 weeks unless it is tagged \"help wanted\" or other activity occurs. Thank you for your contributions.\n"}}
{"actor":{"display_login":"stale"}}