{"action":"created","issue":{"url":"https://api.github.com/repos/istio/istio/issues/8590","repository_url":"https://api.github.com/repos/istio/istio","labels_url":"https://api.github.com/repos/istio/istio/issues/8590/labels{/name}","comments_url":"https://api.github.com/repos/istio/istio/issues/8590/comments","events_url":"https://api.github.com/repos/istio/istio/issues/8590/events","html_url":"https://github.com/istio/istio/issues/8590","id":358567436,"node_id":"MDU6SXNzdWUzNTg1Njc0MzY=","number":8590,"title":"Use Jmeter to test the istio performance: the istio with mixer test result is better than the istio without mixer","user":{"login":"zxDiscovery","id":40016978,"node_id":"MDQ6VXNlcjQwMDE2OTc4","avatar_url":"https://avatars1.githubusercontent.com/u/40016978?v=4","gravatar_id":"","url":"https://api.github.com/users/zxDiscovery","html_url":"https://github.com/zxDiscovery","followers_url":"https://api.github.com/users/zxDiscovery/followers","following_url":"https://api.github.com/users/zxDiscovery/following{/other_user}","gists_url":"https://api.github.com/users/zxDiscovery/gists{/gist_id}","starred_url":"https://api.github.com/users/zxDiscovery/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zxDiscovery/subscriptions","organizations_url":"https://api.github.com/users/zxDiscovery/orgs","repos_url":"https://api.github.com/users/zxDiscovery/repos","events_url":"https://api.github.com/users/zxDiscovery/events{/privacy}","received_events_url":"https://api.github.com/users/zxDiscovery/received_events","type":"User","site_admin":false},"labels":[{"id":750614917,"node_id":"MDU6TGFiZWw3NTA2MTQ5MTc=","url":"https://api.github.com/repos/istio/istio/labels/area/perf%20and%20scalability","name":"area/perf and scalability","color":"0e8a16","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2018-09-10T10:44:37Z","updated_at":"2018-09-19T14:48:43Z","closed_at":null,"author_association":"NONE","body":"**Describe the bug**\r\nI use the jmeter to test the istio performance, the result of istio with mixer is better than istio without mixer. \r\n\r\n**Expected behavior**\r\nBecause the mixer needs to deal with data, so the istio without mixer performance test result should be better than the istio with mixer.\r\n\r\n**Steps to reproduce the bug**\r\nenvironment:  ubuntu 16.04,  IBMPrivateCloud, jmeter 4.0, istio-1.0.3 (From https://github.com/IBM/charts/blob/master/repo/stable/ibm-istio-1.0.3.tgz , but this chart is using Istio 1.0 image)\r\n\r\nInstall the istio without mixer\r\n\r\n```\r\nhelm install ./ibm-istio-1.0.3.tgz -f values.yaml --name istio --namespace istio-system --tls\r\n```\r\nThe file `values.yaml` enable all add-on deployment except `mixer`, the change set as follows:\r\n```\r\n--set global.proxy.envoyStatsd.enabled=false\r\n--set mixer.enabled=false\r\n```\r\nGet ibm-istio-1.0.3.tgz at here https://github.com/IBM/charts/blob/master/repo/stable/ibm-istio-1.0.3.tgz\r\n\r\nDeploy the bookinfo follow the step https://istio.io/docs/examples/bookinfo/. Because we have 100 nodes on IBMPrivateCloud, so set 100 to `replicas` in bookinfo.yaml.\r\n\r\nUse jmeter start test:\r\n```\r\njmeter -n -t bookinfo.jmx -JHOST=$host -JPORT=31380 -j jMeter-log -l jMeter-results -e -o resultReport -JTHREAD=100 -JDURATION=300 -JRAMP=300\r\n```\r\nThe file `bookinfo.jmx` \r\n[bookinfo.jmx.zip](https://github.com/istio/istio/files/2366192/bookinfo.jmx.zip)\r\n\r\nAfter the steps above, we can get the jmeter test report about the istio without mixer. Then we test the istio with mixer. The result as follows:\r\nIstio without mixer\r\n<img width=\"1159\" alt=\"2018-09-10 6 38 45\" src=\"https://user-images.githubusercontent.com/40016978/45292799-ddd76400-b528-11e8-8527-7d3cbae2875b.png\">\r\n\r\nIstio with mixer\r\n<img width=\"1162\" alt=\"2018-09-10 6 40 11\" src=\"https://user-images.githubusercontent.com/40016978/45292829-fb0c3280-b528-11e8-892c-4c7c9a8095f6.png\">\r\n\r\nWe can see the istio with mixer test result is better than istio without mixer.\r\n\r\n**Version**\r\nistio 1.0.3\r\n\r\n**Is Istio Auth enabled or not?**\r\nNo\r\n\r\n**Environment**\r\nubuntu 16.04,  IBMPrivateCloud, jmeter 4.0, istio-1.0.3\r\n\r\n**Cluster state**\r\nAll nodes state are normal\r\n"},"comment":{"url":"https://api.github.com/repos/istio/istio/issues/comments/422832904","html_url":"https://github.com/istio/istio/issues/8590#issuecomment-422832904","issue_url":"https://api.github.com/repos/istio/istio/issues/8590","id":422832904,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMjgzMjkwNA==","user":{"login":"gyliu513","id":4461983,"node_id":"MDQ6VXNlcjQ0NjE5ODM=","avatar_url":"https://avatars1.githubusercontent.com/u/4461983?v=4","gravatar_id":"","url":"https://api.github.com/users/gyliu513","html_url":"https://github.com/gyliu513","followers_url":"https://api.github.com/users/gyliu513/followers","following_url":"https://api.github.com/users/gyliu513/following{/other_user}","gists_url":"https://api.github.com/users/gyliu513/gists{/gist_id}","starred_url":"https://api.github.com/users/gyliu513/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gyliu513/subscriptions","organizations_url":"https://api.github.com/users/gyliu513/orgs","repos_url":"https://api.github.com/users/gyliu513/repos","events_url":"https://api.github.com/users/gyliu513/events{/privacy}","received_events_url":"https://api.github.com/users/gyliu513/received_events","type":"User","site_admin":false},"created_at":"2018-09-19T14:48:43Z","updated_at":"2018-09-19T14:48:43Z","author_association":"MEMBER","body":"> Is it possible this is caused by the fact you run with mixer first?\r\n\r\n@linsun what do you mean of `run with mixer first?`?"}}
{"actor":{"display_login":"gyliu513"}}