{"action":"created","issue":{"url":"https://api.github.com/repos/openshiftio/openshift.io/issues/609","repository_url":"https://api.github.com/repos/openshiftio/openshift.io","labels_url":"https://api.github.com/repos/openshiftio/openshift.io/issues/609/labels{/name}","comments_url":"https://api.github.com/repos/openshiftio/openshift.io/issues/609/comments","events_url":"https://api.github.com/repos/openshiftio/openshift.io/issues/609/events","html_url":"https://github.com/openshiftio/openshift.io/issues/609","id":251201138,"node_id":"MDU6SXNzdWUyNTEyMDExMzg=","number":609,"title":"[8](5) Performance tests for end to end consumption of user facing API","user":{"login":"krishnapaparaju","id":15967765,"node_id":"MDQ6VXNlcjE1OTY3NzY1","avatar_url":"https://avatars3.githubusercontent.com/u/15967765?v=4","gravatar_id":"","url":"https://api.github.com/users/krishnapaparaju","html_url":"https://github.com/krishnapaparaju","followers_url":"https://api.github.com/users/krishnapaparaju/followers","following_url":"https://api.github.com/users/krishnapaparaju/following{/other_user}","gists_url":"https://api.github.com/users/krishnapaparaju/gists{/gist_id}","starred_url":"https://api.github.com/users/krishnapaparaju/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/krishnapaparaju/subscriptions","organizations_url":"https://api.github.com/users/krishnapaparaju/orgs","repos_url":"https://api.github.com/users/krishnapaparaju/repos","events_url":"https://api.github.com/users/krishnapaparaju/events{/privacy}","received_events_url":"https://api.github.com/users/krishnapaparaju/received_events","type":"User","site_admin":false},"labels":[{"id":627758105,"node_id":"MDU6TGFiZWw2Mjc3NTgxMDU=","url":"https://api.github.com/repos/openshiftio/openshift.io/labels/area/analytics","name":"area/analytics","color":"fef2c0","default":false},{"id":632270958,"node_id":"MDU6TGFiZWw2MzIyNzA5NTg=","url":"https://api.github.com/repos/openshiftio/openshift.io/labels/area/architecture/performance","name":"area/architecture/performance","color":"fef2c0","default":false},{"id":637470943,"node_id":"MDU6TGFiZWw2Mzc0NzA5NDM=","url":"https://api.github.com/repos/openshiftio/openshift.io/labels/team/analytics","name":"team/analytics","color":"d4c5f9","default":false},{"id":675640870,"node_id":"MDU6TGFiZWw2NzU2NDA4NzA=","url":"https://api.github.com/repos/openshiftio/openshift.io/labels/team/analytics/integration","name":"team/analytics/integration","color":"d4c5f9","default":false},{"id":627758087,"node_id":"MDU6TGFiZWw2Mjc3NTgwODc=","url":"https://api.github.com/repos/openshiftio/openshift.io/labels/type/user-story","name":"type/user-story","color":"1d76db","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/openshiftio/openshift.io/milestones/9","html_url":"https://github.com/openshiftio/openshift.io/milestone/9","labels_url":"https://api.github.com/repos/openshiftio/openshift.io/milestones/9/labels","id":2706704,"node_id":"MDk6TWlsZXN0b25lMjcwNjcwNA==","number":9,"title":"Analytics Backlog","description":"","creator":{"login":"adisakala","id":16018556,"node_id":"MDQ6VXNlcjE2MDE4NTU2","avatar_url":"https://avatars2.githubusercontent.com/u/16018556?v=4","gravatar_id":"","url":"https://api.github.com/users/adisakala","html_url":"https://github.com/adisakala","followers_url":"https://api.github.com/users/adisakala/followers","following_url":"https://api.github.com/users/adisakala/following{/other_user}","gists_url":"https://api.github.com/users/adisakala/gists{/gist_id}","starred_url":"https://api.github.com/users/adisakala/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/adisakala/subscriptions","organizations_url":"https://api.github.com/users/adisakala/orgs","repos_url":"https://api.github.com/users/adisakala/repos","events_url":"https://api.github.com/users/adisakala/events{/privacy}","received_events_url":"https://api.github.com/users/adisakala/received_events","type":"User","site_admin":false},"open_issues":168,"closed_issues":122,"state":"open","created_at":"2017-08-17T08:19:48Z","updated_at":"2018-07-05T10:45:31Z","due_on":null,"closed_at":null},"comments":2,"created_at":"2017-08-18T10:13:42Z","updated_at":"2018-07-05T10:45:31Z","closed_at":"2018-07-05T10:45:31Z","author_association":"COLLABORATOR","body":"So far, there been performance tests done at individual components. End to end performance testing of the user API would need be instrumental in scaling the resources (which resources , how much to scale upto) as needed and calculate associated cost involved at infra. level\r\n\r\nAcceptance Criteria:\r\n\r\n- [x] SLA, throughput for Component analysis API / requests (for known component)\r\n- [x] SLA, throughput for Component analysis API / requests (for unknown component)\r\n- [x] SLA, throughput for Stack analysis API / requests (with stacks containing known components)\r\n- [ ] SLA, throughput for Stack analysis API / requests (with few of the stacks containing unknown components)\r\n- [ ] Calculate the log size across ONLINE part of OSIO analytics (MB) for the  throughput on user facing traffic\r\n- [ ] Calculate the log size across OFFLINE part of OSIO analytics (MB) for the  incremental data refresh\r\n\r\n# Actual results:\r\n\r\n## SLA criteria and results:\r\n\r\nShared with the team\r\n\r\n## Component analysis\r\n\r\nDuration of concurrent (parallel) component analysis:\r\nhttps://github.com/fabric8-analytics/fabric8-analytics.github.io/blob/master/perf-tests/jobs_api/flow_analysis/concurrent/jobs_flow_scheduling_1-18_threads.png\r\n\r\nDuration of component analytics steps (for selected components):\r\nhttps://github.com/fabric8-analytics/fabric8-analytics.github.io/blob/master/perf-tests/jobs_api/flow_analysis/pypi_clojure_py.png\r\n\r\n## Stack analysis\r\n\r\nResults for production:\r\nhttps://github.com/fabric8-analytics/fabric8-analytics.github.io/tree/master/perf-tests/core_api/stack_analysis/production\r\n\r\nAverage times:\r\nhttps://github.com/fabric8-analytics/fabric8-analytics.github.io/blob/master/perf-tests/core_api/stack_analysis/production/average_times.png\r\n\r\nMin+avg+max times:\r\nhttps://github.com/fabric8-analytics/fabric8-analytics.github.io/blob/master/perf-tests/core_api/stack_analysis/production/min_avg_max_times.png\r\n\r\n## Component analysis\r\nResults for production:\r\nhttps://fabric8-analytics.github.io/perf-tests/core_api/component_analysis/component_analysis.png\r\n\r\nMin+avg+max times:\r\nhttps://fabric8-analytics.github.io/perf-tests/core_api/component_analysis/component_analysis_min_max_avg_times.png\r\n\r\nParallel component analysis for known component:\r\nhttps://fabric8-analytics.github.io/perf-tests/core_api/component_analysis/component_analysis_parallel_calls_known_component.png\r\n\r\nParallel component analysis for unknown component:\r\nhttps://fabric8-analytics.github.io/perf-tests/core_api/component_analysis/component_analysis_parallel_calls_unknown_component.png\r\n\r\n\r\n\r\n## API calls benchmark\r\n\r\n### Jobs API\r\n\r\n### Stack API"},"comment":{"url":"https://api.github.com/repos/openshiftio/openshift.io/issues/comments/402682745","html_url":"https://github.com/openshiftio/openshift.io/issues/609#issuecomment-402682745","issue_url":"https://api.github.com/repos/openshiftio/openshift.io/issues/609","id":402682745,"node_id":"MDEyOklzc3VlQ29tbWVudDQwMjY4Mjc0NQ==","user":{"login":"miteshvp","id":17736013,"node_id":"MDQ6VXNlcjE3NzM2MDEz","avatar_url":"https://avatars2.githubusercontent.com/u/17736013?v=4","gravatar_id":"","url":"https://api.github.com/users/miteshvp","html_url":"https://github.com/miteshvp","followers_url":"https://api.github.com/users/miteshvp/followers","following_url":"https://api.github.com/users/miteshvp/following{/other_user}","gists_url":"https://api.github.com/users/miteshvp/gists{/gist_id}","starred_url":"https://api.github.com/users/miteshvp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/miteshvp/subscriptions","organizations_url":"https://api.github.com/users/miteshvp/orgs","repos_url":"https://api.github.com/users/miteshvp/repos","events_url":"https://api.github.com/users/miteshvp/events{/privacy}","received_events_url":"https://api.github.com/users/miteshvp/received_events","type":"User","site_admin":false},"created_at":"2018-07-05T10:45:31Z","updated_at":"2018-07-05T10:45:31Z","author_association":"COLLABORATOR","body":"Closing this issue as performance numbers are shared as mentioned in the document in previous comment."}}
{"actor":{"display_login":"miteshvp"}}