{"action":"closed","issue":{"url":"https://api.github.com/repos/vistadataproject/VICSServer/issues/1","repository_url":"https://api.github.com/repos/vistadataproject/VICSServer","labels_url":"https://api.github.com/repos/vistadataproject/VICSServer/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/vistadataproject/VICSServer/issues/1/comments","events_url":"https://api.github.com/repos/vistadataproject/VICSServer/issues/1/events","html_url":"https://github.com/vistadataproject/VICSServer/issues/1","id":261158671,"number":1,"title":"Create Summary Report Generator for Benchmark Harness","user":{"login":"mfuroyama","id":728376,"avatar_url":"https://avatars0.githubusercontent.com/u/728376?v=4","gravatar_id":"","url":"https://api.github.com/users/mfuroyama","html_url":"https://github.com/mfuroyama","followers_url":"https://api.github.com/users/mfuroyama/followers","following_url":"https://api.github.com/users/mfuroyama/following{/other_user}","gists_url":"https://api.github.com/users/mfuroyama/gists{/gist_id}","starred_url":"https://api.github.com/users/mfuroyama/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mfuroyama/subscriptions","organizations_url":"https://api.github.com/users/mfuroyama/orgs","repos_url":"https://api.github.com/users/mfuroyama/repos","events_url":"https://api.github.com/users/mfuroyama/events{/privacy}","received_events_url":"https://api.github.com/users/mfuroyama/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-09-28T00:35:51Z","updated_at":"2018-03-22T01:28:19Z","closed_at":"2018-03-22T01:28:19Z","author_association":"OWNER","body":"## Background\r\nThe _benchmark.js_ currently runs a set of RPC objects through multiple RPC handler types (e.g. native, pass-thru, etc.) and saves a JSON file for each type. Each JSON file contains the RPC results and timing numbers generated by the individual handlers. The point of the _benchmark.js_ tool is determine overall runtime speeds for each RPC execution technique, and to compare and contrast the performance numbers between the techniques. To this end, we need a means to process and analyze the raw results generated by the tool into something human-readable and consumable for analysis.\r\n\r\n## Tasks\r\nBuild a report generator tool that takes the raw JSON output of the _benchmark.js_ tool and summarizes and compares the execution times of the various RPC handlers into a human-readable (i.e. Markdown) format. The report should be sectioned off with the following information:\r\n* Summary statistics for each RPC execution handler type:\r\n    * Mean, median, min/max, standard deviation\r\n* Performance benchmark comparisons between execution handler types:\r\n    * Overall\r\n    * Per RPC\r\n* Listing of the 95th percentile **slowest** execution times overall across all execution types:\r\n    * RPC name, elapsed time\r\n    * execution handler type\r\n"}}
{"actor":{"display_login":"mfuroyama"}}