{"action":"created","issue":{"url":"https://api.github.com/repos/kubeflow/kubeflow/issues/596","repository_url":"https://api.github.com/repos/kubeflow/kubeflow","labels_url":"https://api.github.com/repos/kubeflow/kubeflow/issues/596/labels{/name}","comments_url":"https://api.github.com/repos/kubeflow/kubeflow/issues/596/comments","events_url":"https://api.github.com/repos/kubeflow/kubeflow/issues/596/events","html_url":"https://github.com/kubeflow/kubeflow/issues/596","id":311850132,"number":596,"title":"Benchmarking TF and other frameworks","user":{"login":"jlewi","id":777219,"avatar_url":"https://avatars3.githubusercontent.com/u/777219?v=4","gravatar_id":"","url":"https://api.github.com/users/jlewi","html_url":"https://github.com/jlewi","followers_url":"https://api.github.com/users/jlewi/followers","following_url":"https://api.github.com/users/jlewi/following{/other_user}","gists_url":"https://api.github.com/users/jlewi/gists{/gist_id}","starred_url":"https://api.github.com/users/jlewi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jlewi/subscriptions","organizations_url":"https://api.github.com/users/jlewi/orgs","repos_url":"https://api.github.com/users/jlewi/repos","events_url":"https://api.github.com/users/jlewi/events{/privacy}","received_events_url":"https://api.github.com/users/jlewi/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":8,"created_at":"2018-04-06T05:13:44Z","updated_at":"2018-04-06T12:11:58Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"Benchmarking has come up in a couple contexts so opening up this issue.\r\n\r\nAt a high level we'd like to do something like the following\r\n\r\n- Run a bunch of different configurations (e.g. single GPU, multiple GPU, distributed)\r\n- for different frameworks (e.g. TF, PyTorch)\r\n- And different versions of the framework\r\n- on different problems / datasets\r\n\r\nWe'd like to run these tests regularly and then dump them to a DB from which we can create dashboards.\r\n\r\nFirst step would probably to be create a proposal of what this would look like. "},"comment":{"url":"https://api.github.com/repos/kubeflow/kubeflow/issues/comments/379234735","html_url":"https://github.com/kubeflow/kubeflow/issues/596#issuecomment-379234735","issue_url":"https://api.github.com/repos/kubeflow/kubeflow/issues/596","id":379234735,"user":{"login":"bhack","id":1710528,"avatar_url":"https://avatars0.githubusercontent.com/u/1710528?v=4","gravatar_id":"","url":"https://api.github.com/users/bhack","html_url":"https://github.com/bhack","followers_url":"https://api.github.com/users/bhack/followers","following_url":"https://api.github.com/users/bhack/following{/other_user}","gists_url":"https://api.github.com/users/bhack/gists{/gist_id}","starred_url":"https://api.github.com/users/bhack/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bhack/subscriptions","organizations_url":"https://api.github.com/users/bhack/orgs","repos_url":"https://api.github.com/users/bhack/repos","events_url":"https://api.github.com/users/bhack/events{/privacy}","received_events_url":"https://api.github.com/users/bhack/received_events","type":"User","site_admin":false},"created_at":"2018-04-06T12:11:58Z","updated_at":"2018-04-06T12:11:58Z","author_association":"NONE","body":"/cc @psyhtest "}}
{"actor":{"display_login":"bhack"}}