{"action":"created","issue":{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/10362","repository_url":"https://api.github.com/repos/scikit-learn/scikit-learn","labels_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/10362/labels{/name}","comments_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/10362/comments","events_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/10362/events","html_url":"https://github.com/scikit-learn/scikit-learn/pull/10362","id":284303415,"number":10362,"title":"[WIP] Feature: Generic benchmarking/profiling tool","user":{"login":"vrishank97","id":14790428,"avatar_url":"https://avatars2.githubusercontent.com/u/14790428?v=4","gravatar_id":"","url":"https://api.github.com/users/vrishank97","html_url":"https://github.com/vrishank97","followers_url":"https://api.github.com/users/vrishank97/followers","following_url":"https://api.github.com/users/vrishank97/following{/other_user}","gists_url":"https://api.github.com/users/vrishank97/gists{/gist_id}","starred_url":"https://api.github.com/users/vrishank97/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vrishank97/subscriptions","organizations_url":"https://api.github.com/users/vrishank97/orgs","repos_url":"https://api.github.com/users/vrishank97/repos","events_url":"https://api.github.com/users/vrishank97/events{/privacy}","received_events_url":"https://api.github.com/users/vrishank97/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2017-12-23T12:12:02Z","updated_at":"2018-05-09T02:09:58Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/pulls/10362","html_url":"https://github.com/scikit-learn/scikit-learn/pull/10362","diff_url":"https://github.com/scikit-learn/scikit-learn/pull/10362.diff","patch_url":"https://github.com/scikit-learn/scikit-learn/pull/10362.patch"},"body":"### Reference Issues/PRs\r\nFixes #10289 \r\n\r\n### What does this implement/fix? Explain your changes.\r\nThis PR implements a generic benchmarking tool `sklearn.benchmark.benchmark_estimator_cost` .\r\nThe tool allows users to estimate runtime or space complexity of an estimator by fitting in on varied subsets of a particular input data, and then using a GaussianProcessRegressor to model the time used, peak memory and model_memory(The memory in use at the end of fitting, minus that at the beginning)\r\n\r\nThe PR is still a work in progress\r\n\r\n### TO-DO\r\n- [ ] Add code to stop a fit if time runs out\r\n- [x] Work on benchmarking memory\r\n- [x] Add code to log fit exceptions in errors dict\r\n- [ ] Add an example\r\n- [ ] Add tests"},"comment":{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/comments/387598286","html_url":"https://github.com/scikit-learn/scikit-learn/pull/10362#issuecomment-387598286","issue_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/10362","id":387598286,"user":{"login":"chang","id":16146623,"avatar_url":"https://avatars0.githubusercontent.com/u/16146623?v=4","gravatar_id":"","url":"https://api.github.com/users/chang","html_url":"https://github.com/chang","followers_url":"https://api.github.com/users/chang/followers","following_url":"https://api.github.com/users/chang/following{/other_user}","gists_url":"https://api.github.com/users/chang/gists{/gist_id}","starred_url":"https://api.github.com/users/chang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chang/subscriptions","organizations_url":"https://api.github.com/users/chang/orgs","repos_url":"https://api.github.com/users/chang/repos","events_url":"https://api.github.com/users/chang/events{/privacy}","received_events_url":"https://api.github.com/users/chang/received_events","type":"User","site_admin":false},"created_at":"2018-05-09T02:09:58Z","updated_at":"2018-05-09T02:09:58Z","author_association":"CONTRIBUTOR","body":"@vrishank97 Are you still working on this? I'd be interested in picking this up if you're open to it!"}}
{"actor":{"display_login":"chang"}}