{"action":"created","issue":{"url":"https://api.github.com/repos/ai-se/activeconfig/issues/48","repository_url":"https://api.github.com/repos/ai-se/activeconfig","labels_url":"https://api.github.com/repos/ai-se/activeconfig/issues/48/labels{/name}","comments_url":"https://api.github.com/repos/ai-se/activeconfig/issues/48/comments","events_url":"https://api.github.com/repos/ai-se/activeconfig/issues/48/events","html_url":"https://github.com/ai-se/activeconfig/issues/48","id":139079297,"number":48,"title":"planning next steps","user":{"login":"timm","id":29195,"avatar_url":"https://avatars.githubusercontent.com/u/29195?v=3","gravatar_id":"","url":"https://api.github.com/users/timm","html_url":"https://github.com/timm","followers_url":"https://api.github.com/users/timm/followers","following_url":"https://api.github.com/users/timm/following{/other_user}","gists_url":"https://api.github.com/users/timm/gists{/gist_id}","starred_url":"https://api.github.com/users/timm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/timm/subscriptions","organizations_url":"https://api.github.com/users/timm/orgs","repos_url":"https://api.github.com/users/timm/repos","events_url":"https://api.github.com/users/timm/events{/privacy}","received_events_url":"https://api.github.com/users/timm/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"vivekaxl","id":6147456,"avatar_url":"https://avatars.githubusercontent.com/u/6147456?v=3","gravatar_id":"","url":"https://api.github.com/users/vivekaxl","html_url":"https://github.com/vivekaxl","followers_url":"https://api.github.com/users/vivekaxl/followers","following_url":"https://api.github.com/users/vivekaxl/following{/other_user}","gists_url":"https://api.github.com/users/vivekaxl/gists{/gist_id}","starred_url":"https://api.github.com/users/vivekaxl/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vivekaxl/subscriptions","organizations_url":"https://api.github.com/users/vivekaxl/orgs","repos_url":"https://api.github.com/users/vivekaxl/repos","events_url":"https://api.github.com/users/vivekaxl/events{/privacy}","received_events_url":"https://api.github.com/users/vivekaxl/received_events","type":"User","site_admin":false},"milestone":null,"comments":2,"created_at":"2016-03-07T20:04:25Z","updated_at":"2016-03-07T21:16:34Z","closed_at":null,"body":"![image](https://cloud.githubusercontent.com/assets/29195/13581290/32840eb4-e474-11e5-9650-e6bb711f5bdc.png)\r\n\r\n# Questions:\r\n\r\n- [ ] so we've seen some of thse before? like x264 llvm and BDBC and BDBJ?\r\n- [ ] where's sqllite?\r\n- [ ] is there a feature model available for all? (so we know what are illegal mutants)?\r\n- [ ] there are only 3 with multi-objectives ?\r\n   - hSMGP: 3\r\n   - TriMashL 3\r\n   - x264: 8\r\n- [ ]  should we ignore the small ones with single goal. So ignore Clasp,  Lrzip, Apache, BDB-J?\r\n\r\n# To do (Proposed)\r\n\r\n-  Implement Vivek's next trick \r\n           - sort the clusters found by WHAT according to the distances within each cluster, \r\n           - iteratively sample, in order of the ones with lowest variance on that measure\r\n           - stop sampling when no improvement on a CART model built from 30 labelled instances\r\n                            - this is just a heuristic assessment tree, \r\n                            - no promises here that such a tree will perform well in an absolute sense\r\n                            - but current experiments show that such a tree can work well in a  relative sense in that in can serve to detect when new samples do not improve score from older samples.\r\n           - experiments with current data show that this approach can sample less than the FSE paper are result in estimates with no worse mean error but much less variance.\r\n\r\n- apply the  new trick to  single objective that we have not tried before. note that this might be enough for a journal-level extension to an accepted FSE paper.\r\n             - [ ] Java GC\r\n             -  [ ] AJstats\r\n             -  [ ] HIPA\r\n             - [ ] Dune\r\n             - [ ] and not BDBC, LLVM (done before)\r\n\r\n- then we go multi-goal optimization (whole new round of papers)\r\n            - [ ] TriMash-MG\r\n            -  [ ] x264 \r\n            - [ ] HSMGP\r\n"},"comment":{"url":"https://api.github.com/repos/ai-se/activeconfig/issues/comments/193453972","html_url":"https://github.com/ai-se/activeconfig/issues/48#issuecomment-193453972","issue_url":"https://api.github.com/repos/ai-se/activeconfig/issues/48","id":193453972,"user":{"login":"timm","id":29195,"avatar_url":"https://avatars.githubusercontent.com/u/29195?v=3","gravatar_id":"","url":"https://api.github.com/users/timm","html_url":"https://github.com/timm","followers_url":"https://api.github.com/users/timm/followers","following_url":"https://api.github.com/users/timm/following{/other_user}","gists_url":"https://api.github.com/users/timm/gists{/gist_id}","starred_url":"https://api.github.com/users/timm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/timm/subscriptions","organizations_url":"https://api.github.com/users/timm/orgs","repos_url":"https://api.github.com/users/timm/repos","events_url":"https://api.github.com/users/timm/events{/privacy}","received_events_url":"https://api.github.com/users/timm/received_events","type":"User","site_admin":false},"created_at":"2016-03-07T21:16:34Z","updated_at":"2016-03-07T21:16:34Z","body":"@vivekaxl \r\nany comment on the above? a more pragmatic ordering? any halfway steps i missed above?\r\n\r\n@svenapel \r\n> Currently, yes. But recently we bought advanced energy measurement equipment...\r\nvery cool. now i'm a little nervous of an 8 goal problem. are then (small) N number of most used energy measures? turn all our problems into N goals?\r\n\r\n"}}