{"action":"created","issue":{"url":"https://api.github.com/repos/ilastik/ilastik-feature-selection/issues/1","repository_url":"https://api.github.com/repos/ilastik/ilastik-feature-selection","labels_url":"https://api.github.com/repos/ilastik/ilastik-feature-selection/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/ilastik/ilastik-feature-selection/issues/1/comments","events_url":"https://api.github.com/repos/ilastik/ilastik-feature-selection/issues/1/events","html_url":"https://github.com/ilastik/ilastik-feature-selection/issues/1","id":164444597,"number":1,"title":"Unit tests fail","user":{"login":"stuarteberg","id":1655821,"avatar_url":"https://avatars.githubusercontent.com/u/1655821?v=3","gravatar_id":"","url":"https://api.github.com/users/stuarteberg","html_url":"https://github.com/stuarteberg","followers_url":"https://api.github.com/users/stuarteberg/followers","following_url":"https://api.github.com/users/stuarteberg/following{/other_user}","gists_url":"https://api.github.com/users/stuarteberg/gists{/gist_id}","starred_url":"https://api.github.com/users/stuarteberg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/stuarteberg/subscriptions","organizations_url":"https://api.github.com/users/stuarteberg/orgs","repos_url":"https://api.github.com/users/stuarteberg/repos","events_url":"https://api.github.com/users/stuarteberg/events{/privacy}","received_events_url":"https://api.github.com/users/stuarteberg/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-07-08T01:57:57Z","updated_at":"2016-07-08T13:03:32Z","closed_at":null,"body":"[Apparently](https://github.com/ilastik/ilastik/pull/1161#issuecomment-194390951) the unit tests in this repo used to pass, but now I'm seeing failures.  Are we concerned about that?\r\n\r\nHere's the test log I get.  (The tests take a really long time to run, so I stopped them early, hence the `^C` from when I hit `Ctrl+C`.)\r\n\r\nping: @akreshuk @FabianIsensee\r\n\r\n```\r\n+ nosetests .\r\n..........F..FF^C\r\n======================================================================\r\nFAIL: test_initial_set (test_wrapper_selection.TestWrapperMethod)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/miniconda/conda-bld/work/tests/test_wrapper_selection.py\", line 96, in test_initial_set\r\n    53]))\r\nAssertionError: Items in the first set but not the second:\r\n35\r\n36\r\n37\r\n38\r\n45\r\n51\r\n20\r\n54\r\n23\r\n26\r\nItems in the second set but not the first:\r\n33\r\n43\r\n53\r\n-------------------- >> begin captured logging << --------------------\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 21])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 0.915250, overall best score is 0.749500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 21])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 21, 27])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.001000, overall best score is 0.915250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 21, 27])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 35, 21, 27])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.044750, overall best score is 1.001000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 35, 21, 27])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 42, 35, 21, 27])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.066500, overall best score is 1.044750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 42, 35, 21, 27])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 42, 18, 35, 21, 27])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.084250, overall best score is 1.066500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 42, 18, 35, 21, 27])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 42, 45, 18, 35, 21, 27])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.118000, overall best score is 1.084250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 27, 35, 42, 45])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 26, 27, 35, 42, 45])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.113750, overall best score is 1.118000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: best set has not changed in 1 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 27, 35, 42, 45])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 26, 27, 35, 37, 42, 45])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.127500, overall best score is 1.118000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 26, 27, 35, 37, 42, 45])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 26, 27, 35, 37, 42, 45, 51])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.123250, overall best score is 1.127500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: best set has not changed in 1 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 26, 27, 35, 37, 42, 45])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 26, 27, 35, 37, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.135000, overall best score is 1.127500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 26, 27, 35, 37, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 26, 27, 35, 36, 37, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.130750, overall best score is 1.135000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: best set has not changed in 1 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 21, 26, 27, 35, 37, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 26, 27, 35, 36, 37, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.140500, overall best score is 1.135000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 26, 27, 35, 36, 37, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 35, 36, 37, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.134250, overall best score is 1.140500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: best set has not changed in 1 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 26, 27, 35, 36, 37, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 35, 36, 37, 38, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.128000, overall best score is 1.140500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: best set has not changed in 2 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 26, 27, 35, 36, 37, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 30, 35, 36, 37, 38, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.143750, overall best score is 1.140500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 30, 35, 36, 37, 38, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 30, 35, 36, 37, 38, 42, 45, 51, 54, 58])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.125500, overall best score is 1.143750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: best set has not changed in 1 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 30, 35, 36, 37, 38, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 30, 31, 35, 36, 37, 38, 42, 45, 51, 54, 58])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.123250, overall best score is 1.143750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: best set has not changed in 2 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 30, 35, 36, 37, 38, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 30, 31, 35, 36, 37, 38, 42, 44, 45, 51, 54, 58])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.127000, overall best score is 1.143750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: best set has not changed in 3 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best feature set set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 30, 35, 36, 37, 38, 42, 45, 51, 54])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: curr set is now: set([0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 18, 20, 21, 23, 26, 27, 30, 31, 35, 36, 37, 38, 39, 42, 44, 45, 51, 54, 58])\r\nilastik_feature_selection.wrapper_feature_selection: INFO: local best score is 1.130750, overall best score is 1.143750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: best set has not changed in 4 iterations\r\n--------------------- >> end captured logging << ---------------------\r\n\r\n======================================================================\r\nFAIL: test_wrapper_BFS_adv (test_wrapper_selection.TestWrapperMethod)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/miniconda/conda-bld/work/tests/test_wrapper_selection.py\", line 33, in test_wrapper_BFS_adv\r\n    self.assertEqual(a[1], 1.2064999999999999)\r\nAssertionError: 1.2090000000000001 != 1.2065\r\n-------------------- >> begin captured logging << --------------------\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([]) with score -inf\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([20]) \t score: 0.669750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best node thanks to compound operators\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best node thanks to compound operators\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best node thanks to compound operators\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best node thanks to compound operators\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best node thanks to compound operators\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best node thanks to compound operators\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best node thanks to compound operators\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best node thanks to compound operators\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best node thanks to compound operators\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 44, 46, 19, 20, 21, 54, 58, 29]) with score 1.147500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 42, 43, 44, 46, 19, 20, 21, 54, 58, 29]) \t score: 1.163250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 46, 19, 20, 21, 54, 58, 29]) with score 1.163250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 42, 43, 44, 46, 19, 20, 21, 54, 58, 27, 29]) \t score: 1.175000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 46, 19, 20, 21, 54, 58, 27, 29]) with score 1.175000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 42, 43, 44, 46, 20, 21, 54, 58, 27, 29]) \t score: 1.179250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 46, 20, 21, 54, 58, 27, 29]) with score 1.179250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 42, 43, 44, 46, 20, 21, 54, 58, 27, 29, 30]) \t score: 1.183000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 46, 20, 21, 54, 58, 27, 29, 30]) with score 1.183000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 42, 43, 44, 46, 20, 21, 54, 58, 27, 30]) \t score: 1.185250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 46, 20, 21, 54, 58, 27, 30]) with score 1.185250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 42, 43, 44, 46, 20, 21, 54, 58, 27, 26, 30]) \t score: 1.193000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 46, 20, 21, 54, 58, 27, 26, 30]) with score 1.193000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 38, 42, 43, 44, 46, 20, 21, 54, 58, 27, 26, 30]) \t score: 1.194750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 38, 42, 43, 44, 46, 20, 21, 54, 58, 27, 26, 30]) with score 1.194750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 38, 42, 43, 44, 46, 20, 21, 54, 24, 58, 27, 26, 30]) \t score: 1.200500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 38, 42, 43, 44, 46, 20, 21, 54, 24, 58, 27, 26, 30]) with score 1.200500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 1 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 38, 42, 43, 44, 46, 20, 21, 54, 24, 58, 27, 26, 30]) with score 1.200500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 2 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 38, 42, 43, 44, 46, 20, 21, 54, 24, 58, 27, 26, 30]) with score 1.200500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 42, 43, 44, 20, 21, 54, 62, 58, 27, 26, 30]) \t score: 1.209000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 20, 21, 54, 62, 58, 27, 26, 30]) with score 1.209000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 1 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 20, 21, 54, 62, 58, 27, 26, 30]) with score 1.209000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 2 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 20, 21, 54, 62, 58, 27, 26, 30]) with score 1.209000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 3 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 42, 43, 44, 20, 21, 54, 62, 58, 27, 26, 30]) with score 1.209000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 4 iterations\r\n--------------------- >> end captured logging << ---------------------\r\n\r\n======================================================================\r\nFAIL: test_wrapper_BFS_no_adv (test_wrapper_selection.TestWrapperMethod)\r\n----------------------------------------------------------------------\r\nTraceback (most recent call last):\r\n  File \"/miniconda/conda-bld/work/tests/test_wrapper_selection.py\", line 21, in test_wrapper_BFS_no_adv\r\n    self.assertEqual(a[1], 1.1995)\r\nAssertionError: 1.2075 != 1.1995\r\n-------------------- >> begin captured logging << --------------------\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([]) with score -inf\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([20]) \t score: 0.669750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([20]) with score 0.669750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([20, 30]) \t score: 0.761500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([20, 30]) with score 0.761500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([43, 20, 30]) \t score: 0.881250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([43, 20, 30]) with score 0.881250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 43, 20, 30]) \t score: 1.003000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 43, 20, 30]) with score 1.003000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([27, 34, 43, 20, 30]) \t score: 1.062750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([27, 34, 43, 20, 30]) with score 1.062750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 36, 43, 20, 27, 30]) \t score: 1.110500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 36, 43, 20, 27, 30]) with score 1.110500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 27, 36, 21, 20, 43, 30]) \t score: 1.128250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 27, 36, 21, 20, 43, 30]) with score 1.128250\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 43, 36, 21, 20, 27, 30, 5]) \t score: 1.164000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 43, 36, 21, 20, 27, 30, 5]) with score 1.164000\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 36, 5, 10, 43, 20, 21, 27, 30]) \t score: 1.193750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 36, 5, 10, 43, 20, 21, 27, 30]) with score 1.193750\r\nilastik_feature_selection.wrapper_feature_selection: INFO: updated best feature set: set([34, 36, 5, 10, 43, 20, 21, 23, 27, 30]) \t score: 1.207500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 36, 5, 10, 43, 20, 21, 23, 27, 30]) with score 1.207500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 1 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 36, 5, 10, 43, 20, 21, 23, 27, 30]) with score 1.207500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 2 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 36, 5, 10, 43, 20, 21, 23, 27, 30]) with score 1.207500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 3 iterations\r\nilastik_feature_selection.wrapper_feature_selection: INFO: current best set: set([34, 36, 5, 10, 43, 20, 21, 23, 27, 30]) with score 1.207500\r\nilastik_feature_selection.wrapper_feature_selection: INFO: The feature set has not been updated in the last 4 iterations\r\n--------------------- >> end captured logging << ---------------------\r\n\r\nTraceback (most recent call last):\r\n  File \"/miniconda/bin/conda-build\", line 5, in <module>\r\n----------------------------------------------------------------------\r\nRan 16 tests in 906.054s\r\n\r\nFAILED (failures=3)\r\n```"},"comment":{"url":"https://api.github.com/repos/ilastik/ilastik-feature-selection/issues/comments/231353717","html_url":"https://github.com/ilastik/ilastik-feature-selection/issues/1#issuecomment-231353717","issue_url":"https://api.github.com/repos/ilastik/ilastik-feature-selection/issues/1","id":231353717,"user":{"login":"FabianIsensee","id":11302164,"avatar_url":"https://avatars.githubusercontent.com/u/11302164?v=3","gravatar_id":"","url":"https://api.github.com/users/FabianIsensee","html_url":"https://github.com/FabianIsensee","followers_url":"https://api.github.com/users/FabianIsensee/followers","following_url":"https://api.github.com/users/FabianIsensee/following{/other_user}","gists_url":"https://api.github.com/users/FabianIsensee/gists{/gist_id}","starred_url":"https://api.github.com/users/FabianIsensee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/FabianIsensee/subscriptions","organizations_url":"https://api.github.com/users/FabianIsensee/orgs","repos_url":"https://api.github.com/users/FabianIsensee/repos","events_url":"https://api.github.com/users/FabianIsensee/events{/privacy}","received_events_url":"https://api.github.com/users/FabianIsensee/received_events","type":"User","site_admin":false},"created_at":"2016-07-08T13:03:31Z","updated_at":"2016-07-08T13:03:31Z","body":"There is no automated way but you should be able to run the code from \nthe tests and get the result it expects (see \nhttps://github.com/ilastik/ilastik-feature-selection/blob/master/tests/test_wrapper_selection.py). \nJust open an IPython shell and run what you need. It should not be much code\nHere is an example for test_wrapper_BFS_no_adv\n\n/import sys//\n//import utils//\n//import numpy as np//\n//import ilastik_feature_selection//\n//import sklearn//\n//import unittest//\n//import os//\n//import logging//\n//\n//rf = sklearn.ensemble.RandomForestClassifier(random_state = 14271, \nn_estimators = 10)//\n//X = np.load(os.path.dirname(os.path.realpath(__file__)) \n+\"/digits_data.npy\")//\n//Y = np.load(os.path.dirname(os.path.realpath(__file__)) \n+\"/digits_target.npy\")//\n//\n//eval_fct = \nilastik_feature_selection.wrapper_feature_selection.EvaluationFunction(rf, \ncomplexity_penalty=0.4)//\n//feat_selector = \nilastik_feature_selection.wrapper_feature_selection.WrapperFeatureSelection(X, \nY,  eval_fct.evaluate_feature_set_size_penalty, method=\"BFS\")//\n//a = feat_selector.run(do_advanced_search=False)/\n\n(make sure that the path to the .npy arrays is correct. You can find the \nfiles here: \nhttps://github.com/ilastik/ilastik-feature-selection/tree/master/tests)\n\nThe test expects:\n/self.assertEqual(a[1], 1.1995)//\n//self.assertEqual(set(a[0]), set([10, 13, 20, 29, 35, 37, 42, 44, 51, \n53]))/\n\nThese are the lines that need to be updated.\n\nCheers,\n\nFabian\n\n\n\nOn 08.07.2016 14:57, Stuart Berg wrote:\n>\n> OK, that makes sense. I upgraded to scikit-learn 0.17.1. Is there an \n> automated way to generate the new \"expected\" results and update the \n> test suite?\n>\n> —\n> You are receiving this because you were mentioned.\n> Reply to this email directly, view it on GitHub \n> <https://github.com/ilastik/ilastik-feature-selection/issues/1#issuecomment-231352552>, \n> or mute the thread \n> <https://github.com/notifications/unsubscribe/AKx1FBxnuQUM0Zu5Zf-NJ8fSns-ipkj9ks5qTklSgaJpZM4JHqNb>.\n>\n\n"}}
{"actor":{"display_login":"FabianIsensee"}}