{"action":"created","issue":{"url":"https://api.github.com/repos/ngageoint/hootenanny/issues/171","repository_url":"https://api.github.com/repos/ngageoint/hootenanny","labels_url":"https://api.github.com/repos/ngageoint/hootenanny/issues/171/labels{/name}","comments_url":"https://api.github.com/repos/ngageoint/hootenanny/issues/171/comments","events_url":"https://api.github.com/repos/ngageoint/hootenanny/issues/171/events","html_url":"https://github.com/ngageoint/hootenanny/issues/171","id":123023832,"number":171,"title":"Cleaning input datasets more than once results in different output than if they are only cleaned once","user":{"login":"bwitham","id":303724,"avatar_url":"https://avatars.githubusercontent.com/u/303724?v=3","gravatar_id":"","url":"https://api.github.com/users/bwitham","html_url":"https://github.com/bwitham","followers_url":"https://api.github.com/users/bwitham/followers","following_url":"https://api.github.com/users/bwitham/following{/other_user}","gists_url":"https://api.github.com/users/bwitham/gists{/gist_id}","starred_url":"https://api.github.com/users/bwitham/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bwitham/subscriptions","organizations_url":"https://api.github.com/users/bwitham/orgs","repos_url":"https://api.github.com/users/bwitham/repos","events_url":"https://api.github.com/users/bwitham/events{/privacy}","received_events_url":"https://api.github.com/users/bwitham/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/ngageoint/hootenanny/labels/Category:%20Algorithms","name":"Category: Algorithms","color":"d4c5f9"},{"url":"https://api.github.com/repos/ngageoint/hootenanny/labels/Priority:%20Medium","name":"Priority: Medium","color":"fad8c7"},{"url":"https://api.github.com/repos/ngageoint/hootenanny/labels/Status:%20In%20Progress","name":"Status: In Progress","color":"eb6420"},{"url":"https://api.github.com/repos/ngageoint/hootenanny/labels/Type:%20Bug","name":"Type: Bug","color":"fef2c0"}],"state":"open","locked":false,"assignee":{"login":"bwitham","id":303724,"avatar_url":"https://avatars.githubusercontent.com/u/303724?v=3","gravatar_id":"","url":"https://api.github.com/users/bwitham","html_url":"https://github.com/bwitham","followers_url":"https://api.github.com/users/bwitham/followers","following_url":"https://api.github.com/users/bwitham/following{/other_user}","gists_url":"https://api.github.com/users/bwitham/gists{/gist_id}","starred_url":"https://api.github.com/users/bwitham/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bwitham/subscriptions","organizations_url":"https://api.github.com/users/bwitham/orgs","repos_url":"https://api.github.com/users/bwitham/repos","events_url":"https://api.github.com/users/bwitham/events{/privacy}","received_events_url":"https://api.github.com/users/bwitham/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/ngageoint/hootenanny/milestones/7","html_url":"https://github.com/ngageoint/hootenanny/milestones/Hootenanny%202016-02-17","labels_url":"https://api.github.com/repos/ngageoint/hootenanny/milestones/7/labels","id":1556601,"number":7,"title":"Hootenanny 2016-02-17","description":"Tracking milestone for version 2.23","creator":{"login":"bwitham","id":303724,"avatar_url":"https://avatars.githubusercontent.com/u/303724?v=3","gravatar_id":"","url":"https://api.github.com/users/bwitham","html_url":"https://github.com/bwitham","followers_url":"https://api.github.com/users/bwitham/followers","following_url":"https://api.github.com/users/bwitham/following{/other_user}","gists_url":"https://api.github.com/users/bwitham/gists{/gist_id}","starred_url":"https://api.github.com/users/bwitham/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bwitham/subscriptions","organizations_url":"https://api.github.com/users/bwitham/orgs","repos_url":"https://api.github.com/users/bwitham/repos","events_url":"https://api.github.com/users/bwitham/events{/privacy}","received_events_url":"https://api.github.com/users/bwitham/received_events","type":"User","site_admin":false},"open_issues":24,"closed_issues":0,"state":"open","created_at":"2016-02-01T19:37:33Z","updated_at":"2016-02-03T23:08:16Z","due_on":"2016-02-17T05:00:00Z","closed_at":null},"comments":4,"created_at":"2015-12-18T20:49:58Z","updated_at":"2016-02-04T18:19:23Z","closed_at":null,"body":"r5629\r\n\r\nThis shouldn't happen.  The results of cleaning should be the same no matter how many times the data is cleaned.\r\n\r\nhoot score-matches -C conf/LinearWaterway.conf --confusion /.../gis-data/northcom/united-states/san-diego/rivers/SanDiego_waterways_NHD_REF1-cropped-2.osm /.../gis-data/northcom/united-states/san-diego/rivers/SanDiego_waterways_OSM_REF2-cropped-2.osm tmp/Test1.osm\r\n\r\nFor the above, as of this writing you will get about 20% incorrect.\r\n\r\nhoot cleanup /.../gis-data/northcom/united-states/san-diego/rivers/SanDiego_waterways_NHD_REF1-cropped-2.osm /tmp/Cleaned1.osm\r\nhoot cleanup /.../gis-data/northcom/united-states/san-diego/rivers/SanDiego_waterways_OSM_REF2-cropped-2.osm /tmp/Cleaned2.osm\r\nhoot score-matches -C conf/LinearWaterway.conf --confusion tmp/Cleaned1.osm tmp/Cleaned2.osm tmp/Test2.osm\r\n\r\nFor the above, as of this writing you will get about 43% incorrect.\r\n\r\nIt seems as if you should get the same scores whether the input data is cleaned separately beforehand or not.\r\n\r\n---\r\n\r\nThis test also appears to be suffering from this problem:\r\n\r\n hoot-tests/model-training.child/train-highways.child - Test1BOld.osm\r\n\r\nPlease verify that whatever fix applies to this bug also improves Test1BOld. Test1BOld gets a score of .766 when cleaning in MapPreparer and a score of .720 when cleaned before the MapPreparer.\r\n"},"comment":{"url":"https://api.github.com/repos/ngageoint/hootenanny/issues/comments/179979268","html_url":"https://github.com/ngageoint/hootenanny/issues/171#issuecomment-179979268","issue_url":"https://api.github.com/repos/ngageoint/hootenanny/issues/171","id":179979268,"user":{"login":"bwitham","id":303724,"avatar_url":"https://avatars.githubusercontent.com/u/303724?v=3","gravatar_id":"","url":"https://api.github.com/users/bwitham","html_url":"https://github.com/bwitham","followers_url":"https://api.github.com/users/bwitham/followers","following_url":"https://api.github.com/users/bwitham/following{/other_user}","gists_url":"https://api.github.com/users/bwitham/gists{/gist_id}","starred_url":"https://api.github.com/users/bwitham/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bwitham/subscriptions","organizations_url":"https://api.github.com/users/bwitham/orgs","repos_url":"https://api.github.com/users/bwitham/repos","events_url":"https://api.github.com/users/bwitham/events{/privacy}","received_events_url":"https://api.github.com/users/bwitham/received_events","type":"User","site_admin":false},"created_at":"2016-02-04T18:19:23Z","updated_at":"2016-02-04T18:19:23Z","body":"Interesting, though, that when setting up a test to check for identical output for multiple invocations of each cleaning op on the same data UnlikelyIntersectionRemover passes the test, but DuplicateWayRemover does not."}}