{"action":"opened","issue":{"url":"https://api.github.com/repos/graphhopper/map-matching/issues/89","repository_url":"https://api.github.com/repos/graphhopper/map-matching","labels_url":"https://api.github.com/repos/graphhopper/map-matching/issues/89/labels{/name}","comments_url":"https://api.github.com/repos/graphhopper/map-matching/issues/89/comments","events_url":"https://api.github.com/repos/graphhopper/map-matching/issues/89/events","html_url":"https://github.com/graphhopper/map-matching/issues/89","id":195361680,"number":89,"title":"map matching 'quality' test suite","user":{"login":"kodonnell","id":8204904,"avatar_url":"https://avatars.githubusercontent.com/u/8204904?v=3","gravatar_id":"","url":"https://api.github.com/users/kodonnell","html_url":"https://github.com/kodonnell","followers_url":"https://api.github.com/users/kodonnell/followers","following_url":"https://api.github.com/users/kodonnell/following{/other_user}","gists_url":"https://api.github.com/users/kodonnell/gists{/gist_id}","starred_url":"https://api.github.com/users/kodonnell/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kodonnell/subscriptions","organizations_url":"https://api.github.com/users/kodonnell/orgs","repos_url":"https://api.github.com/users/kodonnell/repos","events_url":"https://api.github.com/users/kodonnell/events{/privacy}","received_events_url":"https://api.github.com/users/kodonnell/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-12-13T20:37:31Z","updated_at":"2016-12-13T20:37:31Z","closed_at":null,"body":"As discussed [here](https://github.com/graphhopper/map-matching/pull/83#issuecomment-266190993) it'd be good to have a way of testing how 'good' our map matching is by comparing it with known results. (I.e. our map-matching on a GPX track gives a certain route, and how close does that align to the actual known route taken?)\r\n\r\nConsiderations/comments (to direct a PR):\r\n\r\n- where do we get data of known routes? @stefanholder [pointed out](https://github.com/graphhopper/map-matching/pull/83#issuecomment-266392638) one example - do we want others? Do we want users to be able to test their own data sets?\r\n- we should see how map matching performs not only with the given GPX track, but also as we continually down-sample it.\r\n- how do we compare with the known route? Compare total distances of each? Or the proportion of the distance which they share common edges on?\r\n- how will we add this functionality? I think it is very similar to the Measurement suite (#73) in how it'll be used (and we could, I guess, put it in there if we wanted). Or we could build it into unit tests somehow (e.g. require that the match is sufficiently high.)\r\n- do we want to store historical trends in accuracy (as opposed to e.g. just comparing with the last commit) - and if so, how?\r\n"}}
{"actor":{"display_login":"kodonnell"}}