{"action":"created","issue":{"url":"https://api.github.com/repos/craffel/mir_eval/issues/167","repository_url":"https://api.github.com/repos/craffel/mir_eval","labels_url":"https://api.github.com/repos/craffel/mir_eval/issues/167/labels{/name}","comments_url":"https://api.github.com/repos/craffel/mir_eval/issues/167/comments","events_url":"https://api.github.com/repos/craffel/mir_eval/issues/167/events","html_url":"https://github.com/craffel/mir_eval/issues/167","id":131399231,"number":167,"title":"Transcription metrics","user":{"login":"justinsalamon","id":3009670,"avatar_url":"https://avatars.githubusercontent.com/u/3009670?v=3","gravatar_id":"","url":"https://api.github.com/users/justinsalamon","html_url":"https://github.com/justinsalamon","followers_url":"https://api.github.com/users/justinsalamon/followers","following_url":"https://api.github.com/users/justinsalamon/following{/other_user}","gists_url":"https://api.github.com/users/justinsalamon/gists{/gist_id}","starred_url":"https://api.github.com/users/justinsalamon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/justinsalamon/subscriptions","organizations_url":"https://api.github.com/users/justinsalamon/orgs","repos_url":"https://api.github.com/users/justinsalamon/repos","events_url":"https://api.github.com/users/justinsalamon/events{/privacy}","received_events_url":"https://api.github.com/users/justinsalamon/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/craffel/mir_eval/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"open","locked":false,"assignee":{"login":"justinsalamon","id":3009670,"avatar_url":"https://avatars.githubusercontent.com/u/3009670?v=3","gravatar_id":"","url":"https://api.github.com/users/justinsalamon","html_url":"https://github.com/justinsalamon","followers_url":"https://api.github.com/users/justinsalamon/followers","following_url":"https://api.github.com/users/justinsalamon/following{/other_user}","gists_url":"https://api.github.com/users/justinsalamon/gists{/gist_id}","starred_url":"https://api.github.com/users/justinsalamon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/justinsalamon/subscriptions","organizations_url":"https://api.github.com/users/justinsalamon/orgs","repos_url":"https://api.github.com/users/justinsalamon/repos","events_url":"https://api.github.com/users/justinsalamon/events{/privacy}","received_events_url":"https://api.github.com/users/justinsalamon/received_events","type":"User","site_admin":false},"milestone":null,"comments":29,"created_at":"2016-02-04T16:24:09Z","updated_at":"2016-02-13T21:08:43Z","closed_at":null,"body":"I think it'd be awesome for ```mir_eval``` to have metrics for evaluating automatic transcription (i.e. comparing two sets of symbolic notes). There's a relatively large number of people working on this problem in MIR, so I think such a module would very much come in handy.\r\n\r\nSince I need this for some of my own work (ehm ehm), I'm happy to take a first stab at this.\r\n\r\nAs far as existing tools there's Emilio Molina's [matlab framework](http://www.terasoft.com.tw/conf/ismir2014/proceedings/T102_298_Paper.pdf) which has a fairly extensive set of metrics in it. For a first iteration though I'd stick to a widely used subset of metrics as defined in [Bello, 2003](https://qmro.qmul.ac.uk/xmlui/handle/123456789/3803); [Ryynänen & Klapuri, 2008](http://dl.acm.org/citation.cfm?id=1403132); and [Salamon, 2013](http://www.justinsalamon.com/phd-thesis.html) (page 186)."},"comment":{"url":"https://api.github.com/repos/craffel/mir_eval/issues/comments/183754994","html_url":"https://github.com/craffel/mir_eval/issues/167#issuecomment-183754994","issue_url":"https://api.github.com/repos/craffel/mir_eval/issues/167","id":183754994,"user":{"login":"justinsalamon","id":3009670,"avatar_url":"https://avatars.githubusercontent.com/u/3009670?v=3","gravatar_id":"","url":"https://api.github.com/users/justinsalamon","html_url":"https://github.com/justinsalamon","followers_url":"https://api.github.com/users/justinsalamon/followers","following_url":"https://api.github.com/users/justinsalamon/following{/other_user}","gists_url":"https://api.github.com/users/justinsalamon/gists{/gist_id}","starred_url":"https://api.github.com/users/justinsalamon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/justinsalamon/subscriptions","organizations_url":"https://api.github.com/users/justinsalamon/orgs","repos_url":"https://api.github.com/users/justinsalamon/repos","events_url":"https://api.github.com/users/justinsalamon/events{/privacy}","received_events_url":"https://api.github.com/users/justinsalamon/received_events","type":"User","site_admin":false},"created_at":"2016-02-13T21:08:43Z","updated_at":"2016-02-13T21:08:43Z","body":"I can ask"}}