{"action":"created","issue":{"url":"https://api.github.com/repos/Illumina/happyR/issues/4","repository_url":"https://api.github.com/repos/Illumina/happyR","labels_url":"https://api.github.com/repos/Illumina/happyR/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/Illumina/happyR/issues/4/comments","events_url":"https://api.github.com/repos/Illumina/happyR/issues/4/events","html_url":"https://github.com/Illumina/happyR/issues/4","id":355335884,"node_id":"MDU6SXNzdWUzNTUzMzU4ODQ=","number":4,"title":"AUC","user":{"login":"ksw9","id":7399551,"node_id":"MDQ6VXNlcjczOTk1NTE=","avatar_url":"https://avatars3.githubusercontent.com/u/7399551?v=4","gravatar_id":"","url":"https://api.github.com/users/ksw9","html_url":"https://github.com/ksw9","followers_url":"https://api.github.com/users/ksw9/followers","following_url":"https://api.github.com/users/ksw9/following{/other_user}","gists_url":"https://api.github.com/users/ksw9/gists{/gist_id}","starred_url":"https://api.github.com/users/ksw9/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ksw9/subscriptions","organizations_url":"https://api.github.com/users/ksw9/orgs","repos_url":"https://api.github.com/users/ksw9/repos","events_url":"https://api.github.com/users/ksw9/events{/privacy}","received_events_url":"https://api.github.com/users/ksw9/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-08-29T21:14:10Z","updated_at":"2018-09-03T16:16:35Z","closed_at":null,"author_association":"NONE","body":"I'm wondering a best way to calculate AUC from a pr_curve created in the happyR package?\r\nThank you!"},"comment":{"url":"https://api.github.com/repos/Illumina/happyR/issues/comments/418155072","html_url":"https://github.com/Illumina/happyR/issues/4#issuecomment-418155072","issue_url":"https://api.github.com/repos/Illumina/happyR/issues/4","id":418155072,"node_id":"MDEyOklzc3VlQ29tbWVudDQxODE1NTA3Mg==","user":{"login":"blmoore","id":2961106,"node_id":"MDQ6VXNlcjI5NjExMDY=","avatar_url":"https://avatars0.githubusercontent.com/u/2961106?v=4","gravatar_id":"","url":"https://api.github.com/users/blmoore","html_url":"https://github.com/blmoore","followers_url":"https://api.github.com/users/blmoore/followers","following_url":"https://api.github.com/users/blmoore/following{/other_user}","gists_url":"https://api.github.com/users/blmoore/gists{/gist_id}","starred_url":"https://api.github.com/users/blmoore/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/blmoore/subscriptions","organizations_url":"https://api.github.com/users/blmoore/orgs","repos_url":"https://api.github.com/users/blmoore/repos","events_url":"https://api.github.com/users/blmoore/events{/privacy}","received_events_url":"https://api.github.com/users/blmoore/received_events","type":"User","site_admin":false},"created_at":"2018-09-03T16:16:35Z","updated_at":"2018-09-03T16:16:35Z","author_association":"MEMBER","body":"AuPR might not be very useful in this case — often just varying a quality cutoff won't span the entire range of recall so a good classifier could rank below a poor classifier whose PR curve is sampled along a broader range (e.g. caller 1 outputs variants with quality scores 30-60, caller 2 outputs them with 0-1000). If you still want to calculate this, there are various generic methods to integrate under a curve you could try.\r\n\r\nThe F<sub>1</sub> score as output by hap.py might be a more useful summary statistic."}}
{"actor":{"display_login":"blmoore"}}