{"action":"closed","issue":{"url":"https://api.github.com/repos/zooniverse/aggregation/issues/100","repository_url":"https://api.github.com/repos/zooniverse/aggregation","labels_url":"https://api.github.com/repos/zooniverse/aggregation/issues/100/labels{/name}","comments_url":"https://api.github.com/repos/zooniverse/aggregation/issues/100/comments","events_url":"https://api.github.com/repos/zooniverse/aggregation/issues/100/events","html_url":"https://github.com/zooniverse/aggregation/issues/100","id":126652689,"number":100,"title":"aggregations of question tasks should include all p values for possible answers","user":{"login":"vrooje","id":2357126,"avatar_url":"https://avatars.githubusercontent.com/u/2357126?v=3","gravatar_id":"","url":"https://api.github.com/users/vrooje","html_url":"https://github.com/vrooje","followers_url":"https://api.github.com/users/vrooje/followers","following_url":"https://api.github.com/users/vrooje/following{/other_user}","gists_url":"https://api.github.com/users/vrooje/gists{/gist_id}","starred_url":"https://api.github.com/users/vrooje/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vrooje/subscriptions","organizations_url":"https://api.github.com/users/vrooje/orgs","repos_url":"https://api.github.com/users/vrooje/repos","events_url":"https://api.github.com/users/vrooje/events{/privacy}","received_events_url":"https://api.github.com/users/vrooje/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":{"login":"ggdhines","id":6626461,"avatar_url":"https://avatars.githubusercontent.com/u/6626461?v=3","gravatar_id":"","url":"https://api.github.com/users/ggdhines","html_url":"https://github.com/ggdhines","followers_url":"https://api.github.com/users/ggdhines/followers","following_url":"https://api.github.com/users/ggdhines/following{/other_user}","gists_url":"https://api.github.com/users/ggdhines/gists{/gist_id}","starred_url":"https://api.github.com/users/ggdhines/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ggdhines/subscriptions","organizations_url":"https://api.github.com/users/ggdhines/orgs","repos_url":"https://api.github.com/users/ggdhines/repos","events_url":"https://api.github.com/users/ggdhines/events{/privacy}","received_events_url":"https://api.github.com/users/ggdhines/received_events","type":"User","site_admin":false},"milestone":null,"comments":10,"created_at":"2016-01-14T13:15:01Z","updated_at":"2016-02-05T11:03:42Z","closed_at":"2016-02-05T11:03:42Z","body":"Currently the aggregations appear to only report p(most_likely_label). That will be very useful for some researchers, but _only_ reporting that complicates some analyses. If I'm looking to weight an external quantity by p(specific_label), I can't directly use p(most_likely_label) because it will switch meanings from subject to subject. And if the most likely label's p-value is the only thing reported even when the question task has >2 possible answers, I can't recover the information I need at all.\r\n\r\nSo the aggregations should report p(most likely) and p(specific labels) for all possible labels, even when there are only 2 possible labels."}}