{"action":"opened","issue":{"url":"https://api.github.com/repos/zcash/zcash/issues/3763","repository_url":"https://api.github.com/repos/zcash/zcash","labels_url":"https://api.github.com/repos/zcash/zcash/issues/3763/labels{/name}","comments_url":"https://api.github.com/repos/zcash/zcash/issues/3763/comments","events_url":"https://api.github.com/repos/zcash/zcash/issues/3763/events","html_url":"https://github.com/zcash/zcash/issues/3763","id":396093754,"node_id":"MDU6SXNzdWUzOTYwOTM3NTQ=","number":3763,"title":"We shouldn't use RICE scores in the process of Network Upgrade feature prioritization","user":{"login":"daira","id":643204,"node_id":"MDQ6VXNlcjY0MzIwNA==","avatar_url":"https://avatars2.githubusercontent.com/u/643204?v=4","gravatar_id":"","url":"https://api.github.com/users/daira","html_url":"https://github.com/daira","followers_url":"https://api.github.com/users/daira/followers","following_url":"https://api.github.com/users/daira/following{/other_user}","gists_url":"https://api.github.com/users/daira/gists{/gist_id}","starred_url":"https://api.github.com/users/daira/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/daira/subscriptions","organizations_url":"https://api.github.com/users/daira/orgs","repos_url":"https://api.github.com/users/daira/repos","events_url":"https://api.github.com/users/daira/events{/privacy}","received_events_url":"https://api.github.com/users/daira/received_events","type":"User","site_admin":false},"labels":[{"id":320683014,"node_id":"MDU6TGFiZWwzMjA2ODMwMTQ=","url":"https://api.github.com/repos/zcash/zcash/labels/community","name":"community","color":"005800","default":false},{"id":179182764,"node_id":"MDU6TGFiZWwxNzkxODI3NjQ=","url":"https://api.github.com/repos/zcash/zcash/labels/consensus%20protocol","name":"consensus protocol","color":"f766c7","default":false},{"id":175839803,"node_id":"MDU6TGFiZWwxNzU4Mzk4MDM=","url":"https://api.github.com/repos/zcash/zcash/labels/dev%20policy","name":"dev policy","color":"fbca04","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2019-01-04T22:50:04Z","updated_at":"2019-01-04T22:50:04Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"My objections to RICE (Reach, Impact, Confidence, Effort) scoring:\r\n\r\n* the individual scores have very low [inter-rater agreement](https://en.wikipedia.org/wiki/Inter-rater_reliability);\r\n* the combined R\\*I\\*C/E metric has the effect of exaggerating misestimates in the individual scores;\r\n* \"person-months\" is a [discredited](https://www.cs.drexel.edu/~yfcai/CS451/RequiredReadings/MythicalManMonth.pdf) way of measuring effort;\r\n* multiplying by the Confidence estimate is a poor way of dealing with uncertainty, that could lead to excessive conservativeness;\r\n* the system was designed to prioritize features, and does a bad job of assessing risk or the importance of security issues.\r\n\r\nNote that when I say that scores have very low inter-rater agreement, I'm talking not just about differences of 1 or 2 points, but in some cases fundamental disagreement about whether the impact will be highly positive, or actually detrimental to the protocol.\r\n\r\nThe responses to my objections have amounted to \"but we won't use it in those bad ways\". I am deeply skeptical, because I don't understand why we are using it at all, if it has no influence on prioritization. If it does have an influence on prioritization, however indirect, then I'm arguing that it shouldn't. If it doesn't have any influence, then I am arguing that it's a waste of time.\r\n\r\nSince I've been misinterpreted on this point in private conversation, I will make it clear that I don't seek to dictate (indeed, would be very strongly opposed to dictating) how people make their own decisions; only on whether RICE scoring is an appropriate tool to use in our collective decision-making."}}
{"actor":{"display_login":"daira"}}