{"action":"created","issue":{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7698","repository_url":"https://api.github.com/repos/scikit-learn/scikit-learn","labels_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7698/labels{/name}","comments_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7698/comments","events_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7698/events","html_url":"https://github.com/scikit-learn/scikit-learn/issues/7698","id":183714741,"number":7698,"title":"Multilabel ranking coverage error formula","user":{"login":"emir-munoz","id":2099041,"avatar_url":"https://avatars.githubusercontent.com/u/2099041?v=3","gravatar_id":"","url":"https://api.github.com/users/emir-munoz","html_url":"https://github.com/emir-munoz","followers_url":"https://api.github.com/users/emir-munoz/followers","following_url":"https://api.github.com/users/emir-munoz/following{/other_user}","gists_url":"https://api.github.com/users/emir-munoz/gists{/gist_id}","starred_url":"https://api.github.com/users/emir-munoz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/emir-munoz/subscriptions","organizations_url":"https://api.github.com/users/emir-munoz/orgs","repos_url":"https://api.github.com/users/emir-munoz/repos","events_url":"https://api.github.com/users/emir-munoz/events{/privacy}","received_events_url":"https://api.github.com/users/emir-munoz/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/labels/Bug","name":"Bug","color":"e10c02"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/milestones/21","html_url":"https://github.com/scikit-learn/scikit-learn/milestones/0.19","labels_url":"https://api.github.com/repos/scikit-learn/scikit-learn/milestones/21/labels","id":1970916,"number":21,"title":"0.19","description":"","creator":{"login":"amueller","id":449558,"avatar_url":"https://avatars.githubusercontent.com/u/449558?v=3","gravatar_id":"","url":"https://api.github.com/users/amueller","html_url":"https://github.com/amueller","followers_url":"https://api.github.com/users/amueller/followers","following_url":"https://api.github.com/users/amueller/following{/other_user}","gists_url":"https://api.github.com/users/amueller/gists{/gist_id}","starred_url":"https://api.github.com/users/amueller/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amueller/subscriptions","organizations_url":"https://api.github.com/users/amueller/orgs","repos_url":"https://api.github.com/users/amueller/repos","events_url":"https://api.github.com/users/amueller/events{/privacy}","received_events_url":"https://api.github.com/users/amueller/received_events","type":"User","site_admin":false},"open_issues":151,"closed_issues":23,"state":"open","created_at":"2016-08-29T22:34:33Z","updated_at":"2016-10-18T18:34:47Z","due_on":"2016-12-31T00:00:00Z","closed_at":null},"comments":1,"created_at":"2016-10-18T15:09:07Z","updated_at":"2016-10-18T18:34:55Z","closed_at":null,"body":"<!-- Instructions For Filing a Bug: https://github.com/scikit-learn/scikit-learn/blob/master/CONTRIBUTING.md#filing-bugs -->\r\n\r\n#### Description\r\nThe formula for `sklearn.metrics.coverage_error` in multilabel ranking presented in the [documentation](http://scikit-learn.org/stable/modules/model_evaluation.html#coverage-error) does not match with the one in the referenced paper \"Tsoumakas, G., Katakis, I., & Vlahavas, I. (2010). Mining multi-label data. In Data mining and knowledge discovery handbook (pp. 667-685). Springer US.\"\r\n\r\nThe original formula has a `-1` at the end which is not considered in the current implementation.\r\n\r\n#### Steps/Code to Reproduce\r\nThe example given in the sklearn documentation is the following:\r\n```\r\nimport numpy as np\r\nfrom sklearn.metrics import coverage_error\r\ny_true = np.array([[1, 0, 0], [0, 0, 1]])\r\ny_score = np.array([[0.75, 0.5, 1], [1, 0.2, 0.1]])\r\ncoverage_error(y_true, y_score)\r\n```\r\nwhich returns 2.5.\r\n\r\n#### Expected Results\r\nI think that the expected value should be 1.5.\r\n\r\n#### Actual Results\r\nThe current sklearn implementation returns 2.5.\r\n\r\n#### Versions\r\n```\r\nWindows-7-6.1.7601-SP1\r\nPython 3.5.2 |Anaconda 4.0.0 (64-bit)| (default, Jul  5 2016, 11:41:13) [MSC v.1900 64 bit (AMD64)]\r\nNumPy 1.11.2\r\nSciPy 0.18.0\r\nScikit-Learn 0.18\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/comments/254598629","html_url":"https://github.com/scikit-learn/scikit-learn/issues/7698#issuecomment-254598629","issue_url":"https://api.github.com/repos/scikit-learn/scikit-learn/issues/7698","id":254598629,"user":{"login":"amueller","id":449558,"avatar_url":"https://avatars.githubusercontent.com/u/449558?v=3","gravatar_id":"","url":"https://api.github.com/users/amueller","html_url":"https://github.com/amueller","followers_url":"https://api.github.com/users/amueller/followers","following_url":"https://api.github.com/users/amueller/following{/other_user}","gists_url":"https://api.github.com/users/amueller/gists{/gist_id}","starred_url":"https://api.github.com/users/amueller/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amueller/subscriptions","organizations_url":"https://api.github.com/users/amueller/orgs","repos_url":"https://api.github.com/users/amueller/repos","events_url":"https://api.github.com/users/amueller/events{/privacy}","received_events_url":"https://api.github.com/users/amueller/received_events","type":"User","site_admin":false},"created_at":"2016-10-18T18:34:55Z","updated_at":"2016-10-18T18:34:55Z","body":"thanks for the report."}}
{"actor":{"display_login":"amueller"}}