{"action":"created","issue":{"url":"https://api.github.com/repos/mschoeffler1/ds_portfolio/issues/6","repository_url":"https://api.github.com/repos/mschoeffler1/ds_portfolio","labels_url":"https://api.github.com/repos/mschoeffler1/ds_portfolio/issues/6/labels{/name}","comments_url":"https://api.github.com/repos/mschoeffler1/ds_portfolio/issues/6/comments","events_url":"https://api.github.com/repos/mschoeffler1/ds_portfolio/issues/6/events","html_url":"https://github.com/mschoeffler1/ds_portfolio/issues/6","id":140414427,"number":6,"title":"Final review","user":{"login":"MasonGallo","id":4913951,"avatar_url":"https://avatars.githubusercontent.com/u/4913951?v=3","gravatar_id":"","url":"https://api.github.com/users/MasonGallo","html_url":"https://github.com/MasonGallo","followers_url":"https://api.github.com/users/MasonGallo/followers","following_url":"https://api.github.com/users/MasonGallo/following{/other_user}","gists_url":"https://api.github.com/users/MasonGallo/gists{/gist_id}","starred_url":"https://api.github.com/users/MasonGallo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MasonGallo/subscriptions","organizations_url":"https://api.github.com/users/MasonGallo/orgs","repos_url":"https://api.github.com/users/MasonGallo/repos","events_url":"https://api.github.com/users/MasonGallo/events{/privacy}","received_events_url":"https://api.github.com/users/MasonGallo/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2016-03-12T20:19:23Z","updated_at":"2016-03-13T01:40:44Z","closed_at":null,"body":"Clarity of research problem:\r\n\r\nYour research problem is clear. I did not see conclusions or analysis slides at time of review. I am still a little uncomfortable with your research question. I don't think you can really answer the question you've posed about religion given your analysis.\r\n\r\nCode:\r\n\r\nYour notebook is nicely formatted and clean. I noticed you only use class_weight=None in your notebook. Try tuning this to force the unbalanced dataset issue we discussed in class. \r\n\r\nNext steps:\r\n\r\nMathematically, changing the decision threshold away from 0.5 will only alter your false positives/negatives. In this case, think about the cost of a false pos vs false neg. You will want to balance this likely with the loan amount. Sklearn doesn't have this built in, but we discussed in class the way you can implement this. \r\n"},"comment":{"url":"https://api.github.com/repos/mschoeffler1/ds_portfolio/issues/comments/195848756","html_url":"https://github.com/mschoeffler1/ds_portfolio/issues/6#issuecomment-195848756","issue_url":"https://api.github.com/repos/mschoeffler1/ds_portfolio/issues/6","id":195848756,"user":{"login":"mschoeffler1","id":9667723,"avatar_url":"https://avatars.githubusercontent.com/u/9667723?v=3","gravatar_id":"","url":"https://api.github.com/users/mschoeffler1","html_url":"https://github.com/mschoeffler1","followers_url":"https://api.github.com/users/mschoeffler1/followers","following_url":"https://api.github.com/users/mschoeffler1/following{/other_user}","gists_url":"https://api.github.com/users/mschoeffler1/gists{/gist_id}","starred_url":"https://api.github.com/users/mschoeffler1/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mschoeffler1/subscriptions","organizations_url":"https://api.github.com/users/mschoeffler1/orgs","repos_url":"https://api.github.com/users/mschoeffler1/repos","events_url":"https://api.github.com/users/mschoeffler1/events{/privacy}","received_events_url":"https://api.github.com/users/mschoeffler1/received_events","type":"User","site_admin":false},"created_at":"2016-03-13T01:40:44Z","updated_at":"2016-03-13T01:40:44Z","body":"Thanks for the detailed comments. I read more deeply on the issue. I may try to build an F2 score (weights more heavily towards recall than F1) and artificially change the threshold as we discussed. \r\n\r\nData Science For Business (Provost & Fawcett) recommends profit curves (explicitly assigning cost of false positives) or ROC curves when the cost isn't known precisely. The problem domain in their example was similar (fraud detection).\r\n\r\nI hope to explore the different options - I've learned a ton from your explanation."}}