{"action":"created","issue":{"url":"https://api.github.com/repos/yooper/php-text-analysis/issues/42","repository_url":"https://api.github.com/repos/yooper/php-text-analysis","labels_url":"https://api.github.com/repos/yooper/php-text-analysis/issues/42/labels{/name}","comments_url":"https://api.github.com/repos/yooper/php-text-analysis/issues/42/comments","events_url":"https://api.github.com/repos/yooper/php-text-analysis/issues/42/events","html_url":"https://github.com/yooper/php-text-analysis/issues/42","id":375591264,"node_id":"MDU6SXNzdWUzNzU1OTEyNjQ=","number":42,"title":"Poor Vader Sentiment Accuracy. Lots of influential words missing from the vader_lexicon.txt","user":{"login":"bdteo","id":10471824,"node_id":"MDQ6VXNlcjEwNDcxODI0","avatar_url":"https://avatars2.githubusercontent.com/u/10471824?v=4","gravatar_id":"","url":"https://api.github.com/users/bdteo","html_url":"https://github.com/bdteo","followers_url":"https://api.github.com/users/bdteo/followers","following_url":"https://api.github.com/users/bdteo/following{/other_user}","gists_url":"https://api.github.com/users/bdteo/gists{/gist_id}","starred_url":"https://api.github.com/users/bdteo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bdteo/subscriptions","organizations_url":"https://api.github.com/users/bdteo/orgs","repos_url":"https://api.github.com/users/bdteo/repos","events_url":"https://api.github.com/users/bdteo/events{/privacy}","received_events_url":"https://api.github.com/users/bdteo/received_events","type":"User","site_admin":false},"labels":[{"id":5387185,"node_id":"MDU6TGFiZWw1Mzg3MTg1","url":"https://api.github.com/repos/yooper/php-text-analysis/labels/bug","name":"bug","color":"fc2929","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2018-10-30T16:51:29Z","updated_at":"2018-11-06T13:47:54Z","closed_at":null,"author_association":"NONE","body":"So, I tried running this implementation of the Vader algorith on this dataset: https://archive.ics.uci.edu/ml/datasets/Sentiment+Labelled+Sentences\r\n\r\nEverything I do is: `vader(normalize_tokens(tokenize('and . ' . $sample[0])))` (adding 'and . ' as a dummy first word as a workaround for a bug in the library)\r\n\r\nHere are the results:\r\n\r\n```\r\n[\r\n\"vader\" => array:3 [\r\n    \"amazon_cells_labelled.txt\" => array:9 [\r\n      \"positive\" => 500\r\n      \"negative\" => 500\r\n      \"matched-positive\" => 367\r\n      \"failed-positive\" => 133\r\n      \"matched-negative\" => 223\r\n      \"failed-negative\" => 277\r\n      \"matched-neutral\" => 320\r\n      \"matched-%-positive\" => 73.4\r\n      \"matched-%-negative\" => 44.6\r\n    ]\r\n    \"imdb_labelled.txt\" => array:9 [\r\n      \"positive\" => 500\r\n      \"negative\" => 500\r\n      \"matched-positive\" => 364\r\n      \"failed-positive\" => 136\r\n      \"matched-negative\" => 233\r\n      \"failed-negative\" => 267\r\n      \"matched-neutral\" => 261\r\n      \"matched-%-positive\" => 72.8\r\n      \"matched-%-negative\" => 46.6\r\n    ]\r\n    \"yelp_labelled.txt\" => array:9 [\r\n      \"positive\" => 500\r\n      \"negative\" => 500\r\n      \"matched-positive\" => 358\r\n      \"failed-positive\" => 142\r\n      \"matched-negative\" => 178\r\n      \"failed-negative\" => 322\r\n      \"matched-neutral\" => 350\r\n      \"matched-%-positive\" => 71.6\r\n      \"matched-%-negative\" => 35.6\r\n    ]\r\n]\r\n```\r\n\r\nI read how the algorithm works and I liked its simplicity.\r\n\r\nHowever the accuracy in the upper example seems to be extremely poor ! - Mainly because of the lean lexicon.\r\n\r\nAre there fuller lexicons for the Vader algorithm ? What can I do to improve accuracy other than that ?\r\nAs you can see the accuracy classifying negative sentences is beyond tragic. "},"comment":{"url":"https://api.github.com/repos/yooper/php-text-analysis/issues/comments/436257941","html_url":"https://github.com/yooper/php-text-analysis/issues/42#issuecomment-436257941","issue_url":"https://api.github.com/repos/yooper/php-text-analysis/issues/42","id":436257941,"node_id":"MDEyOklzc3VlQ29tbWVudDQzNjI1Nzk0MQ==","user":{"login":"yooper","id":1064781,"node_id":"MDQ6VXNlcjEwNjQ3ODE=","avatar_url":"https://avatars0.githubusercontent.com/u/1064781?v=4","gravatar_id":"","url":"https://api.github.com/users/yooper","html_url":"https://github.com/yooper","followers_url":"https://api.github.com/users/yooper/followers","following_url":"https://api.github.com/users/yooper/following{/other_user}","gists_url":"https://api.github.com/users/yooper/gists{/gist_id}","starred_url":"https://api.github.com/users/yooper/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yooper/subscriptions","organizations_url":"https://api.github.com/users/yooper/orgs","repos_url":"https://api.github.com/users/yooper/repos","events_url":"https://api.github.com/users/yooper/events{/privacy}","received_events_url":"https://api.github.com/users/yooper/received_events","type":"User","site_admin":false},"created_at":"2018-11-06T13:47:54Z","updated_at":"2018-11-06T13:47:54Z","author_association":"OWNER","body":"After looking more at the Vader class, I have decided to make the properties within it more accessible. You can now modify the tokens and their weights. Please review the changes in commit https://github.com/yooper/php-text-analysis/commit/ad5b139fb94ad96100ee1b545cf51458150ba45a for ways to directly modify properties of the class to better improve your results. \r\n\r\nI will close this issue tomorrow, if no feedback is received. \r\n\r\nCheers,"}}
{"actor":{"display_login":"yooper"}}