{"action":"created","issue":{"url":"https://api.github.com/repos/dgcrouse/torch-rnn/issues/3","repository_url":"https://api.github.com/repos/dgcrouse/torch-rnn","labels_url":"https://api.github.com/repos/dgcrouse/torch-rnn/issues/3/labels{/name}","comments_url":"https://api.github.com/repos/dgcrouse/torch-rnn/issues/3/comments","events_url":"https://api.github.com/repos/dgcrouse/torch-rnn/issues/3/events","html_url":"https://github.com/dgcrouse/torch-rnn/issues/3","id":172031826,"number":3,"title":"Why when I set low temperature (0.1-0.3), I get a lot of wild cards?","user":{"login":"vi","id":173219,"avatar_url":"https://avatars.githubusercontent.com/u/173219?v=3","gravatar_id":"","url":"https://api.github.com/users/vi","html_url":"https://github.com/vi","followers_url":"https://api.github.com/users/vi/followers","following_url":"https://api.github.com/users/vi/following{/other_user}","gists_url":"https://api.github.com/users/vi/gists{/gist_id}","starred_url":"https://api.github.com/users/vi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vi/subscriptions","organizations_url":"https://api.github.com/users/vi/orgs","repos_url":"https://api.github.com/users/vi/repos","events_url":"https://api.github.com/users/vi/events{/privacy}","received_events_url":"https://api.github.com/users/vi/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-08-19T00:39:44Z","updated_at":"2016-08-19T11:42:19Z","closed_at":null,"body":"```\r\n— я не */WILDCARD/* в */WILDCARD/* */WILDCARD/* */WILDCARD/* и */WILDCARD/* */WILDCARD/*, — негромко\r\nпроизнес */WILDCARD/*. — я не */WILDCARD/* в этом */WILDCARD/* */WILDCARD/*. я не */WILDCARD/* в том, что\r\nя не могу */WILDCARD/* в */WILDCARD/* */WILDCARD/*. я не знаю. мы не могу в */WILDCARD/*\r\n*/WILDCARD/* */WILDCARD/* и */WILDCARD/* */WILDCARD/* в */WILDCARD/* */WILDCARD/*. а я не могу на него\r\n*/WILDCARD/*. я не могу */WILDCARD/* в */WILDCARD/* */WILDCARD/*. скандалисткарты — я не могу в том, что я не могу\r\n*/WILDCARD/* */WILDCARD/*? я не могу */WILDCARD/* */WILDCARD/* */WILDCARD/* и */WILDCARD/* */WILDCARD/*.\r\n```\r\n\r\nwhile `Wildcard per cent: 2.524799 %`...\r\n\r\nShouldn't wild cards in output have similar occurrence like wild cards in input?"},"comment":{"url":"https://api.github.com/repos/dgcrouse/torch-rnn/issues/comments/240996889","html_url":"https://github.com/dgcrouse/torch-rnn/issues/3#issuecomment-240996889","issue_url":"https://api.github.com/repos/dgcrouse/torch-rnn/issues/3","id":240996889,"user":{"login":"vi","id":173219,"avatar_url":"https://avatars.githubusercontent.com/u/173219?v=3","gravatar_id":"","url":"https://api.github.com/users/vi","html_url":"https://github.com/vi","followers_url":"https://api.github.com/users/vi/followers","following_url":"https://api.github.com/users/vi/following{/other_user}","gists_url":"https://api.github.com/users/vi/gists{/gist_id}","starred_url":"https://api.github.com/users/vi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vi/subscriptions","organizations_url":"https://api.github.com/users/vi/orgs","repos_url":"https://api.github.com/users/vi/repos","events_url":"https://api.github.com/users/vi/events{/privacy}","received_events_url":"https://api.github.com/users/vi/received_events","type":"User","site_admin":false},"created_at":"2016-08-19T11:42:19Z","updated_at":"2016-08-19T11:42:19Z","body":"Proposed change:\r\n\r\n```diff\r\ndiff --git a/scripts/preprocessWords.py b/scripts/preprocessWords.py\r\nindex f684c76..7033b9e 100644\r\n--- a/scripts/preprocessWords.py\r\n+++ b/scripts/preprocessWords.py\r\n@@ -17,6 +17,8 @@ parser.add_argument('--min_occurrences',type=int,default=20)\r\n parser.add_argument('--min_documents', type=int,default=1)\r\n parser.add_argument('--use_ascii', action='store_true')\r\n parser.add_argument('--encoding', default='utf-8')\r\n+parser.add_argument('--wildcard_rate', type=float, default=0.01)\r\n+parser.add_argument('--wildcard_max', type=int, default=10)\r\n args = parser.parse_args()\r\n \r\n if __name__ == '__main__':\r\n@@ -95,7 +97,7 @@ if __name__ == '__main__':\r\n             \r\n     # Add a wildcard character onto the end of everything...\r\n     \r\n-    num_distinct_wild = min(10,int(0.01*total_eliminated))\r\n+    num_distinct_wild = min(args.wildcard_max,int(args.wildcard_rate * total_eliminated))\r\n     wildcard_ids = []\r\n     \r\n     for wcnum in xrange(num_distinct_wild):\r\n@@ -130,7 +132,7 @@ if __name__ == '__main__':\r\n \r\n     if not args.quiet:\r\n         print 'Total unique words: {0}'.format(len(wordlist))\r\n-        print 'Total vocabulary size: {0}'.format(len(token_to_idx))\r\n+        print 'Total vocabulary size: {0} ({1} wild cards)'.format(len(token_to_idx), num_distinct_wild)\r\n         print 'Total tokens in file: {0}'.format(total_size)\r\n         print 'Total wildcards in file: {0} ({1}%)'.format(wildcard_replace_count,100.0*wildcard_replace_count/total_size)\r\n         print '  Training size: {0}'.format(train_size)\r\n```"}}
{"actor":{"display_login":"vi"}}