{"action":"created","issue":{"url":"https://api.github.com/repos/galsang/BIMPM-pytorch/issues/4","repository_url":"https://api.github.com/repos/galsang/BIMPM-pytorch","labels_url":"https://api.github.com/repos/galsang/BIMPM-pytorch/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/galsang/BIMPM-pytorch/issues/4/comments","events_url":"https://api.github.com/repos/galsang/BIMPM-pytorch/issues/4/events","html_url":"https://github.com/galsang/BIMPM-pytorch/issues/4","id":318771709,"number":4,"title":"Memory error","user":{"login":"handsomezebra","id":5323637,"avatar_url":"https://avatars3.githubusercontent.com/u/5323637?v=4","gravatar_id":"","url":"https://api.github.com/users/handsomezebra","html_url":"https://github.com/handsomezebra","followers_url":"https://api.github.com/users/handsomezebra/followers","following_url":"https://api.github.com/users/handsomezebra/following{/other_user}","gists_url":"https://api.github.com/users/handsomezebra/gists{/gist_id}","starred_url":"https://api.github.com/users/handsomezebra/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/handsomezebra/subscriptions","organizations_url":"https://api.github.com/users/handsomezebra/orgs","repos_url":"https://api.github.com/users/handsomezebra/repos","events_url":"https://api.github.com/users/handsomezebra/events{/privacy}","received_events_url":"https://api.github.com/users/handsomezebra/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-04-30T02:13:28Z","updated_at":"2018-05-01T05:53:08Z","closed_at":null,"author_association":"NONE","body":"Hi, Thanks for converting the model to pytorch. But I always got memory error by using this tool, I checked one of the existing issues and set the --max-sent-len to 32. But still got the same error. What else can I try to solve it?\r\n\r\n```\r\n$ python train.py --data-type Quora --max-sent-len 32\r\nloading Quora data...\r\n100%|████████████████████████████████████████████████████████████████████████████| 2196017/2196017 [02:21<00:00, 15546.98it/s]\r\nTraceback (most recent call last):\r\n  File \"train.py\", line 148, in <module>\r\n    main()\r\n  File \"train.py\", line 127, in main\r\n    data = Quora(args)\r\n  File \"/home/vba/dev/external/BIMPM-pytorch/model/utils.py\", line 70, in __init__\r\n    self.TEXT.build_vocab(self.train, self.dev, self.test, vectors=GloVe(name='840B', dim=300))\r\n  File \"/home/vba/anaconda3/lib/python3.6/site-packages/torchtext/vocab.py\", line 347, in __init__\r\n    super(GloVe, self).__init__(name, url=url, **kwargs)\r\n  File \"/home/vba/anaconda3/lib/python3.6/site-packages/torchtext/vocab.py\", line 236, in __init__\r\n    self.cache(name, cache, url=url)\r\n  File \"/home/vba/anaconda3/lib/python3.6/site-packages/torchtext/vocab.py\", line 327, in cache\r\n    self.vectors = torch.Tensor(vectors).view(-1, dim)\r\nMemoryError\r\n\r\n```"},"comment":{"url":"https://api.github.com/repos/galsang/BIMPM-pytorch/issues/comments/385605080","html_url":"https://github.com/galsang/BIMPM-pytorch/issues/4#issuecomment-385605080","issue_url":"https://api.github.com/repos/galsang/BIMPM-pytorch/issues/4","id":385605080,"user":{"login":"handsomezebra","id":5323637,"avatar_url":"https://avatars3.githubusercontent.com/u/5323637?v=4","gravatar_id":"","url":"https://api.github.com/users/handsomezebra","html_url":"https://github.com/handsomezebra","followers_url":"https://api.github.com/users/handsomezebra/followers","following_url":"https://api.github.com/users/handsomezebra/following{/other_user}","gists_url":"https://api.github.com/users/handsomezebra/gists{/gist_id}","starred_url":"https://api.github.com/users/handsomezebra/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/handsomezebra/subscriptions","organizations_url":"https://api.github.com/users/handsomezebra/orgs","repos_url":"https://api.github.com/users/handsomezebra/repos","events_url":"https://api.github.com/users/handsomezebra/events{/privacy}","received_events_url":"https://api.github.com/users/handsomezebra/received_events","type":"User","site_admin":false},"created_at":"2018-05-01T05:53:08Z","updated_at":"2018-05-01T05:53:08Z","author_association":"NONE","body":"With the GloVe vector name as '42B', I can finish the training as below.\r\n`python train.py --data-type Quora`\r\n\r\nBut after 10 epoch of training, the testing accuracy is around 81.5%. The 42B GloVe won't cause such a big difference right? What are the parameters you use to achieve 87.3%? @galsang \r\n\r\nThanks!"}}
{"actor":{"display_login":"handsomezebra"}}