{"action":"created","issue":{"url":"https://api.github.com/repos/kbenoit/quanteda/issues/124","repository_url":"https://api.github.com/repos/kbenoit/quanteda","labels_url":"https://api.github.com/repos/kbenoit/quanteda/issues/124/labels{/name}","comments_url":"https://api.github.com/repos/kbenoit/quanteda/issues/124/comments","events_url":"https://api.github.com/repos/kbenoit/quanteda/issues/124/events","html_url":"https://github.com/kbenoit/quanteda/issues/124","id":150023318,"number":124,"title":"wordfish text model blows up when coercing sparse to dense matrix","user":{"login":"methodds","id":7460499,"avatar_url":"https://avatars.githubusercontent.com/u/7460499?v=3","gravatar_id":"","url":"https://api.github.com/users/methodds","html_url":"https://github.com/methodds","followers_url":"https://api.github.com/users/methodds/followers","following_url":"https://api.github.com/users/methodds/following{/other_user}","gists_url":"https://api.github.com/users/methodds/gists{/gist_id}","starred_url":"https://api.github.com/users/methodds/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/methodds/subscriptions","organizations_url":"https://api.github.com/users/methodds/orgs","repos_url":"https://api.github.com/users/methodds/repos","events_url":"https://api.github.com/users/methodds/events{/privacy}","received_events_url":"https://api.github.com/users/methodds/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-04-21T09:47:54Z","updated_at":"2016-04-21T11:36:06Z","closed_at":null,"body":"Hi,\r\n\r\nI'm currently trying to fit scaling models on a larger dfm (length 5084391279 , ~ 190.000 documents) which results in an error:\r\n\r\n```\r\nwf <- textmodel(myDfm, model = \"wordfish\")\r\n\r\n\r\nError in asMethod(object) : \r\n  Cholmod error 'problem too large' at file ../Core/cholmod_dense.c, line 105\r\n``` \r\nDo you have an idea what's going on here? Also, I don't fully understand the effect of the ``dir`` parameter for the wordfish model. Can you give me a hint?\r\n\r\n\r\nOn a sidenote, I'm pretty impressed how fast sparse dfm matrices can be generated with ``quanteda``. I discovered you out of frustration with ``tm`` :-)\r\n\r\nCheers,\r\nCarsten"},"comment":{"url":"https://api.github.com/repos/kbenoit/quanteda/issues/comments/212874357","html_url":"https://github.com/kbenoit/quanteda/issues/124#issuecomment-212874357","issue_url":"https://api.github.com/repos/kbenoit/quanteda/issues/124","id":212874357,"user":{"login":"methodds","id":7460499,"avatar_url":"https://avatars.githubusercontent.com/u/7460499?v=3","gravatar_id":"","url":"https://api.github.com/users/methodds","html_url":"https://github.com/methodds","followers_url":"https://api.github.com/users/methodds/followers","following_url":"https://api.github.com/users/methodds/following{/other_user}","gists_url":"https://api.github.com/users/methodds/gists{/gist_id}","starred_url":"https://api.github.com/users/methodds/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/methodds/subscriptions","organizations_url":"https://api.github.com/users/methodds/orgs","repos_url":"https://api.github.com/users/methodds/repos","events_url":"https://api.github.com/users/methodds/events{/privacy}","received_events_url":"https://api.github.com/users/methodds/received_events","type":"User","site_admin":false},"created_at":"2016-04-21T11:36:06Z","updated_at":"2016-04-21T11:36:06Z","body":"Hi Ken, thanks for the fast response :)\r\n\r\nI investigated a little but and I'm not sure whether you need SVD related computations for wordfish. But if so, you can maybe work with the [irlba](https://github.com/bwlewis/irlba/) package."}}