{"action":"created","issue":{"url":"https://api.github.com/repos/cmusatyalab/openface/issues/132","repository_url":"https://api.github.com/repos/cmusatyalab/openface","labels_url":"https://api.github.com/repos/cmusatyalab/openface/issues/132/labels{/name}","comments_url":"https://api.github.com/repos/cmusatyalab/openface/issues/132/comments","events_url":"https://api.github.com/repos/cmusatyalab/openface/issues/132/events","html_url":"https://github.com/cmusatyalab/openface/issues/132","id":153313333,"number":132,"title":"Memory limit on a table somewhere?","user":{"login":"aaronnech","id":3673255,"avatar_url":"https://avatars.githubusercontent.com/u/3673255?v=3","gravatar_id":"","url":"https://api.github.com/users/aaronnech","html_url":"https://github.com/aaronnech","followers_url":"https://api.github.com/users/aaronnech/followers","following_url":"https://api.github.com/users/aaronnech/following{/other_user}","gists_url":"https://api.github.com/users/aaronnech/gists{/gist_id}","starred_url":"https://api.github.com/users/aaronnech/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aaronnech/subscriptions","organizations_url":"https://api.github.com/users/aaronnech/orgs","repos_url":"https://api.github.com/users/aaronnech/repos","events_url":"https://api.github.com/users/aaronnech/events{/privacy}","received_events_url":"https://api.github.com/users/aaronnech/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":13,"created_at":"2016-05-05T20:03:23Z","updated_at":"2016-05-08T00:30:54Z","closed_at":null,"body":"### Context of the issue.\r\nI have a big data set and can't get past the loading part of training. From searching I think there is a table somewhere (with possibly the directory of images/folders?) which is (probably) a native lua table (thus subject to the luajit object limit). I'm looking into the issue myself now but I thought I'd make a post here in the case that someone knows where this might be. So I can replace it with a c hash table.\r\n\r\n### Expected behavior.\r\nShould load any sized dataset\r\n\r\n### Actual behavior.\r\nWhen a dataset becomes sufficiently large there is a memory PANIC error similar to this:\r\nhttp://stackoverflow.com/questions/27015150/how-to-get-past-1gb-memory-limit-of-64-bit-luajit-on-linux\r\n\r\n### OS and hardware information.\r\n64gb RAM, 4 nvidia titans, linux\r\n"},"comment":{"url":"https://api.github.com/repos/cmusatyalab/openface/issues/comments/217678739","html_url":"https://github.com/cmusatyalab/openface/issues/132#issuecomment-217678739","issue_url":"https://api.github.com/repos/cmusatyalab/openface/issues/132","id":217678739,"user":{"login":"aaronnech","id":3673255,"avatar_url":"https://avatars.githubusercontent.com/u/3673255?v=3","gravatar_id":"","url":"https://api.github.com/users/aaronnech","html_url":"https://github.com/aaronnech","followers_url":"https://api.github.com/users/aaronnech/followers","following_url":"https://api.github.com/users/aaronnech/following{/other_user}","gists_url":"https://api.github.com/users/aaronnech/gists{/gist_id}","starred_url":"https://api.github.com/users/aaronnech/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aaronnech/subscriptions","organizations_url":"https://api.github.com/users/aaronnech/orgs","repos_url":"https://api.github.com/users/aaronnech/repos","events_url":"https://api.github.com/users/aaronnech/events{/privacy}","received_events_url":"https://api.github.com/users/aaronnech/received_events","type":"User","site_admin":false},"created_at":"2016-05-08T00:30:54Z","updated_at":"2016-05-08T00:30:54Z","body":"Awesome. I made a comment on your commit. I think I'm a version or two behind (from when the automatic LFW training scheme was implemented). I'll try updating and training again.\r\n\r\nThanks for all the information!"}}