{"action":"created","issue":{"url":"https://api.github.com/repos/nextcloud/fulltextsearch/issues/311","repository_url":"https://api.github.com/repos/nextcloud/fulltextsearch","labels_url":"https://api.github.com/repos/nextcloud/fulltextsearch/issues/311/labels{/name}","comments_url":"https://api.github.com/repos/nextcloud/fulltextsearch/issues/311/comments","events_url":"https://api.github.com/repos/nextcloud/fulltextsearch/issues/311/events","html_url":"https://github.com/nextcloud/fulltextsearch/issues/311","id":321332433,"number":311,"title":"fulltextsearch:index hangs, repeating \"- RAM: 566.something\"","user":{"login":"b-","id":284789,"avatar_url":"https://avatars2.githubusercontent.com/u/284789?v=4","gravatar_id":"","url":"https://api.github.com/users/b-","html_url":"https://github.com/b-","followers_url":"https://api.github.com/users/b-/followers","following_url":"https://api.github.com/users/b-/following{/other_user}","gists_url":"https://api.github.com/users/b-/gists{/gist_id}","starred_url":"https://api.github.com/users/b-/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/b-/subscriptions","organizations_url":"https://api.github.com/users/b-/orgs","repos_url":"https://api.github.com/users/b-/repos","events_url":"https://api.github.com/users/b-/events{/privacy}","received_events_url":"https://api.github.com/users/b-/received_events","type":"User","site_admin":false},"labels":[{"id":818363088,"url":"https://api.github.com/repos/nextcloud/fulltextsearch/labels/3.%20to%20review","name":"3. to review","color":"0052cc","default":false},{"id":489343802,"url":"https://api.github.com/repos/nextcloud/fulltextsearch/labels/fixed%20?","name":"fixed ?","color":"c2e0c6","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":7,"created_at":"2018-05-08T20:19:13Z","updated_at":"2018-05-15T22:57:03Z","closed_at":null,"author_association":"NONE","body":"I'm trying to perform my first index, and I'm almost definitely stress testing this whole FullTextSearch stack while doing so — I've got a 500 GB dataset.\r\n\r\nThe data itself is \"external storage,\" which is CIFS storage served from Windows Server 2012 R2, mounted via `cifs` entries in `/etc/fstab` as follows: \r\n```fstab\r\n## Windows Shares\r\n//<server>/Q-Data/shared\t/NetShares/v\tcifs\tcredentials=/NetShares/.smbcredentials,iocharset=utf8,sec=ntlm,file_mode=0777,dir_mode=0777\t0\t0\r\n//<server>/R-Data\t\t/NetShares/r\tcifs\tcredentials=/NetShares/.smbcredentials,iocharset=utf8,sec=ntlm,file_mode=0777,dir_mode=0777\t0\t0\r\n//<server>/J-Data\t\t/NetShares/j\tcifs\tcredentials=/NetShares/.smbcredentials,iocharset=utf8,sec=ntlm,file_mode=0777,dir_mode=0777\t0\t0\r\n//<server>/W-Data\t\t/NetShares/w\tcifs\tcredentials=/NetShares/.smbcredentials,iocharset=utf8,sec=ntlm,file_mode=0777,dir_mode=0777\t0\t0\r\n```\r\n\r\nI've gotten it to index for one user successfully, but then as soon as it gets to the next user it gets stuck filling the RAM (?) once it gets to `- RAM: 566.43410491943`.\r\n\r\nIf I try to continue indexing by simply doing `occ fulltextsearch:index` again this happens:\r\n\r\n```shell\r\nroot@c:/var/ncdata# occ fulltextsearch:index\r\nindexing Files.\r\n USER: blr@ieitransit.com\r\n- RAM: 23.89949798584\r\n- RAM: 30.564025878906\r\n- RAM: 35.104431152344\r\n- RAM: 37.639022827148\r\n- RAM: 41.782417297363\r\n- RAM: 46.028549194336\r\n- RAM: 49.148544311523\r\n- RAM: 50.502540588379\r\n- RAM: 54.82398223877\r\n- RAM: 59.080146789551\r\n- RAM: 60.91951751709\r\n- RAM: 65.728569030762\r\n- RAM: 66.85343170166\r\n- RAM: 70.643966674805\r\n- RAM: 73.079170227051\r\n- RAM: 77.160293579102\r\n- RAM: 80.570121765137\r\n- RAM: 83.654678344727\r\n- RAM: 91.375785827637\r\n- RAM: 96.923522949219\r\n- RAM: 102.13726043701\r\n- RAM: 110.47479248047\r\n- RAM: 113.87605285645\r\n- RAM: 116.39376831055\r\n- RAM: 119.73052215576\r\n- RAM: 123.79248809814\r\n- RAM: 128.93239593506\r\n- RAM: 132.1827545166\r\n- RAM: 135.75133514404\r\n- RAM: 141.4944152832\r\n- RAM: 149.27917480469\r\n- RAM: 159.47479248047\r\n- RAM: 164.93907928467\r\n- RAM: 169.28715515137\r\n- RAM: 173.63157653809\r\n- RAM: 177.92807769775\r\n- RAM: 181.32400512695\r\n- RAM: 184.85238647461\r\n- RAM: 188.70569610596\r\n- RAM: 192.77071380615\r\n- RAM: 196.81725311279\r\n- RAM: 204.74087524414\r\n- RAM: 207.80700683594\r\n- RAM: 211.59580993652\r\n- RAM: 486.29839324951\r\n- RAM: 508.19902038574\r\n- RAM: 277.52561950684\r\n- RAM: 272.46606445312\r\n- RAM: 279.18186187744\r\n- RAM: 287.55152893066\r\n- RAM: 285.63525390625\r\n- RAM: 291.30284118652\r\n- RAM: 301.78762817383\r\n- RAM: 306.75387573242\r\n- RAM: 310.88928222656\r\n- RAM: 316.43890380859\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n- RAM: 566.42482757568\r\n```\r\nand then it'll keep repeating that last number and going nowhere.\r\n\r\nThe only relevant entry in the log file is:\r\n\r\n```json\r\n{\r\n  \"reqId\": \"M8HADbAjjBympXqBfFxw\",\r\n  \"level\": 1,\r\n  \"time\": \"2018-05-08T11:53:44-04:00\",\r\n  \"remoteAddr\": \"\",\r\n  \"user\": \"--\",\r\n  \"app\": \"admin_audit\",\r\n  \"method\": \"--\",\r\n  \"url\": \"--\",\r\n  \"message\": \"Console command executed: fulltextsearch:index\",\r\n  \"userAgent\": \"--\",\r\n  \"version\": \"13.0.2.1\"\r\n}\r\n```\r\n\r\nI've reset the entire index more than once and started over, but it always ends up hanging, repeating the same `- RAM: ` line over and over. I let it sit for over 24 hours doing so, just to be certain…\r\n\r\nI imagine this number itself isn't particularly significant (I have no clue what it even refers to), but nevertheless I don't know where to start troubleshooting more.\r\n\r\nI want to reference this issue I'm having, https://github.com/nextcloud/fulltextsearch_elasticsearch/issues/22 because I believe they may be related.\r\n\r\nLastly, while it does sound to me like this may be something to do with resource *limits,* I have definitely given the VM running Nextcloud / FullTextSearch / ElasticSearch, etc. enough resources: 32 GB RAM and 8 Xeon E5 CPU cores. If it's as simple as telling something it's allowed to use more RAM, so be it."},"comment":{"url":"https://api.github.com/repos/nextcloud/fulltextsearch/issues/comments/389339811","html_url":"https://github.com/nextcloud/fulltextsearch/issues/311#issuecomment-389339811","issue_url":"https://api.github.com/repos/nextcloud/fulltextsearch/issues/311","id":389339811,"user":{"login":"b-","id":284789,"avatar_url":"https://avatars2.githubusercontent.com/u/284789?v=4","gravatar_id":"","url":"https://api.github.com/users/b-","html_url":"https://github.com/b-","followers_url":"https://api.github.com/users/b-/followers","following_url":"https://api.github.com/users/b-/following{/other_user}","gists_url":"https://api.github.com/users/b-/gists{/gist_id}","starred_url":"https://api.github.com/users/b-/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/b-/subscriptions","organizations_url":"https://api.github.com/users/b-/orgs","repos_url":"https://api.github.com/users/b-/repos","events_url":"https://api.github.com/users/b-/events{/privacy}","received_events_url":"https://api.github.com/users/b-/received_events","type":"User","site_admin":false},"created_at":"2018-05-15T22:57:03Z","updated_at":"2018-05-15T22:57:03Z","author_association":"NONE","body":"I just went to check on things, and it was slowly moving along but then I realized my swap partition was full. I just added an extra 32 GB swap drive (which I couldn't do without shutting down the VM as the controller doesn't support hot-swappable drives), and it's going again.\r\n\r\nThis time I piped `fulltextsearch:index` to `tee` so it'll save the progress to a file, \"index.log\"\r\n\r\nI'll let you know tomorrow what \"- RAM: \" line it gets to before it gets to the files."}}
{"actor":{"display_login":"b-"}}