{"action":"created","issue":{"url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/5634","repository_url":"https://api.github.com/repos/rethinkdb/rethinkdb","labels_url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/5634/labels{/name}","comments_url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/5634/comments","events_url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/5634/events","html_url":"https://github.com/rethinkdb/rethinkdb/issues/5634","id":147170052,"number":5634,"title":"hangs with asynchronous writes, millions of records, and ≥60% cache usage","user":{"login":"wmark","id":191736,"avatar_url":"https://avatars.githubusercontent.com/u/191736?v=3","gravatar_id":"","url":"https://api.github.com/users/wmark","html_url":"https://github.com/wmark","followers_url":"https://api.github.com/users/wmark/followers","following_url":"https://api.github.com/users/wmark/following{/other_user}","gists_url":"https://api.github.com/users/wmark/gists{/gist_id}","starred_url":"https://api.github.com/users/wmark/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wmark/subscriptions","organizations_url":"https://api.github.com/users/wmark/orgs","repos_url":"https://api.github.com/users/wmark/repos","events_url":"https://api.github.com/users/wmark/events{/privacy}","received_events_url":"https://api.github.com/users/wmark/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/rethinkdb/rethinkdb/labels/pr:high","name":"pr:high","color":"e10c02"},{"url":"https://api.github.com/repos/rethinkdb/rethinkdb/labels/tp:bug","name":"tp:bug","color":"e102d8"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/rethinkdb/rethinkdb/milestones/119","html_url":"https://github.com/rethinkdb/rethinkdb/milestones/2.3.x","labels_url":"https://api.github.com/repos/rethinkdb/rethinkdb/milestones/119/labels","id":1687920,"number":119,"title":"2.3.x","description":null,"creator":{"login":"danielmewes","id":505365,"avatar_url":"https://avatars.githubusercontent.com/u/505365?v=3","gravatar_id":"","url":"https://api.github.com/users/danielmewes","html_url":"https://github.com/danielmewes","followers_url":"https://api.github.com/users/danielmewes/followers","following_url":"https://api.github.com/users/danielmewes/following{/other_user}","gists_url":"https://api.github.com/users/danielmewes/gists{/gist_id}","starred_url":"https://api.github.com/users/danielmewes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/danielmewes/subscriptions","organizations_url":"https://api.github.com/users/danielmewes/orgs","repos_url":"https://api.github.com/users/danielmewes/repos","events_url":"https://api.github.com/users/danielmewes/events{/privacy}","received_events_url":"https://api.github.com/users/danielmewes/received_events","type":"User","site_admin":false},"open_issues":59,"closed_issues":3,"state":"open","created_at":"2016-04-06T18:05:18Z","updated_at":"2016-04-26T01:00:34Z","due_on":null,"closed_at":null},"comments":15,"created_at":"2016-04-09T22:37:32Z","updated_at":"2016-04-26T15:04:58Z","closed_at":null,"body":"I seem to be hitting an invisible wall when inserting some millions of rows (avg. 160bytes in size):\r\nAs soon as I've inserted 18M rows RethinkDB just stops responding.\r\n\r\nAny pending INSERTs just hang.\r\nCPU is at 0% at this point, no disk activity (no consolidation of the data on disk), ~60% of „cache“ has been used (I tried setting the cache to 16 GiB and then independently to 22 GiB without difference); and Linux shows that I still have some gigabytes memory free (out of the total memory, which is 32 GiB).\r\n\r\nThe web interface shows „NaN% cache used“ after some time after the stalling."},"comment":{"url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/comments/214775432","html_url":"https://github.com/rethinkdb/rethinkdb/issues/5634#issuecomment-214775432","issue_url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/5634","id":214775432,"user":{"login":"wmark","id":191736,"avatar_url":"https://avatars.githubusercontent.com/u/191736?v=3","gravatar_id":"","url":"https://api.github.com/users/wmark","html_url":"https://github.com/wmark","followers_url":"https://api.github.com/users/wmark/followers","following_url":"https://api.github.com/users/wmark/following{/other_user}","gists_url":"https://api.github.com/users/wmark/gists{/gist_id}","starred_url":"https://api.github.com/users/wmark/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wmark/subscriptions","organizations_url":"https://api.github.com/users/wmark/orgs","repos_url":"https://api.github.com/users/wmark/repos","events_url":"https://api.github.com/users/wmark/events{/privacy}","received_events_url":"https://api.github.com/users/wmark/received_events","type":"User","site_admin":false},"created_at":"2016-04-26T15:04:58Z","updated_at":"2016-04-26T15:04:58Z","body":"No, I've never tried with it with anything less than the 7 GiB RethinkDB sets with 16 GiB memory, which is the lowest I can go (without setting anything myself) because I've only memory sticks of 16 GiB each.\r\n\r\nAnyway, I've started test series now on a fresh Ubuntu 16.04, 2×SSDs with Ext4, Linux 4.4.0-21, Docker 1.11.0 (driver: overlay), and will update this comment with the results.\r\n\r\n1. 16 GiB memory, 24 threads, cache auto=7.1 GiB, 2.3.0 →\r\n2. 16 GiB memory, 24 threads, cache auto=7.1 GiB, **2.3.1** →\r\n3. 16 GiB memory, 24 threads, cache **fixed=2 GiB**, 2.3.1 →\r\n4. 16 GiB memory, 24 threads cache fixed=2 GiB, **2.3.0** →\r\n\r\n… 32 GiB, 4 threads combinations follow."}}