{"action":"opened","issue":{"url":"https://api.github.com/repos/openzim/zimwriterfs/issues/47","repository_url":"https://api.github.com/repos/openzim/zimwriterfs","labels_url":"https://api.github.com/repos/openzim/zimwriterfs/issues/47/labels{/name}","comments_url":"https://api.github.com/repos/openzim/zimwriterfs/issues/47/comments","events_url":"https://api.github.com/repos/openzim/zimwriterfs/issues/47/events","html_url":"https://github.com/openzim/zimwriterfs/issues/47","id":324602994,"number":47,"title":"Cutting edge zimwriterfs slows down over time","user":{"login":"kelson42","id":1029718,"avatar_url":"https://avatars0.githubusercontent.com/u/1029718?v=4","gravatar_id":"","url":"https://api.github.com/users/kelson42","html_url":"https://github.com/kelson42","followers_url":"https://api.github.com/users/kelson42/followers","following_url":"https://api.github.com/users/kelson42/following{/other_user}","gists_url":"https://api.github.com/users/kelson42/gists{/gist_id}","starred_url":"https://api.github.com/users/kelson42/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kelson42/subscriptions","organizations_url":"https://api.github.com/users/kelson42/orgs","repos_url":"https://api.github.com/users/kelson42/repos","events_url":"https://api.github.com/users/kelson42/events{/privacy}","received_events_url":"https://api.github.com/users/kelson42/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-05-19T05:25:56Z","updated_at":"2018-05-19T05:25:56Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"Currently building the ZIM file of stackoverflow. I have remarked that if at the start things were doing well, they have slow down piece by piece over time. Now, a new compressed cluster is saved only every few seconds. See the log in attachment.\r\n[cluster.txt](https://github.com/openzim/zimwriterfs/files/2019166/cluster.txt)\r\n\r\nThe system was quite busy (in particular the CPU) at the beginning... but now, almost no CPU activiy, see here the result of dstat:\r\n\r\n```\r\n--total-cpu-usage-- -net/total- ------memory-usage----- -dsk/total-\r\nusr sys idl wai stl| recv  send| used  free  buff  cach| read  writ\r\n  9   2  65  24   0|6130B  466B|14.8G  320M 67.1M 15.9G|2512k  824k\r\n  8   2  71  20   0| 180k 3625B|14.8G  307M 67.8M 15.9G|2320k 3032k\r\n  9   1  71  19   0|5996B  350B|14.8G  318M 67.8M 15.9G| 204k 5880k\r\n  9   2  67  22   0|5587B  579B|14.8G  320M 67.8M 15.9G|1076k 2584k\r\n  7   1  73  19   0|4178B  738B|14.8G  322M 67.8M 15.9G| 408k 5040k\r\n  8   2  67  23   0|6102B  504B|14.8G  304M 67.8M 15.9G|1776k 3340k\r\n 17   1  63  19   0|  15k 4182B|14.8G  234M 70.6M 15.9G|9624k 7036k\r\n 17   1  62  20   0|6637B  245B|14.8G  266M 70.6M 15.9G| 328k 4600k\r\n 12   2  66  20   0|6505B  443B|14.8G  327M 70.6M 15.9G| 204k 6596k\r\n 11   2  68  19   0|  17k 2112B|14.8G  317M 70.6M 15.9G| 496k 5008k\r\n  9   1  73  16   0|3362B  140B|14.8G  325M 70.6M 15.9G| 600k 7848k\r\n  6   1  72  20   0| 184k 3625B|14.8G  321M 70.6M 15.9G| 272k 5916k\r\n 15   2  66  18   0|6245B  408B|14.8G  265M 70.6M 15.9G| 508k   11M\r\n 19   1  61  20   0|4190B  280B|14.8G  267M 70.6M 15.9G| 324k 7576k\r\n 11   2  67  20   0|5122B  210B|14.7G  334M 70.6M 15.9G| 552k 3864k\r\n 10   3  62  24   0|  10k  350B|14.7G  345M 70.6M 15.9G| 584k   18M\r\n  9   3  59  29   0|4321B  615B|14.8G  309M 70.6M 15.9G| 628k   20M\r\n  9   1  59  31   0|5854B  140B|14.8G  309M 70.6M 15.9G| 312k 8324k\r\n 12   2  58  28   0|  13k   49k|14.8G  311M 70.7M 15.9G| 484k 6912k\r\n 13   1  55  30   0|  44k 2215k|14.8G  274M 70.7M 15.9G| 404k 8944k\r\n 15   1  46  38   0|8667B 2421B|14.8G  261M 70.7M 15.9G| 140k 8568k\r\n  8   1  60  32   0| 183k 4283B|14.7G  334M 70.7M 15.9G| 112k 9248k\r\n  7   1  60  32   0|  13k 2742B|14.7G  335M 70.7M 15.9G|  96k   10M\r\n 13   1  59  27   0|4552B  400B|14.8G  305M 70.7M 15.9G|  96k 8512k\r\n  6   1  60  32   0| 147k 6901B|14.8G  284M 70.7M 15.9G| 132k 8304k\r\n  4   1  67  27   0|8370B  280B|14.8G  281M 70.7M 15.9G| 104k 8528k\r\n  5   1  62  32   0|3630B  695B|14.8G  288M 70.7M 15.9G| 112k   10M\r\n  5   1  62  32   0|3922B  140B|14.8G  281M 70.7M 15.9G| 128k 9736k\r\n  2   1  67  30   0|8052B  536B|14.8G  281M 70.7M 15.9G| 112k   12M\r\n  5   1  64  30   0|2676B  140B|14.8G  295M 70.7M 15.9G|  96k 8668k\r\n  5   1  71  23   0|6664B  350B|14.8G  295M 70.7M 15.9G| 112k 8288k\r\n  4   1  75  20   0| 181k 3555B|14.8G  294M 70.7M 15.9G|  76k 6664k\r\n  2   1  72  25   0|3988B  356B|14.8G  295M 70.7M 15.9G| 124k   13M\r\n  3   1  68  28   0|7262B  210B|14.8G  293M 70.7M 15.9G|  92k 8192k\r\n  3   1  73  24   0|  14k 3163B|14.8G  297M 70.7M 15.9G| 188k 8364k\r\n  2   1  72  25   0|  15k 2181B|14.8G  297M 70.7M 15.9G|  84k 7932k\r\n  2   1  71  26   0|6430B  884B|14.8G  297M 70.7M 15.9G|  84k 7912k\r\n  5   2  64  30   0|5018B  442B|14.8G  308M 70.7M 15.9G| 156k 7056k\r\n  3   1  72  24   0|  14k  786B|14.8G  309M 70.7M 15.9G|  80k 6944k\r\n  2   1  72  25   0|5968B  280B|14.8G  310M 70.7M 15.9G| 112k 8952k\r\n  2   1  73  24   0|1678B  140B|14.8G  306M 70.7M 15.9G|  80k 9224k\r\n  3   1  70  26   0| 184k 3625B|14.8G  306M 70.7M 15.9G| 112k   10M\r\n  2   1  71  26   0|5922B  350B|14.8G  307M 70.7M 15.9G| 112k   10M\r\n  2   1  73  25   0|2144B   70B|14.8G  306M 70.7M 15.9G| 112k   11M\r\n  6   1  63  31   0|8030B  496B|14.8G  306M 70.7M 15.9G| 284k 6424k\r\n  5   1  65  30   0|7144B  210B|14.8G  307M 70.7M 15.9G| 332k 5536k\r\n  6   1  62  31   0|2704B   70B|14.8G  308M 70.7M 15.9G| 432k 5520k\r\n  4   1  65  31   0|6434B  210B|14.8G  307M 70.7M 15.9G| 216k 7984k\r\n  7   1  61  31   0|8386B  280B|14.7G  309M 70.7M 15.9G| 444k 7752k\r\n 15   1  55  30   0|2094B  140B|14.8G  250M 70.7M 15.9G| 452k 6320k^C\r\n```\r\n"}}
{"actor":{"display_login":"kelson42"}}