{"push_id":2511876463,"size":3,"distinct_size":1,"ref":"refs/heads/master","head":"d21cfba9f1c3c5b537fb4c1c35a7130243a13de9","before":"7b46e3f93dde11bcd87ba7adb4b4902180c671b7","commits":[{"sha":"a49ffba75ec2beb3af3931ddf200c6e900e4e806","author":{"name":"dqwu","email":"4b220ab560a62f236706ffabd58b7d5aa080c3e1@mcs.anl.gov"},"message":"Adding a compile-time setting on maximum cached IO regions\n\nWhen using PIO with PnetCDF + SUBSET rearranger the number\nof non-contiguous regions cached in a single IO process can\ngrow to a large number. PnetCDF is not efficient at handling\nvery large number of regions (sub-array requests) in the\ndata written out. We typically run out of memory or the\nwrite is very slow.\n\nSo we need to be able to set a limit on the potential\n(after rearrangement) maximum number of non-contiguous\nregions cached in an IO process.","distinct":false,"url":"https://api.github.com/repos/E3SM-Project/ParallelIO/commits/a49ffba75ec2beb3af3931ddf200c6e900e4e806"},{"sha":"3139683107147aea027fd1e7cfb4d7751052d85b","author":{"name":"dqwu","email":"4b220ab560a62f236706ffabd58b7d5aa080c3e1@mcs.anl.gov"},"message":"Flushing out cached user data when the IO regions reach the limit\n\nWithout this change, the number of non-contiguous regions cached\nin a single IO process can grow to a large number. With too many\nsub-array requests, PnetCDF might run out of memory or the write\nis very slow.","distinct":false,"url":"https://api.github.com/repos/E3SM-Project/ParallelIO/commits/3139683107147aea027fd1e7cfb4d7751052d85b"},{"sha":"d21cfba9f1c3c5b537fb4c1c35a7130243a13de9","author":{"name":"dqwu","email":"4b220ab560a62f236706ffabd58b7d5aa080c3e1@mcs.anl.gov"},"message":"Merge pull request #96 from E3SM-Project/dqwu/limit_io_regions\n\nSet a limit on the potential maximum number of non-contiguous\r\nregions in an IO process, and forcefully flush out user data\r\ncached by a compute process when that limit has been reached.\r\n\r\nFixes #95","distinct":true,"url":"https://api.github.com/repos/E3SM-Project/ParallelIO/commits/d21cfba9f1c3c5b537fb4c1c35a7130243a13de9"}]}
{"actor":{"display_login":"dqwu"}}