{"action":"created","issue":{"url":"https://api.github.com/repos/openstreetmap/osm2pgsql/issues/612","repository_url":"https://api.github.com/repos/openstreetmap/osm2pgsql","labels_url":"https://api.github.com/repos/openstreetmap/osm2pgsql/issues/612/labels{/name}","comments_url":"https://api.github.com/repos/openstreetmap/osm2pgsql/issues/612/comments","events_url":"https://api.github.com/repos/openstreetmap/osm2pgsql/issues/612/events","html_url":"https://github.com/openstreetmap/osm2pgsql/pull/612","id":166821669,"number":612,"title":"Drop slim mode tables just after finishing processing pending ways an…","user":{"login":"StyXman","id":167327,"avatar_url":"https://avatars.githubusercontent.com/u/167327?v=3","gravatar_id":"","url":"https://api.github.com/users/StyXman","html_url":"https://github.com/StyXman","followers_url":"https://api.github.com/users/StyXman/followers","following_url":"https://api.github.com/users/StyXman/following{/other_user}","gists_url":"https://api.github.com/users/StyXman/gists{/gist_id}","starred_url":"https://api.github.com/users/StyXman/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/StyXman/subscriptions","organizations_url":"https://api.github.com/users/StyXman/orgs","repos_url":"https://api.github.com/users/StyXman/repos","events_url":"https://api.github.com/users/StyXman/events{/privacy}","received_events_url":"https://api.github.com/users/StyXman/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2016-07-21T13:39:23Z","updated_at":"2016-12-24T11:07:54Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/openstreetmap/osm2pgsql/pulls/612","html_url":"https://github.com/openstreetmap/osm2pgsql/pull/612","diff_url":"https://github.com/openstreetmap/osm2pgsql/pull/612.diff","patch_url":"https://github.com/openstreetmap/osm2pgsql/pull/612.patch"},"body":"…d relations, freeing space for clustering and indexing.\n"},"comment":{"url":"https://api.github.com/repos/openstreetmap/osm2pgsql/issues/comments/269079976","html_url":"https://github.com/openstreetmap/osm2pgsql/pull/612#issuecomment-269079976","issue_url":"https://api.github.com/repos/openstreetmap/osm2pgsql/issues/612","id":269079976,"user":{"login":"pnorman","id":1190866,"avatar_url":"https://avatars.githubusercontent.com/u/1190866?v=3","gravatar_id":"","url":"https://api.github.com/users/pnorman","html_url":"https://github.com/pnorman","followers_url":"https://api.github.com/users/pnorman/followers","following_url":"https://api.github.com/users/pnorman/following{/other_user}","gists_url":"https://api.github.com/users/pnorman/gists{/gist_id}","starred_url":"https://api.github.com/users/pnorman/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pnorman/subscriptions","organizations_url":"https://api.github.com/users/pnorman/orgs","repos_url":"https://api.github.com/users/pnorman/repos","events_url":"https://api.github.com/users/pnorman/events{/privacy}","received_events_url":"https://api.github.com/users/pnorman/received_events","type":"User","site_admin":false},"created_at":"2016-12-24T11:07:54Z","updated_at":"2016-12-24T11:07:54Z","body":"I ran a test import with this PR, and the commit before it\r\n\r\nImport flags were `--cache 34500 --flat-nodes nodes.bin --slim` with a 161212 planet. The machine had 64GB RAM, vm.swappiness=20, and very fast NVMe drives\r\n\r\n```\r\n                master          PR\r\ntime            15:54:26        15:48:21\r\nprocessing time 17650s          16641s\r\npending ways    6803s           6822s\r\nindexing poly   14238s          13028s\r\nindexing ways   32795s          33414s\r\nMax res size    36.90 GB        36.87\r\n```\r\n\r\nNo big differences, but but Munin is more interesting. Master is to the left, PR to the right.\r\n\r\n![image](https://cloud.githubusercontent.com/assets/1190866/21466605/793071a8-c985-11e6-8aa6-fb5479683a92.png)\r\n\r\nJust for reference, DB size is below on the same time scale\r\n![image](https://cloud.githubusercontent.com/assets/1190866/21466620/e38cf9a4-c985-11e6-9d42-9ce5589fc6c5.png)\r\n\r\nI could retry with swap disabled, but there's not much indication of memory differences with this testing.\r\n\r\nBecause with this much ram the node cache is unused, it probably all went out to swap."}}
{"actor":{"display_login":"pnorman"}}