{"action":"created","issue":{"url":"https://api.github.com/repos/openstreetmap/Nominatim/issues/1234","repository_url":"https://api.github.com/repos/openstreetmap/Nominatim","labels_url":"https://api.github.com/repos/openstreetmap/Nominatim/issues/1234/labels{/name}","comments_url":"https://api.github.com/repos/openstreetmap/Nominatim/issues/1234/comments","events_url":"https://api.github.com/repos/openstreetmap/Nominatim/issues/1234/events","html_url":"https://github.com/openstreetmap/Nominatim/issues/1234","id":379477636,"node_id":"MDU6SXNzdWUzNzk0Nzc2MzY=","number":1234,"title":"Importing planet-latest.osm.bz2 into nominatim is slow","user":{"login":"Snickbrack","id":28804584,"node_id":"MDQ6VXNlcjI4ODA0NTg0","avatar_url":"https://avatars2.githubusercontent.com/u/28804584?v=4","gravatar_id":"","url":"https://api.github.com/users/Snickbrack","html_url":"https://github.com/Snickbrack","followers_url":"https://api.github.com/users/Snickbrack/followers","following_url":"https://api.github.com/users/Snickbrack/following{/other_user}","gists_url":"https://api.github.com/users/Snickbrack/gists{/gist_id}","starred_url":"https://api.github.com/users/Snickbrack/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Snickbrack/subscriptions","organizations_url":"https://api.github.com/users/Snickbrack/orgs","repos_url":"https://api.github.com/users/Snickbrack/repos","events_url":"https://api.github.com/users/Snickbrack/events{/privacy}","received_events_url":"https://api.github.com/users/Snickbrack/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-11-11T00:56:56Z","updated_at":"2018-11-11T21:57:18Z","closed_at":null,"author_association":"NONE","body":"Hi,\r\n\r\nis it normal that my server is importing the planet-latest.osm.bz2 at the following rate?\r\n\r\nProcessing: Node(817970k 8.4k/s) Way(0k 0.00k/s) Relation(0 0.00/s)\r\n\r\nAccording to [this ](https://wiki.openstreetmap.org/w/images/thumb/e/e3/Osmdbstats2.png/800px-Osmdbstats2.png)the total node count is 4 billion and im at the above value after three days. So the process on importing takes more than months...\r\n\r\nServer specs are:\r\nIntel Core i7-3770\r\n2x HDD SATA 4,0 TB Enterprise\r\n4x RAM 8192 MB DDR3\r\n\r\nCan I speed up the process?\r\n\r\nPS: What does k mean? 1k = 1000 Nodes?"},"comment":{"url":"https://api.github.com/repos/openstreetmap/Nominatim/issues/comments/437708754","html_url":"https://github.com/openstreetmap/Nominatim/issues/1234#issuecomment-437708754","issue_url":"https://api.github.com/repos/openstreetmap/Nominatim/issues/1234","id":437708754,"node_id":"MDEyOklzc3VlQ29tbWVudDQzNzcwODc1NA==","user":{"login":"mtmail","id":3727288,"node_id":"MDQ6VXNlcjM3MjcyODg=","avatar_url":"https://avatars1.githubusercontent.com/u/3727288?v=4","gravatar_id":"","url":"https://api.github.com/users/mtmail","html_url":"https://github.com/mtmail","followers_url":"https://api.github.com/users/mtmail/followers","following_url":"https://api.github.com/users/mtmail/following{/other_user}","gists_url":"https://api.github.com/users/mtmail/gists{/gist_id}","starred_url":"https://api.github.com/users/mtmail/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mtmail/subscriptions","organizations_url":"https://api.github.com/users/mtmail/orgs","repos_url":"https://api.github.com/users/mtmail/repos","events_url":"https://api.github.com/users/mtmail/events{/privacy}","received_events_url":"https://api.github.com/users/mtmail/received_events","type":"User","site_admin":false},"created_at":"2018-11-11T21:57:18Z","updated_at":"2018-11-11T21:57:18Z","author_association":"COLLABORATOR","body":"1k is 1000. \r\n\r\nMy last finished planet import showed\r\n```\r\nNode(4759851k 5207.7k/s) Way(527655k 117.10k/s) Relation(6140360 3788.01/s)\r\nOsm2pgsql took 7208s overall\r\n```\r\nThat's about 2 hours. And the osm2pgsql step is a relative small part in the whole setup, the indexing that follows takes 10-20x as long.\r\n\r\nMy server is more powerful but you should be able to finish this step below 6-8h, otherwise you're looking at total setup time of two weeks.\r\n\r\nMore hardware helps, especially fast harddrives. SSD or NVM drives for all the random disc access. Build-in, not network mounted. Bare metal, not virtual machines. Of course you should follow the postgresql optimizations listed in (https://nominatim.org/release-docs/latest/admin/Installation/) and check general system load, e.g. is all RAM used up and swapping to disk?\r\n"}}
{"actor":{"display_login":"mtmail"}}