{"action":"created","issue":{"url":"https://api.github.com/repos/omniscale/imposm3/issues/90","repository_url":"https://api.github.com/repos/omniscale/imposm3","labels_url":"https://api.github.com/repos/omniscale/imposm3/issues/90/labels{/name}","comments_url":"https://api.github.com/repos/omniscale/imposm3/issues/90/comments","events_url":"https://api.github.com/repos/omniscale/imposm3/issues/90/events","html_url":"https://github.com/omniscale/imposm3/issues/90","id":133386416,"number":90,"title":"Killed after reading nodes","user":{"login":"pnorman","id":1190866,"avatar_url":"https://avatars.githubusercontent.com/u/1190866?v=3","gravatar_id":"","url":"https://api.github.com/users/pnorman","html_url":"https://github.com/pnorman","followers_url":"https://api.github.com/users/pnorman/followers","following_url":"https://api.github.com/users/pnorman/following{/other_user}","gists_url":"https://api.github.com/users/pnorman/gists{/gist_id}","starred_url":"https://api.github.com/users/pnorman/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pnorman/subscriptions","organizations_url":"https://api.github.com/users/pnorman/orgs","repos_url":"https://api.github.com/users/pnorman/repos","events_url":"https://api.github.com/users/pnorman/events{/privacy}","received_events_url":"https://api.github.com/users/pnorman/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-02-13T02:01:20Z","updated_at":"2016-03-10T17:14:12Z","closed_at":"2016-03-10T17:14:12Z","body":"With imposm3-0.1dev-20160128-bb3d003-linux-x86-64 from the website I get this error when importing planet-160208.osm.pbf\r\n\r\n```\r\n[Feb 13 01:16:52] [INFO] [2h37m0s] C:  630000/s (3210564187) N:   16600/s (84831038) W:   64400/s (278656000) R:      0/s (0)\r\n\r\n[signal 0x7 code=0x2 addr=0x7fa320de0ff0 pc=0x7fa3700211fe]\r\n\r\nruntime stack:\r\nruntime.throw(0xa63800, 0x2a)\r\n        /usr/local/go/src/runtime/panic.go:527 +0x90\r\nruntime.sigpanic()\r\n        /usr/local/go/src/runtime/sigpanic_unix.go:12 +0x5a\r\n\r\ngoroutine 20 [syscall, locked to thread]:\r\nruntime.cgocall(0x407a56, 0xc820040c50, 0x0)\r\n        /usr/local/go/src/runtime/cgocall.go:120 +0x11b fp=0xc820040c20 sp=0xc820040bf0\r\ngithub.com/jmhodges/levigo._Cfunc_leveldb_write(0x22dec20, 0x22dc650, 0x7fa2680008c0, 0xc84e606050)\r\n        github.com/jmhodges/levigo/_obj/_cgo_gotypes.go:807 +0x35 fp=0xc820040c50 sp=0xc820040c20\r\ngithub.com/jmhodges/levigo.(*DB).Write(0xc8201660a8, 0xc8201660b0, 0xc84e606048, 0x0, 0x0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/Godeps/_workspace/src/github.com/jmhodges/levigo/db.go:217 +0x73 fp=0xc820040cb8 sp=0xc820040c50\r\ngithub.com/omniscale/imposm3/cache.(*WaysCache).PutWays(0xc82015c720, 0xc836424000, 0x1f40, 0x1f40, 0x0, 0x0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/cache/ways.go:50 +0x1c4 fp=0xc820040e50 sp=0xc820040cb8\r\ngithub.com/omniscale/imposm3/reader.ReadPbf.func3(0xc8200170c0, 0xc82015a4e0, 0xc8201548b0, 0xc820154870, 0xc820168000, 0xc820154550, 0xc8201548c0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:130 +0x41f fp=0xc820040f78 sp=0xc820040e50\r\nruntime.goexit()\r\n        /usr/local/go/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc820040f80 sp=0xc820040f78\r\ncreated by github.com/omniscale/imposm3/reader.ReadPbf\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:138 +0x6cc\r\n\r\ngoroutine 1 [semacquire, 157 minutes]:\r\nsync.runtime_Semacquire(0xc82015e44c)\r\n        /usr/local/go/src/runtime/sema.go:43 +0x26\r\nsync.(*WaitGroup).Wait(0xc82015e440)\r\n        /usr/local/go/src/sync/waitgroup.go:126 +0xb4\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).Parse(0xc82015e410)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:51 +0xc9\r\ngithub.com/omniscale/imposm3/reader.ReadPbf(0xc820168000, 0xc820154550, 0xc8200170c0, 0xc82015c7e0, 0x0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:241 +0x971\r\ngithub.com/omniscale/imposm3/import_.Import()\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/import_/import.go:120 +0xa87\r\ngithub.com/omniscale/imposm3/cmd.Main(0xaab9b8)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/cmd/main.go:46 +0x2d2\r\nmain.main()\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/imposm3.go:8 +0x23\r\n\r\ngoroutine 17 [syscall, 157 minutes, locked to thread]:\r\nruntime.goexit()\r\n        /usr/local/go/src/runtime/asm_amd64.s:1696 +0x1\r\n\r\ngoroutine 5 [runnable]:\r\ntime.nextStdChunk(0x9c3e93, 0xc, 0x3, 0x2, 0xd, 0x2b, 0xc)\r\n        /usr/local/go/src/time/format.go:120\r\ntime.Time.AppendFormat(0xece507b1b, 0x18455965, 0xe60100, 0xc820053868, 0x3, 0x40, 0x9c3e93, 0xc, 0x0, 0x0, ...)\r\n        /usr/local/go/src/time/format.go:449 +0x11d\r\ntime.Time.Format(0xece507b1b, 0x18455965, 0xe60100, 0x9c3e90, 0xf, 0x0, 0x0)\r\n        /usr/local/go/src/time/format.go:430 +0xf2\r\ngithub.com/omniscale/imposm3/logging.(*LogBroker).printPrefix(0xe600a0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/logging/logger.go:177 +0x84\r\ngithub.com/omniscale/imposm3/logging.(*LogBroker).printRecord(0xe600a0, 0x1, 0x9bc940, 0x6, 0xc82c828120, 0x59)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/logging/logger.go:200 +0x110\r\ngithub.com/omniscale/imposm3/logging.(*LogBroker).loop(0xe600a0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/logging/logger.go:145 +0x264\r\ncreated by github.com/omniscale/imposm3/logging.init.1\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/logging/logger.go:240 +0x17a\r\n\r\ngoroutine 7 [chan receive, 157 minutes]:\r\ndatabase/sql.(*DB).connectionOpener(0xc82000b680)\r\n        /usr/local/go/src/database/sql/sql.go:634 +0x45\r\ncreated by database/sql.Open\r\n        /usr/local/go/src/database/sql/sql.go:481 +0x336\r\n\r\ngoroutine 18 [select]:\r\ngithub.com/omniscale/imposm3/stats.(*Statistics).loop(0xc820154550)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/stats/stats.go:109 +0x1bd\r\ncreated by github.com/omniscale/imposm3/stats.NewStatsReporter\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/stats/stats.go:88 +0xa6\r\n\r\ngoroutine 19 [runnable, locked to thread]:                                                                                                              [85/411]\r\ngithub.com/jmhodges/levigo._Cfunc_leveldb_writebatch_put(0x7fa300002f20, 0xc84aa14030, 0x8, 0xc829a98000, 0x25)\r\n        github.com/jmhodges/levigo/_obj/_cgo_gotypes.go:871 +0x35\r\ngithub.com/jmhodges/levigo.(*WriteBatch).Put(0xc843f9e098, 0xc84aa14030, 0x8, 0x8, 0xc829a98000, 0x25, 0x30)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/Godeps/_workspace/src/github.com/jmhodges/levigo/batch.go:51 +0x6e\r\ngithub.com/omniscale/imposm3/cache.(*WaysCache).PutWays(0xc82015c720, 0xc859726000, 0x1f40, 0x1f40, 0x0, 0x0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/cache/ways.go:48 +0x440\r\ngithub.com/omniscale/imposm3/reader.ReadPbf.func3(0xc8200170c0, 0xc82015a4e0, 0xc8201548b0, 0xc820154870, 0xc820168000, 0xc820154550, 0xc8201548c0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:130 +0x41f\r\ncreated by github.com/omniscale/imposm3/reader.ReadPbf\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:138 +0x6cc\r\n\r\ngoroutine 21 [chan receive, 157 minutes]:\r\ngithub.com/omniscale/imposm3/reader.ReadPbf.func4(0xc8200170c0, 0xc82015a5a0, 0xc820154870, 0xc820168000, 0xc820154550, 0xc8201548c0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:147 +0xd9\r\ncreated by github.com/omniscale/imposm3/reader.ReadPbf\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:176 +0x780\r\n\r\ngoroutine 22 [chan receive, 157 minutes]:\r\ngithub.com/omniscale/imposm3/reader.ReadPbf.func4(0xc8200170c0, 0xc82015a5a0, 0xc820154870, 0xc820168000, 0xc820154550, 0xc8201548c0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:147 +0xd9\r\ncreated by github.com/omniscale/imposm3/reader.ReadPbf\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:176 +0x780\r\n\r\ngoroutine 23 [chan receive, 72 minutes]:\r\ngithub.com/omniscale/imposm3/reader.ReadPbf.func5(0xc82015a420, 0xc8201548a0, 0xc820154870, 0x0, 0xc820168000, 0xc820154550, 0xc8201548c0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:186 +0xb3\r\ncreated by github.com/omniscale/imposm3/reader.ReadPbf\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:206 +0x85b\r\n\r\ngoroutine 24 [chan receive, 72 minutes]:\r\ngithub.com/omniscale/imposm3/reader.ReadPbf.func5(0xc82015a420, 0xc8201548a0, 0xc820154870, 0x0, 0xc820168000, 0xc820154550, 0xc8201548c0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:186 +0xb3\r\ncreated by github.com/omniscale/imposm3/reader.ReadPbf\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:206 +0x85b\r\n\r\ngoroutine 25 [chan receive, 72 minutes]:\r\ngithub.com/omniscale/imposm3/reader.ReadPbf.func6(0xc8200170c0, 0xc82015a360, 0xc8201548a0, 0xc820154870, 0x0, 0xc820168000, 0xc820154550, 0xc8201548c0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:216 +0xc6\r\ncreated by github.com/omniscale/imposm3/reader.ReadPbf\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:238 +0x943\r\n\r\ngoroutine 26 [chan receive, 72 minutes]:\r\ngithub.com/omniscale/imposm3/reader.ReadPbf.func6(0xc8200170c0, 0xc82015a360, 0xc8201548a0, 0xc820154870, 0x0, 0xc820168000, 0xc820154550, 0xc8201548c0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:216 +0xc6\r\ncreated by github.com/omniscale/imposm3/reader.ReadPbf\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/reader/reader.go:238 +0x943\r\n\r\ngoroutine 27 [chan send]:\r\ngithub.com/omniscale/imposm3/parser/pbf.(*Pbf).BlockPositions.func1(0xc82015c7e0, 0xc820166128)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/lowlevel.go:173 +0x191\r\ncreated by github.com/omniscale/imposm3/parser/pbf.(*Pbf).BlockPositions\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/lowlevel.go:175 +0x96\r\n\r\ngoroutine 28 [chan send]:                                                                                                                               [31/411]\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).parseBlock(0xc82015e410, 0x7ffd0a3fe75c, 0x18, 0x75148053a, 0x33f993)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:112 +0x524\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).Parse.func1(0xc82015a660, 0xc82015e410)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:40 +0xb0\r\ncreated by github.com/omniscale/imposm3/parser/pbf.(*parser).Parse\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:49 +0x95\r\n\r\ngoroutine 29 [chan send]:\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).parseBlock(0xc82015e410, 0x7ffd0a3fe75c, 0x18, 0x750e59aaa, 0x32f9ca)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:112 +0x524\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).Parse.func1(0xc82015a660, 0xc82015e410)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:40 +0xb0\r\ncreated by github.com/omniscale/imposm3/parser/pbf.(*parser).Parse\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:49 +0x95\r\n\r\ngoroutine 30 [chan send]:\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).parseBlock(0xc82015e410, 0x7ffd0a3fe75c, 0x18, 0x7517bfedf, 0x3228b6)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:112 +0x524\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).Parse.func1(0xc82015a660, 0xc82015e410)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:40 +0xb0\r\ncreated by github.com/omniscale/imposm3/parser/pbf.(*parser).Parse\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:49 +0x95\r\n\r\ngoroutine 31 [runnable]:\r\ngithub.com/omniscale/imposm3/parser/pbf.parseTags(0xc845a08000, 0x8f32, 0x8f32, 0xc83f1b7930, 0x1, 0x2, 0xc83f1b7940, 0x1, 0x2, 0xc820ad30e0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/pbf.go:90 +0x153\r\ngithub.com/omniscale/imposm3/parser/pbf.readWays(0xc84fa10000, 0x1f40, 0x2400, 0xc84708f440, 0xc845a08000, 0x8f32, 0x8f32, 0x0, 0x0, 0x0)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/pbf.go:151 +0x17e\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).parseBlock(0xc82015e410, 0x7ffd0a3fe75c, 0x18, 0x751ae27a7, 0x2f465b)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:107 +0x466\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).Parse.func1(0xc82015a660, 0xc82015e410)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:40 +0xb0\r\ncreated by github.com/omniscale/imposm3/parser/pbf.(*parser).Parse\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:49 +0x95\r\n\r\ngoroutine 32 [chan send]:\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).parseBlock(0xc82015e410, 0x7ffd0a3fe75c, 0x18, 0x751dd6e14, 0x2f2c2a)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:112 +0x524\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).Parse.func1(0xc82015a660, 0xc82015e410)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:40 +0xb0\r\ncreated by github.com/omniscale/imposm3/parser/pbf.(*parser).Parse\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:49 +0x95\r\n\r\ngoroutine 33 [chan send]:\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).parseBlock(0xc82015e410, 0x7ffd0a3fe75c, 0x18, 0x7520c9a50, 0x304c8b)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:112 +0x524\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).Parse.func1(0xc82015a660, 0xc82015e410)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:40 +0xb0\r\ncreated by github.com/omniscale/imposm3/parser/pbf.(*parser).Parse\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:49 +0x95\r\n\r\ngoroutine 34 [chan send]:\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).parseBlock(0xc82015e410, 0x7ffd0a3fe75c, 0x18, 0x7527099a8, 0x350ea2)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:112 +0x524\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).Parse.func1(0xc82015a660, 0xc82015e410)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:40 +0xb0\r\ncreated by github.com/omniscale/imposm3/parser/pbf.(*parser).Parse\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:49 +0x95\r\n\r\ngoroutine 35 [chan send]:\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).parseBlock(0xc82015e410, 0x7ffd0a3fe75c, 0x18, 0x7523ce6ed, 0x33b2a9)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:112 +0x524\r\ngithub.com/omniscale/imposm3/parser/pbf.(*parser).Parse.func1(0xc82015a660, 0xc82015e410)\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:40 +0xb0\r\ncreated by github.com/omniscale/imposm3/parser/pbf.(*parser).Parse\r\n        /home/os/imposm/src/github.com/omniscale/imposm3/parser/pbf/process.go:49 +0x95\r\n\r\n```\r\n\r\nCommand line was ``imposm3-0.1dev-20160128-bb3d003-linux-x86-64/imposm3 import -mapping CartoDB-basemaps/imposm3_mapping.json -connection='postgis://?prefix=NONE' -read ../planet-160208.osm.pbf -write -deployproduction -overwritecache``\r\n\r\n3210564187 matches closely with the total number of nodes"},"comment":{"url":"https://api.github.com/repos/omniscale/imposm3/issues/comments/194962636","html_url":"https://github.com/omniscale/imposm3/issues/90#issuecomment-194962636","issue_url":"https://api.github.com/repos/omniscale/imposm3/issues/90","id":194962636,"user":{"login":"olt","id":235174,"avatar_url":"https://avatars.githubusercontent.com/u/235174?v=3","gravatar_id":"","url":"https://api.github.com/users/olt","html_url":"https://github.com/olt","followers_url":"https://api.github.com/users/olt/followers","following_url":"https://api.github.com/users/olt/following{/other_user}","gists_url":"https://api.github.com/users/olt/gists{/gist_id}","starred_url":"https://api.github.com/users/olt/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/olt/subscriptions","organizations_url":"https://api.github.com/users/olt/orgs","repos_url":"https://api.github.com/users/olt/repos","events_url":"https://api.github.com/users/olt/events{/privacy}","received_events_url":"https://api.github.com/users/olt/received_events","type":"User","site_admin":false},"created_at":"2016-03-10T17:14:12Z","updated_at":"2016-03-10T17:14:12Z","body":"It does crash if it runs out of free space. This is a \"feature\" of LevelDB that Imposm can't work around. I've added a note to the documentation: 4ad6843"}}