{"action":"created","issue":{"url":"https://api.github.com/repos/omniscale/imposm3/issues/122","repository_url":"https://api.github.com/repos/omniscale/imposm3","labels_url":"https://api.github.com/repos/omniscale/imposm3/issues/122/labels{/name}","comments_url":"https://api.github.com/repos/omniscale/imposm3/issues/122/comments","events_url":"https://api.github.com/repos/omniscale/imposm3/issues/122/events","html_url":"https://github.com/omniscale/imposm3/issues/122","id":181483664,"number":122,"title":"Error while updating planet import","user":{"login":"svancise","id":5982096,"avatar_url":"https://avatars.githubusercontent.com/u/5982096?v=3","gravatar_id":"","url":"https://api.github.com/users/svancise","html_url":"https://github.com/svancise","followers_url":"https://api.github.com/users/svancise/followers","following_url":"https://api.github.com/users/svancise/following{/other_user}","gists_url":"https://api.github.com/users/svancise/gists{/gist_id}","starred_url":"https://api.github.com/users/svancise/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/svancise/subscriptions","organizations_url":"https://api.github.com/users/svancise/orgs","repos_url":"https://api.github.com/users/svancise/repos","events_url":"https://api.github.com/users/svancise/events{/privacy}","received_events_url":"https://api.github.com/users/svancise/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":13,"created_at":"2016-10-06T17:57:00Z","updated_at":"2016-10-10T07:44:47Z","closed_at":"2016-10-10T07:41:41Z","body":"Hi, I've had a cron job running everyday updating a planet osm import and it has been working great. However, I checked my logs this morning and found that the update has crashed for the past two days (October 5th and 6th). Error below. I've tried to re run a few times, but it seems to get the same error while parsing the diff. Seems to be something while parsing a feature's tags.\r\n\r\nOS is Ubuntu 14.04\r\nBuild is 0.2.0dev-20160615-d495ca4\r\n\r\nThanks!\r\n\r\n```\r\n[Oct  6 17:17:33] Processing /home/ubuntu/osm_data/changes.osc.gz\r\n[Oct  6 17:17:33] Parsing changes, updating cache and removing elements\r\n[Oct  6 17:18:33] [INFO] [  1m0s] C:   13000/s (815821) N:     400/s (29836) W:       0/s (0) R:      0/s (0)\r\n[Oct  6 17:19:33] [INFO] [  2m0s] C:   22000/s (2667879) N:     600/s (74916) W:       0/s (0) R:      0/s (0)\r\n[Oct  6 17:19:47] [INFO] [diff] Processing /home/ubuntu/osm_data/changes.osc.gz took: 2m13.958160413s\r\npanic: runtime error: index out of range\r\n\r\ngoroutine 1 [running]:\r\npanic(0x990960, 0xc82000e0b0)\r\n        /root/imposm/go/src/runtime/panic.go:464 +0x3e6\r\ngithub.com/omniscale/imposm3/cache/binary.tagsFromArray(0xc82249b420, 0x2, 0x2, 0x7fe452fcfc40)\r\n        /root/imposm/gopath/src/github.com/omniscale/imposm3/cache/binary/tags.go:85 +0x43e\r\ngithub.com/omniscale/imposm3/cache/binary.UnmarshalNode(0xc82244bbc0, 0x21, 0x21, 0xc82249b440, 0x0, 0x0)\r\n        /root/imposm/gopath/src/github.com/omniscale/imposm3/cache/binary/serialize.go:43 +0x1d4\r\ngithub.com/omniscale/imposm3/cache.(*NodesCache).GetNode(0xc82011ab70, 0x1081266ff, 0x0, 0x0, 0x0)\r\n        /root/imposm/gopath/src/github.com/omniscale/imposm3/cache/nodes.go:70 +0x291\r\ngithub.com/omniscale/imposm3/diff.(*Deleter).deleteNode(0xc8211bf960, 0x1081266ff, 0x0, 0x0)\r\n        /root/imposm/gopath/src/github.com/omniscale/imposm3/diff/deleter.go:188 +0x57\r\ngithub.com/omniscale/imposm3/diff.(*Deleter).Delete(0xc8211bf960, 0x1, 0xc82249b0a0, 0x0, 0x0, 0x0, 0x0)\r\n        /root/imposm/gopath/src/github.com/omniscale/imposm3/diff/deleter.go:235 +0x2af\r\ngithub.com/omniscale/imposm3/diff.Update(0x7fff361c4930, 0x24, 0x0, 0x0, 0x0, 0xc820019000, 0xc82011ac30, 0x0, 0x0, 0x0)\r\n        /root/imposm/gopath/src/github.com/omniscale/imposm3/diff/process.go:209 +0x3434\r\ngithub.com/omniscale/imposm3/diff.Diff()\r\n        /root/imposm/gopath/src/github.com/omniscale/imposm3/diff/process.go:60 +0x835\r\ngithub.com/omniscale/imposm3/cmd.Main(0xb4bea8)\r\n        /root/imposm/gopath/src/github.com/omniscale/imposm3/cmd/main.go:53 +0x1f1\r\nmain.main()\r\n        /root/imposm/gopath/src/github.com/omniscale/imposm3/imposm3.go:8 +0x23\r\n```"},"comment":{"url":"https://api.github.com/repos/omniscale/imposm3/issues/comments/252553219","html_url":"https://github.com/omniscale/imposm3/issues/122#issuecomment-252553219","issue_url":"https://api.github.com/repos/omniscale/imposm3/issues/122","id":252553219,"user":{"login":"olt","id":235174,"avatar_url":"https://avatars.githubusercontent.com/u/235174?v=3","gravatar_id":"","url":"https://api.github.com/users/olt","html_url":"https://github.com/olt","followers_url":"https://api.github.com/users/olt/followers","following_url":"https://api.github.com/users/olt/following{/other_user}","gists_url":"https://api.github.com/users/olt/gists{/gist_id}","starred_url":"https://api.github.com/users/olt/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/olt/subscriptions","organizations_url":"https://api.github.com/users/olt/orgs","repos_url":"https://api.github.com/users/olt/repos","events_url":"https://api.github.com/users/olt/events{/privacy}","received_events_url":"https://api.github.com/users/olt/received_events","type":"User","site_admin":false},"created_at":"2016-10-10T07:44:47Z","updated_at":"2016-10-10T07:44:47Z","body":"Imposm reduces the cache size by encoding common keys and tag combinations (like `highway=residential`) with \"ASCII\" control characters and private Unicode symbols. There was no escaping of these symbols as the user defined which tags are cached and other tags were filtered out anyway.\r\nThis condition does not apply anymore with the `load_all` feature and it now crashed when a user added a backspace character in the key (Thanks @ImreSamu for finding this one). \r\n\r\nAll encoding symbols are now properly escaped.\r\n\r\n**All users who use `load_all` with diff imports should upgrade to 4a472f5 from 2016-10-10 or higher and do a full re-import.**\r\n\r\nThere is a new binary at https://imposm.org/static/rel/\r\n\r\nThanks for reporting this issue and sorry for the trouble it might have caused you."}}
{"actor":{"display_login":"olt"}}