{"action":"created","issue":{"url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles/issues/251","repository_url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles","labels_url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles/issues/251/labels{/name}","comments_url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles/issues/251/comments","events_url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles/issues/251/events","html_url":"https://github.com/osm2vectortiles/osm2vectortiles/issues/251","id":148988753,"number":251,"title":"Render Planet","user":{"login":"lukasmartinelli","id":1288339,"avatar_url":"https://avatars.githubusercontent.com/u/1288339?v=3","gravatar_id":"","url":"https://api.github.com/users/lukasmartinelli","html_url":"https://github.com/lukasmartinelli","followers_url":"https://api.github.com/users/lukasmartinelli/followers","following_url":"https://api.github.com/users/lukasmartinelli/following{/other_user}","gists_url":"https://api.github.com/users/lukasmartinelli/gists{/gist_id}","starred_url":"https://api.github.com/users/lukasmartinelli/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lukasmartinelli/subscriptions","organizations_url":"https://api.github.com/users/lukasmartinelli/orgs","repos_url":"https://api.github.com/users/lukasmartinelli/repos","events_url":"https://api.github.com/users/lukasmartinelli/events{/privacy}","received_events_url":"https://api.github.com/users/lukasmartinelli/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles/labels/performance","name":"performance","color":"eb6420"}],"state":"open","locked":false,"assignee":{"login":"lukasmartinelli","id":1288339,"avatar_url":"https://avatars.githubusercontent.com/u/1288339?v=3","gravatar_id":"","url":"https://api.github.com/users/lukasmartinelli","html_url":"https://github.com/lukasmartinelli","followers_url":"https://api.github.com/users/lukasmartinelli/followers","following_url":"https://api.github.com/users/lukasmartinelli/following{/other_user}","gists_url":"https://api.github.com/users/lukasmartinelli/gists{/gist_id}","starred_url":"https://api.github.com/users/lukasmartinelli/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lukasmartinelli/subscriptions","organizations_url":"https://api.github.com/users/lukasmartinelli/orgs","repos_url":"https://api.github.com/users/lukasmartinelli/repos","events_url":"https://api.github.com/users/lukasmartinelli/events{/privacy}","received_events_url":"https://api.github.com/users/lukasmartinelli/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles/milestones/18","html_url":"https://github.com/osm2vectortiles/osm2vectortiles/milestones/v1.6","labels_url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles/milestones/18/labels","id":1619633,"number":18,"title":"v1.6","description":"","creator":{"login":"manuelroth","id":1810384,"avatar_url":"https://avatars.githubusercontent.com/u/1810384?v=3","gravatar_id":"","url":"https://api.github.com/users/manuelroth","html_url":"https://github.com/manuelroth","followers_url":"https://api.github.com/users/manuelroth/followers","following_url":"https://api.github.com/users/manuelroth/following{/other_user}","gists_url":"https://api.github.com/users/manuelroth/gists{/gist_id}","starred_url":"https://api.github.com/users/manuelroth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/manuelroth/subscriptions","organizations_url":"https://api.github.com/users/manuelroth/orgs","repos_url":"https://api.github.com/users/manuelroth/repos","events_url":"https://api.github.com/users/manuelroth/events{/privacy}","received_events_url":"https://api.github.com/users/manuelroth/received_events","type":"User","site_admin":false},"open_issues":5,"closed_issues":16,"state":"open","created_at":"2016-03-03T08:46:49Z","updated_at":"2016-05-10T09:23:49Z","due_on":"2016-05-15T22:00:00Z","closed_at":null},"comments":22,"created_at":"2016-04-17T19:48:00Z","updated_at":"2016-05-11T16:31:11Z","closed_at":null,"body":"Currently running Europe (based on latest master so v1.4 + patches) to detect problems in the export process before we start the initial world rendering once the stable v1.5 is released.\r\n\r\nWill go through the entire process (including updating once, dirty tiles and again workers) with Europe as test.\r\n\r\nAlready detected some bugs in 195bbfa9f21899e113e6c011a085ba3d9f03e91b and c67170bdf603291db7564325e744e62b7f3bdede.\r\n\r\nThe nice thing is that **tilelive-copy** seems to pump out much more tiles per second than **tl** before did. (80/s for one machine).\r\nOther interesting fact is that once you scale to two workers the tiles per second for the workers just half - which means that they already pretty much use the database at full limit.\r\n"},"comment":{"url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles/issues/comments/218514584","html_url":"https://github.com/osm2vectortiles/osm2vectortiles/issues/251#issuecomment-218514584","issue_url":"https://api.github.com/repos/osm2vectortiles/osm2vectortiles/issues/251","id":218514584,"user":{"login":"ImreSamu","id":2217320,"avatar_url":"https://avatars.githubusercontent.com/u/2217320?v=3","gravatar_id":"","url":"https://api.github.com/users/ImreSamu","html_url":"https://github.com/ImreSamu","followers_url":"https://api.github.com/users/ImreSamu/followers","following_url":"https://api.github.com/users/ImreSamu/following{/other_user}","gists_url":"https://api.github.com/users/ImreSamu/gists{/gist_id}","starred_url":"https://api.github.com/users/ImreSamu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ImreSamu/subscriptions","organizations_url":"https://api.github.com/users/ImreSamu/orgs","repos_url":"https://api.github.com/users/ImreSamu/repos","events_url":"https://api.github.com/users/ImreSamu/events{/privacy}","received_events_url":"https://api.github.com/users/ImreSamu/received_events","type":"User","site_admin":false},"created_at":"2016-05-11T16:31:11Z","updated_at":"2016-05-11T16:31:11Z","body":"> Regarding Bitmap Index Scan ..\r\n\r\nmy optimization idea  ( need more research , and for  just the v2.x iterations  ) \r\n\r\n**IDEA:**   Data processing optimized imposm3 mappings ( = more `logical partitions` )\r\nThe current design is  `one database table per layer` sometimes not optimal,\r\nbut we can split the big  massive tables  into many smaller tables ( called partitions or child tables)\r\n\r\nso, Instead of one big `osm_road_geometry`table and a complex filtering \r\n* there will be   6 road `child tables`  +  simple SQL ` type in ` filtering   \r\n* OR there will be ~25  road  `child tables` and optimal solutions for the 'road_label' and 'road' layers.\r\n\r\nfor example the  ~25   road  `child tables` example :\r\n* `road_z10` layer will be the SQL UNION of the following new `child tables`\r\n * road_motorway\r\n * road_trunk\r\n * road_primary\r\n * road_secondary\r\n * road_motorway_link\r\n * road_major_rail\r\n * road_major_rail_light\r\n * road_tertiary\r\n\r\nPRO:\r\n * optimized tables for rendering - performance gain\r\n \r\nCON:\r\n * to complex design , lot of tables  \r\n  * need some hand made design tools,  meta tables , ....   \r\n * We need to add some clever post-processing and/or some advanced filtering :\r\n  * for example the mis-tagged osm objects with:  railway=rail AND golf=hole   \r\n\r\nRISK:\r\n * The current (nonofficial and not final and not matured ) advanced filtering  -> [work in progress ] ( https://github.com/ImreSamu/imposm3/commit/73ab6de78a6d5e528552d6c1d09adecba8d5b9a4 ) \r\n\r\n\r\nSTATUS:\r\n *  only draft design:  [ xls ]  \r\n(https://docs.google.com/spreadsheets/d/1ilMLJ_iXIfWJ39ucOI5VIIjwvnClem6RbY5RxZP1Ies/edit?usp=sharing)\r\n  * 6 road child tables\r\n  * 25 road child tables  \r\n\r\n\r\n\r\n\r\n**MORE IMPROVED IDEA:**\r\n * the  ( next generation)  imposm3 will have an  Auto-partitioning  support.   \r\n   * and will  be automatically  generating  [PG Master and Child Tables] (http://www.postgresql.org/docs/9.5/static/ddl-partitioning.html)  from the mapping definitions.\r\n      *  by  `type`  ( = `mapping_value` )\r\n      *  and/or  by QuadTiles\r\n\r\n\r\n\r\n\r\n"}}