Development of national spatial information sharing system using the FOSS4G and CKAN, Drupal
CC Attribution 3.0 Germany:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Kayama, Yoichi (Aeroasahi Corporation)
The Japanese government has begun to create and execute a plan to take advantage of the combined spatial information and ICT technology. From 2014 the Ministry of Internal Affairs and Communications has developed the G-space platform for circulating to collect spatial information of the public and private sectors. I have participated in the development to use the FOSS4G in this system. The G-Space platform of Japanese Goverment is based on data catalog system configured with CKAN and Drupal. We improved spatial information data preview feature in CKAN. We created additional data processing functions for the space-based resources in the CKAN. We did a feature extension for space resources of the selected in CKAN　to be displayed using LeafLet . Also we use the GeoServer + PostGIS as a back-end to provide spatial information. Even if the use request to this system becomes much, as can be supported by clustering the back-end system. I'm going to the explanation how we had used the FOSS4G in this system.
 Hello. How's everyone doing? Do you have some coffee? No? Yes? Today we are going to have a presentation from Yohchi Kajama. He is a senior scientist in the Jewish special laboratory of the Aero Ashashi Corporation. And today he will be presenting. So please, after we're finished, please open up the floor for questions. And he will do his best in speaking English, and he may need some assistance from time to time as well. So if you guys could be so patient with us. So thank you very much. Continue. Hello. Hello. My name is Yohchi Kajama from Japan. And sorry, I'm not good at speaking and hearing in English. I am a O.S.J.P. board member and a GIS association of Japan, the member of... First for the special interest group in GIS association of Japan, a member of the Aero Ashashi Corporation. And working at the QGIS community in Japan and working at Aero Ashashi Corporation. So 2013, Z8 has announced the open data chapter, a charter. And then many governments have begun, published their data on the Internet. Many sites of French, German, and Russia, and Canada, and to... UK, United Kingdom site is very old and famous. And they have using such a site using SIKAN. And there are many data sets and metadata in SIKAN. And we can search metadata. And there are metadata and resource. Resource is the database or data file. And there is not only special information data, but also many other data. Without text data, PDF data, or cumbersprite data, file data. And in United Kingdom government site, there are... If data is a special data, in this site, we can search data, drawing on map. And this is the state government site. This site is using SIKAN 2. And in this site, we can search a dataset with a special extension and draw such special data on the map. Government of Japan also began to make such a dataset site using SIKAN. And data... This is a geo-special authority institute site, only a special data site. But Japanese government site has no maps. In government site, have special data. But we can't see such data on map. Only metadata, text data, who make this data and how to use this data format. But we need such special data to see on the map. Government government is promoting projects to utilization of digital special information in parallel with open data. This is another government promotion. This is Japanese government project budget from 2013 to 2020. And all text is Japanese. So many people can't understand this. Only he can understand. Overview of the plan of government. Launch an organization to operate it by creating a foundation system, fundamental system of special information and construction of disaster prevention system and improve the use of IT in agriculture, forestry and fishers. And activate the local activity and to expand the project that use special information technology to upload. Japanese government plan about special information from 2013. And this talk, I described the presentation about the Mac 2GRAC, launch the organization and creating a foundation system of special information at Japanese government. 2014 to 2015, Ministry of Internal Affairs and Communications Japanese government has developed a system named G-Space platform, G-Space, perhaps G means geospatial. This is such sites image. And this project has this group gave the system development work and national institute of information and communications technology. And this is a private company, big information technology company. And the University of Tokyo, this is Japanese university. And I did the work of creating a mechanism to use the special information in combination of the open source software in this team. This two year I worked in this team using how to use force for G for that system. And this year, another ministry, Ministry of Land Infrastructure and Transport is preparing for the operation of this system. And last two years is development for that system for prototype. And this year, preparing operation of this system. And this year, Ministry preparing for operation of this system. And IGIT, this is a group of association for promotion of infrastructure geospatial information distribution. We make the operation of this system. And I'm also a member of IGIT. And I work for publishing this system in IGIT now. This is all the parts of this system. And this is a system configuration. Maybe you can understand. And front end is Apache and using Seekang and using Drupal. Drupal is a content management, famous content management system. And Seekang is a catalog server. And back end is a geoserver. Maybe you know, famous force for this, rendering and distributing OTC format data. And Solar is in search engine for the text. So in this case, Solar is query for spatial extension and using a post-glare scale and post this. Maybe you know. And Seekang has an interface to good one, OGR. This is a force for this. And this system is not same as Japanese government. All the system has a map. And using a reflet, this publishes a map. Using Seekang, Seekang as data catalog. Seekang is a world-leading open source data portal platform. And the U.K. government, U.S. state government or any other many government of U.R. using this system. And all the AD extensions for some of the spatial data has been implemented in Seekang. Using Seekang exit is extension spatial and Seekang exit high-fone geo view and recline view Seekang exit under view of base maps. And for what describe each extension's function. And Seekang exit spatial has made Ad-Seekang about spatial data, spatial data metadata and implement Seekang exit spatial. You can search metadata using area or format. And Seekang exit geo view can make a function. When you open the special data resource in Seekang, make a preview at maps and recline is a famous JavaScript library using search as a commercial value data. If commercial value data includes a coordinate, in Seekang, recline view display its data on the map. And Seekang exit base map is using base map for Seekang exit geo view or recline view provide maps as a base map. This is our prototype systems. And function that we have extended is here. Improved the preview function of spatial resource and implementation of the spatial data processing function using the good old GR from Seekang. And implement the web map to display selected spatial resource in Seekang. And made the ability to purchase application by selecting the spatial data product with private companies. This site has not only government data but also private company data such as product. And there is the ability to, if people using this site who want to buy such a data from a company, they can find data. But this is a private company's data. If they want to use that data, they must pay. But how to get such data introduce this site. Improved preview function of spatial data. Back to WMS preview, WMS data has preview function at geo view and all the special Seekang exit special. But that has many bugs. If we display such a preview display. Next position is not drawing. And preview KML and GeoJSON and CZML. KML and GeoJSON is famous. ZML is data format for Sezium. That is XML format and coordinate and timeline data. And use GSI geo special institute, Japanese government provided map data. Map as background map. And next implementation of the special data processing function using the guudaru or guudaru. And how to use. Select the special resource in Seekang. And in Seekang's display, we can use the processing method and specify the parameter for the processing. And execute if we can, okay, we click okay, execute processing. But some data, if big data using processing, we must have a very long time waiting. So that is not good for using such a web application. So we thought start in execute, change as Seekang government and store the result in the web public directory of the server. This process is a background batch processing. And send the result of the URL by email to the user. And user open the URL and download the result. If there are some, any error occurred to use a sender electric mail about your error. So user is waiting result of good result or bad result using electric email. And next, implementation of the web map to overlay displaying selected plural special resource in the Seekang. This is a display of the web map implemented using a reflet. And this is a left is a display of the Seekang dataset displaying. So maybe you only Japanese. And here, this button add map. So there is a resource that has a map add button. And another resource has not have a map add. So data type, some data type can add map. But another is not ability to add map. So we can make some maps, click add map, and then open a map, map, map, okay. And then made the ability to purchase application by selecting the special data product with private companies. Many of the private companies in Japan have sold the special data such as satellite image, IR, laser measurement data, navigation log, and so the position of the mobile phone log they sold. And you can find them in our site. And you can also make a purchase application of the data. This is a display of such. And select where you want and make an ad work card and make an estimate. You can. The future plans, we are working on trying the public of the system of this year in November. It is also plan use paid data of the private sector in this time. And we are trying to implement a preview and overlay display of the various, various things with time. I am a member of the QGIS community. And I want to talk about QGIS. We can use a wonderful plug-in called the second browser in QGIS. In QGIS, all Japanese. And in this, using this plug-in from QGIS to second direct to connecting and can search. And we can using a second data using QGIS directory. So I think QGIS is excellent tool in order to use such a data repository. Thank you for your attention. Are there any questions? Okay. Hi. I don't know which end user can get format special data. Is it file or some service or something else from your system? Data format. Data format. Okay. And data format download from SIGAN. SIGAN has any format put and download on the file. And we can provide preview using a few format. About WMS, WFS, KML, GeoJSON, RasterTile and CZML. So we extend about format number. What? Do you directly load it in SIGAN or in GeoServer? GeoServer. Oh, SIGAN has file storing file as a local file system. And Amazon S3. So we put this in this system, storing a file, Amazon S3. And another not a file is WMS is not a file. This is a web service. Web service is another. So it is loading the sql file stretchedals andridge config. Can I use it? It is a dataset and dataset has a file resource and this is a WMS resource and a title resource. So one dataset have a several type of data. Some data is a file, some data is a store, post-GIS and using a geosurfer. And second can register resource as well. Not in this server, in another server resource link. So many kind of data can store. Am I right with file storage, geosurfer storage, post-GIS storage, AWS storage not connected. If something change you need reload it. It's not the common storage for each data. There are management in this server's data is have a... No illegal change. But if there are some link from another site, maybe sometimes happens such a illegal change, I think. Is it okay? Okay. Sorry, I'm not good at using English. So please, yes. Any additional questions? Did you want to say something? I will ask you in English. Please use Japanese. Okay. Can I speak? Well, pretend I am a provider of a data. Okay. I'm like a company and I want to put my data into this platform. What should I do? Okay. This...and you put...you want to put your data in this system to tell manager of this site. And so it is not automatic registration. You cannot automatic registration. So your message, read managers and if they think okay, you are a good man. So you can register your data here. Okay. Thank you very much, Yuchi. Thank you. Thank you. Yes. Thank you. Okay.
 Hello.  How's everyone doing?  Do you have some coffee?  No?  Yes?  Today we are going to have a presentation from Yohchi Kajama.  He is a senior scientist in the Jewish special laboratory of the Aero Ashashi Corporation.  And today he will be presenting.  So please, after we're finished, please open up the floor for questions.  And he will do his best in speaking English, and he may need some assistance from time  to time as well.  So if you guys could be so patient with us.  So thank you very much.  Continue.  Hello.  Hello. My name is Yohchi Kajama from Japan. And sorry, I'm not good at speaking and hearing  in English.  I am a O.S.J.P. board member and a GIS association of Japan, the member of...  First for the special interest group in GIS association of Japan, a member of the Aero  Ashashi Corporation.  And working at the QGIS community in Japan and working at Aero Ashashi Corporation.  So 2013, Z8 has announced the open data chapter, a charter.  And then many governments have begun, published their data on the Internet.  Many sites of French, German, and Russia, and Canada, and to...  UK, United Kingdom site is very old and famous.  And they have using such a site using SIKAN.  And there are many data sets and metadata in SIKAN.  And we can search metadata.  And there are metadata and resource.  Resource is the database or data file.  And there is not only special information data, but also many other data.  Without text data, PDF data, or cumbersprite data, file data.  And in United Kingdom government site, there are...  If data is a special data, in this site, we can search data, drawing on map.  And this is the state government site.  This site is using SIKAN 2.  And in this site, we can search a dataset with a special extension and draw such special  data on the map.  Government of Japan also began to make such a dataset site using SIKAN.  And data...  This is a geo-special authority institute site, only a special data site.  But Japanese government site has no maps.  In government site, have special data.  But we can't see such data on map.  Only metadata, text data, who make this data and how to use this data format.  But we need such special data to see on the map.  Government government is promoting projects to utilization of digital special information  in parallel with open data.  This is another government promotion.  This is Japanese government project budget from 2013 to 2020.  And all text is Japanese.  So many people can't understand this.  Only he can understand.  Overview of the plan of government.  Launch an organization to operate it by creating a foundation system, fundamental system of  special information and construction of disaster prevention system and improve the use of IT  in agriculture, forestry and fishers.  And activate the local activity and to expand the project that use special information technology  to upload.  Japanese government plan about special information from 2013.  And this talk, I described the presentation about the Mac 2GRAC, launch the organization  and creating a foundation system of special information at Japanese government.  2014 to 2015, Ministry of Internal Affairs and Communications Japanese government has  developed a system named G-Space platform, G-Space, perhaps G means geospatial.  This is such sites image.  And this project has this group gave the system development work and national institute of  information and communications technology.  And this is a private company, big information technology company.  And the University of Tokyo, this is Japanese university.  And I did the work of creating a mechanism to use the special information in combination  of the open source software in this team.  This two year I worked in this team using how to use force for G for that system.  And this year, another ministry, Ministry of Land Infrastructure and Transport is preparing  for the operation of this system.  And last two years is development for that system for prototype.  And this year, preparing operation of this system.  And this year, Ministry preparing for operation of this system.  And IGIT, this is a group of association for promotion of infrastructure geospatial information  distribution.  We make the operation of this system.  And I'm also a member of IGIT.  And I work for publishing this system in IGIT now.  This is all the parts of this system.  And this is a system configuration.  Maybe you can understand.  And front end is Apache and using Seekang and using Drupal.  Drupal is a content management, famous content management system.  And Seekang is a catalog server.  And back end is a geoserver.  Maybe you know, famous force for this, rendering and distributing OTC format data.  And Solar is in search engine for the text.  So in this case, Solar is query for spatial extension and using a post-glare scale and  post this.  Maybe you know.  And Seekang has an interface to good one, OGR.  This is a force for this.  And this system is not same as Japanese government.  All the system has a map.  And using a reflet, this publishes a map.  Using Seekang, Seekang as data catalog.  Seekang is a world-leading open source data portal platform.  And the U.K. government, U.S. state government or any other many government of U.R. using  this system.  And all the AD extensions for some of the spatial data has been implemented in Seekang.  Using Seekang exit is extension spatial and Seekang exit high-fone geo view and recline  view Seekang exit under view of base maps.  And for what describe each extension's function.  And Seekang exit spatial has made Ad-Seekang about spatial data, spatial data metadata  and implement Seekang exit spatial.  You can search metadata using area or format.  And Seekang exit geo view can make a function.  When you open the special data resource in Seekang, make a preview at maps and recline  is a famous JavaScript library using search as a commercial value data.  If commercial value data includes a coordinate, in Seekang, recline view display its data  on the map.  And Seekang exit base map is using base map for Seekang exit geo view or recline view  provide maps as a base map.  This is our prototype systems.  And function that we have extended is here.  Improved the preview function of spatial resource and implementation of the spatial  data processing function using the good old GR from Seekang.  And implement the web map to display selected spatial resource in Seekang.  And made the ability to purchase application by selecting the spatial data product with  private companies.  This site has not only government data but also private company data such as product.  And there is the ability to, if people using this site who want to buy such a data from  a company, they can find data.  But this is a private company's data.  If they want to use that data, they must pay.  But how to get such data introduce this site.  Improved preview function of spatial data.  Back to WMS preview, WMS data has preview function at geo view and all the special Seekang exit  special.  But that has many bugs.  If we display such a preview display.  Next position is not drawing.  And preview KML and GeoJSON and CZML.  KML and GeoJSON is famous.  ZML is data format for Sezium.  That is XML format and coordinate and timeline data.  And use GSI geo special institute, Japanese government provided map data.  Map as background map.  And next implementation of the special data processing function using the guudaru or  guudaru.  And how to use.  Select the special resource in Seekang.  And in Seekang's display, we can use the processing method and specify the parameter for the processing.  And execute if we can, okay, we click okay, execute processing.  But some data, if big data using processing, we must have a very long time waiting.  So that is not good for using such a web application.  So we thought start in execute, change as Seekang government and store the result in  the web public directory of the server.  This process is a background batch processing.  And send the result of the URL by email to the user.  And user open the URL and download the result.  If there are some, any error occurred to use a sender electric mail about your error.  So user is waiting result of good result or bad result using electric email.  And next, implementation of the web map to overlay displaying selected plural special  resource in the Seekang.  This is a display of the web map implemented using a reflet.  And this is a left is a display of the Seekang dataset displaying.  So maybe you only Japanese.  And here, this button add map.  So there is a resource that has a map add button.  And another resource has not have a map add.  So data type, some data type can add map.  But another is not ability to add map.  So we can make some maps, click add map, and then open a map, map, map, okay.  And then made the ability to purchase application by selecting the special data product with  private companies.  Many of the private companies in Japan have sold the special data such as satellite image,  IR, laser measurement data, navigation log, and so the position of the mobile phone log  they sold.  And you can find them in our site.  And you can also make a purchase application of the data.  This is a display of such.  And select where you want and make an ad work card and make an estimate.  You can.  The future plans, we are working on trying the public of the system of this year in November.  It is also plan use paid data of the private sector in this time.  And we are trying to implement a preview and overlay display of the various, various  things with time.  I am a member of the QGIS community.  And I want to talk about QGIS.  We can use a wonderful plug-in called the second browser in QGIS.  In QGIS, all Japanese.  And in this, using this plug-in from QGIS to second direct to connecting and can search.  And we can using a second data using QGIS directory.  So I think QGIS is excellent tool in order to use such a data repository.  Thank you for your attention.  Are there any questions?  Okay.  Hi.  I don't know which end user can get format special data.  Is it file or some service or something else from your system?  Data format.  Data format.  Okay.  And data format download from SIGAN.  SIGAN has any format put and download on the file.  And we can provide preview using a few format.  About WMS, WFS, KML, GeoJSON, RasterTile and CZML.  So we extend about format number.  What?  Do you directly load it in SIGAN or in GeoServer?  GeoServer.  Oh, SIGAN has file storing file as a local file system.  And Amazon S3.  So we put this in this system, storing a file, Amazon S3.  And another not a file is WMS is not a file.  This is a web service.  Web service is another.  So it is loading the sql file stretchedals andridge config.  Can I use it?  It is a dataset and dataset has a file resource and this is a WMS resource and a title resource.  So one dataset have a several type of data.  Some data is a file, some data is a store, post-GIS and using a geosurfer.  And second can register resource as well.  Not in this server, in another server resource link.  So many kind of data can store.  Am I right with file storage, geosurfer storage, post-GIS storage, AWS storage not connected.  If something change you need reload it.  It's not the common storage for each data.  There are management in this server's data is have a...  No illegal change.  But if there are some link from another site, maybe sometimes happens such a illegal change,  I think.  Is it okay?  Okay.  Sorry, I'm not good at using English.  So please, yes.  Any additional questions?  Did you want to say something?  I will ask you in English.  Please use Japanese.  Okay.  Can I speak?  Well, pretend I am a provider of a data.  Okay.  I'm like a company and I want to put my data into this platform.  What should I do?  Okay.  This...and you put...you want to put your data in this system to tell manager of this  site.  And so it is not automatic registration.  You cannot automatic registration.  So your message, read managers and if they think okay, you are a good man.  So you can register your data here.  Okay.  Thank you very much, Yuchi.  Thank you.  Thank you.  Yes.  Thank you.  Okay.
foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_0_215.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_216_347.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_348_395.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_396_479.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_480_539.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_540_803.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_804_1223.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_1224_1295.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_1296_1355.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_1356_2411.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_2412_5231.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_5232_8183.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_8184_27791.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_27792_33215.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_33216_33323.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_33324_33455.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_33456_33539.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_33540_35735.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_35736_36911.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_36912_37211.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_37212_37571.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_37572_39203.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_39204_39707.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_39708_40967.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_40968_41639.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_41640_43223.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_43224_43775.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_43776_43895.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_43896_44363.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_44364_44411.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_44412_44495.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_44496_44915.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_44916_45467.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_45468_45623.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_45624_45959.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_45960_46055.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_46056_47303.png foss4g-2016-1213-development_of_national_spatial_information_sharing_system_using_the_foss4g_and_cka_47304_47552.png