European e-infrastructure for extreme data analytics in sustainable development
Agriculture is a, literally, vital industry. Not only important for nourishment, but also a key determiant of health, economic and political stability; employment; business and biological ecosystems; and society. Because of its importance, most attention focuses on productivity but it is essential to have a global view in order to address environment sustainability problems. EUXDAT proposes an e-Infrastructure, which addresses agriculture, land monitoring and energy efficiency for a sustainable development, as a way to support planning policies.
In order to do so, we need to address the problems related to the current and future huge amount of heterogeneous data to be managed and processed. EUXDAT builds on existing mature components for solving them, by providing an advanced frontend, where users will develop applications on top of an infrastructure based on HPC and Cloud. The frontend provides monitoring information, visualization, different parallelized data analytic tools and enhanced data and processes catalogues, enabling Large Data Analytics-as-a-Service. EUXDAT will include a large set of data connectors (UAVs, Copernicus, field sensors, etc.), for scalable analytics.
As for the brokering infrastructure, EUXDAT aims at optimizing data and resources usage. In addition to a mechanism for supporting data management linked to data quality evaluation, EUXDAT proposes a way to orchestrate tasks execution, identifying whether the best target is a HPC center or a Cloud provider. It will use monitoring and profiling information for taking decisions based on trade-offs related to cost, data constraints, efficiency and resources availability.
During the project, EUXDAT will be in contact with scientific communities, in order to identify new trends and datasets, for guiding the evolution of the e-Infrastructure. The final result of the project will be and integrated e-Infrastructure which will encourage end users to create new applications for sustainable development.