Terradue (Italy)

<p>Within INTAROS, WP5 (Data integration and management) is tasked with designing and implementing evolution of the cloud platform and tools for the iAOS (integrated Arctic Observation System). This document in its volume V2 defines additional resources for iAOS data exploitation and processing, in particular in the context of the WP5 support to the WP6 iAOS Showcase applications.<br>\nThese new resources are delivered as a collection of R and Python-based Jupyter Notebooks, a state of the art approach for collaborative science, interactive data analysis and management of software code experiments.</p>\n\n<p>This V2 report embeds the results previously delivered as part of the V1 release, these can be found in the sections 3. “C-PAD Service Specification” (Characterization of Passive Acoustic Data) and 4. “TS-SIC Service Specification” (Time Series of Sea Ice Concentration). For these two services, the update between D5.7 (V1) and D5.11 (V2) was done only on the structure of the chapters "Software modules required", "Cloud resources allocation" and "Roadmap for future development”. No new developments were performed here.</p>\n\n<p>The new results are focused on the exploitation of interoperability protocols (OPeNDAP) as promoted by INTAROS for the iAOS, and on the use of the RGeostats Geostatistical software library. They are presented in section 5. “TS-CTD Service Specification” (Time Series of Conductivity-Temperature-Depth) and in section 6. “iAOS Showcase Service Specification”.</p>

WP5 (Data integration and management) is tasked with designing and implementing evolution of the cloud platform and tools for the iAOS. This document gives a synthesis of the iAOS cloud infrastructure evolution during the project. The experience and challenges from the work include: (1) deploying and operating dedicated Cloud Platform infrastructure services, (2) integrating data repositories and data processing services based on these Cloud Platform infrastructure services, and (3) defining user-oriented applications powered by all these iAOS resources. As a result, the iAOS cloud platform offers services to access observations and derived parameters, including new observations from WP2-3-4. In addition, it offers seamless integration with geo-statistical methods for interpolation of spatiotemporal datasets, and services to store the generated datasets in iAOS enabled repositories. The report presents results on using the iAOS cloud platform to integrate multidisciplinary and distributed data repositories and to provide a set of tools for data analysis, transformation, and visualization. Selected applications established in WP6 have used the services and tools provided by the platform and have showcased the usefulness and functionality of the platform, as part of the benefit of enhanced integration of data from Arctic observing systems.

The INTAROS project develops an integrated Arctic Observation System (iAOS) by extending, improving and unifying existing systems in the different regions of the Arctic. Within INTAROS, WP5 (Data integration and management) is tasked with designing and implementing evolutions of the cloud platform with geo statistical tools for services as part of the iAOS. The work effort in Task 5.4 has been to design, develop and distribute a Geostatistical Library to be used as a scientific toolbox in some different data analysis workflows (e.g. for the iAOS showcase applications). <br> The first version of the Geostatistical Library (v1) was considering CTD data provided by IMR for estimating ocean temperature maps in the Barents Sea (D5.6). <br> This document describes the new version of the Geostatistical Library (v2) where some additional capabilities have been developed. A set of new functions deals with weather stations and AROME Arctic model in order to estimate snow depth maps in Isfjorden (Svalbard). Another set supports the combination of ICES CTD dataset, GINR trawls dataset and GEBCO bathymetry for estimating bottom ocean temperature maps along the West Greenland coast.

The INTAROS project develops an integrated Arctic Observation System (iAOS) by extending, improving and unifying existing systems in the different regions of the Arctic. Within INTAROS, WP5 (Data integration and management) develops the iAOS Portal, which provides access to selected datasets and services offered by INTAROS partners and by other Arctic data providers and service providers. This document describes the major functionality and features of this portal and how it has been implemented. Required functionality has been identified through dialogue with users and stakeholders. The approach has been to use agile development techniques to quickly refine user needs and implement new features iteratively. Two main categories of users of the portal were identified: (1) data/service providers and (2) data/services consumers. Providers make their data or services available through the portal, and update the descriptions of these if changes are made. Consumers search for and access data or services, with sufficient descriptions (metadata) for both data and services to whether to use them in their work. The population and promotion of the iAOS Portal equally depends on data providers and consumers including service providers. The iAOS Portal has been implemented using a leading data management system framework named CKAN (Comprehensive Knowledge Archive Network). CKAN offers a broad range of the needed features out of the box and has an active community that develops additional features (plugins) that can be added to the iAOS Portal as needed. Using the CKAN core components and mature plugins, we have implemented the following main components of the iAOS Portal: <strong>INTAROS Data Catalogue</strong>, holding descriptions (metadata) of datasets collected or generated with support from INTAROS. <strong>iAOS Portal Data Catalogue</strong>, holding metadata harvested from other catalogues offering relevant dataset for the applications under development in WP 6 of INTAROS. <strong>Services and Applications</strong>, describing services and applications developed in INTAROS and by other service providers offering products or functionality that can be exploited in WP 6. <strong>Tools and Resources</strong>, providing links to software libraries and tools, computer platforms, data systems, infrastructures and projects that offer data, information and/or software tools that can be useful for scientists and stakeholders in Arctic sciences and for local communities in the region. The <strong>ARCMAP</strong> web application for mapping and assessing Arctic in situ observing systems is available through the portal. ARCMAP that was developed in a spin-off project is also part of the iAOS Portal. The iAOS Portal will be extended with more features, data and services during the course of the INTAROS project as well as in future projects following up INTAROS and the recommendations from the INTAROS Roadmap. These projects will use the iAOS Portal as a mechanism to make their data and services known to the large network of Arctic scientists and local communities established within INTAROS. In this way, the iAOS Portal will become an important element in a Sustained integrated Arctic Observing System. The IAOS Portal is available at https://portal-intaros.nersc.no/.

&amp;lt;p&amp;gt;The geosciences communities share common challenges related to effective use of the vast and growing amount of data as well as the continueous development of new technology. It is therefore a great potential in learning from the experiences and knowledge aquired across the various fields. The H2020 project NextGEOSS is building a European data hub and platform to support the Earth observation communities with a set of tools and services through the platform. The suite of tools on the platform alllows scalablitly, interoperability and transparency in a flexible way, well suited to serve a multifaceted interdisciplinary community, NextGEOSS is developed with and for multiple communities, the NextGEOSS pilots. This has resulted and continues to provide transfer of experience and knowledge along the whole value chain from data provision to applications and services based on multiple sources of data. We will introduce the NextGEOSS data hub and platform and show some illustrative examples of the exchange of knowledge that facilitates faster uptake of data and advances in use of new technology. An onboarding system is benefitting for existing and new users. A capacity building strategy is an integral part of both the onboarding and the individual services, which will be highligthed in this presentation.&amp;lt;/p&amp;gt;

Urbanization is among the most relevant global trends related to the human presence on the planet. As such, it poses major challenge for the well-being of the next generation. To fully understand and properly mitigate the impact of this change, we need precise and up-to-date global monitoring of the urban areas. The TEP Urban platform focuses on delivering multi-source information on trans-sectoral urban challenges. It provides a set of tools for researchers and service providers to process Earth Observation data and integrate them together with data from other sources in order to provide relevant information for spatial planners, policy makers and other stakeholders.

Copernicus is the European program for monitoring the Earth. It consists of a set of complex systems that collect data from satellites and in-situ sensors, process it, and provide users with reliable and up-to-date information on a range of environmental and security issues. Information extracted from Copernicus data is made available to users through Copernicus services addressing six thematic areas: land, marine, atmosphere, climate, emergency and security. The data processed and disseminated puts Copernicus at the forefront of the big data paradigm and gives rise to all relevant challenges: volume, velocity, variety, veracity and value. In this paper we discuss the challenges of big Copernicus data and how the Copernicus program handled them. We also present lessons learned from our project Copernicus App Lab, which takes Copernicus services information and makes it available on the Web using semantic technologies to aid its take up by mobile developers.

Abstract. The Sentinel fleet will provide a so-far unique coverage with Earth observation data and therewith new opportunities for the implementation of methodologies to generate innovative geo-information products and services. It is here where the TEP Urban project is supposed to initiate a step change by providing an open and participatory platform based on modern ICT technologies and services that enables any interested user to easily exploit Earth observation data pools, in particular those of the Sentinel missions, and derive thematic information on the status and development of the built environment from these data. Key component of TEP Urban project is the implementation of a web-based platform employing distributed high-level computing infrastructures and providing key functionalities for i) high-performance access to satellite imagery and derived thematic data, ii) modular and generic state-of-the art pre-processing, analysis, and visualization techniques, iii) customized development and dissemination of algorithms, products and services, and iv) networking and communication. This contribution introduces the main facts about the TEP Urban project, including a description of the general objectives, the platform systems design and functionalities, and the preliminary portfolio products and services available at the TEP Urban platform.