Cloud computing in a distributed e-infrastructure using the Web processing service standard

Coro G., Panichi G., Scarponi P., Pagano P.

Big Data Processing  Science 2.0  Data Mining  Parallel Processing  Computer Networks and Communications  Distributed Systems  e-Infrastructures  Computational Theory and Mathematics  Cloud Computing  Computer Science Applications  Theoretical Computer Science  Software  WPS 

New Science paradigms have recently evolved to promote open publication of scientific findings as well as multi-disciplinary collaborative approaches to scientific experimentation. These approaches can face modern scientific challenges but must deal with large quantities of data produced by industrial and scientific experiments. These data, so-called "Big Data", require to introduce new Computer Science systems to help scientists cooperate, extract information, and possibly produce new knowledge out of the data. E-Infrastructures are distributed computer systems that foster collaboration between users and can embed distributed and parallel processing systems to manage Big Data. However, in order to meet modern Science requirements, e-Infrastructures impose several requirements to computational systems in turn, e.g. being economically sustainable, managing community-provided processes, using standard representations for processes and data, managing Big Data size and heterogeneous representations, supporting reproducible Science, collaborative experimentation, and cooperative online environments, managing security and privacy for data and services. In this paper, we present a Cloud computing system (gCube DataMiner) that meets these requirements and operates in an e-Infrastructure, while sharing characteristics with state-of-the-art Cloud computing systems. To this aim, DataMiner uses the Web Processing Service standard of the Open Geospatial Consortium and introduces features like collaborative experimental spaces, automatic installation of processes and services on top of a flexible and sustainable Cloud computing architecture. We compare DataMiner with another mature Cloud computing system and highlight the benefits our system brings, the new paradigms requirements it satisfies, and the applications that can be developed based on this system.

Source: Concurrency and computation (Online) 29 (2017). doi:10.1002/cpe.4219

Publisher: John Wiley & Sons,, Chichester, UK , Regno Unito

Metrics