Architecture of a Data Portal for Publishing and Delivering Open Data for Atmospheric Measurement

Rosa Virginia Encinas Quille, Felipe Valencia de Almeida, Mauro Yuji Ohara, Pedro Luiz Pizzigatti Corrêa, Leandro Gomes de Freitas, Solange Nice Alves-Souza, Jorge Rady de Almeida, Maggie Davis, Giri Prakash

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Atmospheric data are collected by researchers every day. Campaigns such as GOAmazon 2014/2015 and the Amazon Tall Tower Observatory collect essential data on aerosols, gases, cloud properties, and meteorological parameters in the Brazilian Amazon basin. These data products provide insights and essential information for analyzing and predicting natural processes. However, in Brazil, it is estimated that more than 80% of the scientific data collected are not published due to the lack of web portals that collect and store these data. This makes it difficult, or even impossible, to access and integrate the data, which can result in the loss of significant amounts of information and significantly affect the understanding of the overall data. To address this problem, we propose a data portal architecture and open data deployment that enable Big Data processing, human interaction, and download-oriented approaches with tools that help users catalog, publish and visualize atmospheric data. Thus, we describe the architecture developed, based on the experience of the Atmospheric Radiation Measurement Data Center, which incorporates the principles of FAIR, the infrastructure and content management system for managing scientific data. The portal partial results were tested with environmental data from contaminated areas at the University of São Paulo. Overall, this data portal creates more shared knowledge about atmospheric processes by providing users with access to open environmental data.

Original languageEnglish
Article number5374
JournalInternational Journal of Environmental Research and Public Health
Volume20
Issue number7
DOIs
StatePublished - Apr 2023

Funding

Grant #2019/21693-0, São Paulo Research Foundation (FAPESP) “Information System for the management and analysis of large volumes of data from contaminated areas”. Grant #2017/50343-2, São Paulo Research Foundation (FAPESP) “Institutional development plan in the area of digital transformation: advanced manufacturing and smart and sustainable cities (PDIp)”. Grant #2017/17047-0, São Paulo Research Foundation (FAPESP) “Aerosol Life Cycles and Clouds in the Amazon”. The authors would also like to thank the Brazilian National Council for Scientific and Technological Development (CNPq) grant number 140253/2021-1. This work was funded by the São Paulo Research Foundation (FAPESP) (grant numbers 2019/21693-0 and 2020/15230-5) and by the Graduate Program in Electrical Engineering (PPGEE) from the Polytechnic School of the University of São Paulo.

Keywords

  • FAIR principles
  • atmospheric data measurement
  • big data
  • data portal requirements
  • open data
  • open science

Fingerprint

Dive into the research topics of 'Architecture of a Data Portal for Publishing and Delivering Open Data for Atmospheric Measurement'. Together they form a unique fingerprint.

Cite this