Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse

Jeremy Logan; Greeshma Agasthya; Heidi Hanson; Matthew Wolf; Heechan Lee; Shaheen Dewji; Hong Jun Yoon; Anuj Kapadia

doi:10.1109/BigData52589.2021.9671683

Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse

Jeremy Logan, Greeshma Agasthya, Heidi Hanson, Matthew Wolf, Heechan Lee, Shaheen Dewji, Hong Jun Yoon, Anuj Kapadia

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

Reusing data is difficult even within well-defined science communities and only gets worse when combining data from multiple communities and disciplines. Through the lens of current work on constructing an environmental epidemiological data set from multiple disciplinary sources, we demonstrate the need for a new tool ecosystem to support heterogeneous Big Data science. Extending existing community standards for schemas and/or data formats through human auditing and wrangling of the data is not feasible at scale. This work therefore suggests new approaches for the multi-disciplinary communities to build a shared tool ecosystem for big data. We discuss both the larger context of data wrangling of epidemiological data sets for novel artificial intelligence algorithms and the specific lessons from working with these multi-disciplinary data sets. Adopting a more model-driven, automatable approach promises not only better efficiency but also removes key sources of human-generated errors and promotes reuse and reproducibility of science data.

Original language	English
Title of host publication	Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021
Editors	Yixin Chen, Heiko Ludwig, Yicheng Tu, Usama Fayyad, Xingquan Zhu, Xiaohua Tony Hu, Suren Byna, Xiong Liu, Jianping Zhang, Shirui Pan, Vagelis Papalexakis, Jianwu Wang, Alfredo Cuzzocrea, Carlos Ordonez
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	3705-3708
Number of pages	4
ISBN (Electronic)	9781665439022
DOIs	https://doi.org/10.1109/BigData52589.2021.9671683
State	Published - 2021
Event	2021 IEEE International Conference on Big Data, Big Data 2021 - Virtual, Online, United States Duration: Dec 15 2021 → Dec 18 2021

Publication series

Name	Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021

Conference

Conference	2021 IEEE International Conference on Big Data, Big Data 2021
Country/Territory	United States
City	Virtual, Online
Period	12/15/21 → 12/18/21

Funding

This work was supported by the Office of Biological and Environmental Research’s (BER), Biological Systems Science Division (BSSD). This manuscript has been authored by UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a non-exclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan).

Keywords

data wrangling
domain-specific modeling
spatial time-series data

Access to Document

10.1109/BigData52589.2021.9671683

Cite this

Logan, J., Agasthya, G., Hanson, H., Wolf, M., Lee, H., Dewji, S., Yoon, H. J., & Kapadia, A. (2021). Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse. In Y. Chen, H. Ludwig, Y. Tu, U. Fayyad, X. Zhu, X. T. Hu, S. Byna, X. Liu, J. Zhang, S. Pan, V. Papalexakis, J. Wang, A. Cuzzocrea, & C. Ordonez (Eds.), Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021 (pp. 3705-3708). (Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BigData52589.2021.9671683

Logan, Jeremy ; Agasthya, Greeshma ; Hanson, Heidi et al. / Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse. Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021. editor / Yixin Chen ; Heiko Ludwig ; Yicheng Tu ; Usama Fayyad ; Xingquan Zhu ; Xiaohua Tony Hu ; Suren Byna ; Xiong Liu ; Jianping Zhang ; Shirui Pan ; Vagelis Papalexakis ; Jianwu Wang ; Alfredo Cuzzocrea ; Carlos Ordonez. Institute of Electrical and Electronics Engineers Inc., 2021. pp. 3705-3708 (Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021).

@inproceedings{33a5ffb732ab4b97996381684ece8bf4,

title = "Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse",

abstract = "Reusing data is difficult even within well-defined science communities and only gets worse when combining data from multiple communities and disciplines. Through the lens of current work on constructing an environmental epidemiological data set from multiple disciplinary sources, we demonstrate the need for a new tool ecosystem to support heterogeneous Big Data science. Extending existing community standards for schemas and/or data formats through human auditing and wrangling of the data is not feasible at scale. This work therefore suggests new approaches for the multi-disciplinary communities to build a shared tool ecosystem for big data. We discuss both the larger context of data wrangling of epidemiological data sets for novel artificial intelligence algorithms and the specific lessons from working with these multi-disciplinary data sets. Adopting a more model-driven, automatable approach promises not only better efficiency but also removes key sources of human-generated errors and promotes reuse and reproducibility of science data.",

keywords = "data wrangling, domain-specific modeling, spatial time-series data",

author = "Jeremy Logan and Greeshma Agasthya and Heidi Hanson and Matthew Wolf and Heechan Lee and Shaheen Dewji and Yoon, {Hong Jun} and Anuj Kapadia",

note = "Publisher Copyright: {\textcopyright} 2021 IEEE.; 2021 IEEE International Conference on Big Data, Big Data 2021 ; Conference date: 15-12-2021 Through 18-12-2021",

year = "2021",

doi = "10.1109/BigData52589.2021.9671683",

language = "English",

series = "Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "3705--3708",

editor = "Yixin Chen and Heiko Ludwig and Yicheng Tu and Usama Fayyad and Xingquan Zhu and Hu, {Xiaohua Tony} and Suren Byna and Xiong Liu and Jianping Zhang and Shirui Pan and Vagelis Papalexakis and Jianwu Wang and Alfredo Cuzzocrea and Carlos Ordonez",

booktitle = "Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021",

}

Logan, J, Agasthya, G, Hanson, H, Wolf, M, Lee, H, Dewji, S, Yoon, HJ & Kapadia, A 2021, Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse. in Y Chen, H Ludwig, Y Tu, U Fayyad, X Zhu, XT Hu, S Byna, X Liu, J Zhang, S Pan, V Papalexakis, J Wang, A Cuzzocrea & C Ordonez (eds), Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021. Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021, Institute of Electrical and Electronics Engineers Inc., pp. 3705-3708, 2021 IEEE International Conference on Big Data, Big Data 2021, Virtual, Online, United States, 12/15/21. https://doi.org/10.1109/BigData52589.2021.9671683

Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse. / Logan, Jeremy; Agasthya, Greeshma; Hanson, Heidi et al.
Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021. ed. / Yixin Chen; Heiko Ludwig; Yicheng Tu; Usama Fayyad; Xingquan Zhu; Xiaohua Tony Hu; Suren Byna; Xiong Liu; Jianping Zhang; Shirui Pan; Vagelis Papalexakis; Jianwu Wang; Alfredo Cuzzocrea; Carlos Ordonez. Institute of Electrical and Electronics Engineers Inc., 2021. p. 3705-3708 (Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse

AU - Logan, Jeremy

AU - Agasthya, Greeshma

AU - Hanson, Heidi

AU - Wolf, Matthew

AU - Lee, Heechan

AU - Dewji, Shaheen

AU - Yoon, Hong Jun

AU - Kapadia, Anuj

PY - 2021

Y1 - 2021

N2 - Reusing data is difficult even within well-defined science communities and only gets worse when combining data from multiple communities and disciplines. Through the lens of current work on constructing an environmental epidemiological data set from multiple disciplinary sources, we demonstrate the need for a new tool ecosystem to support heterogeneous Big Data science. Extending existing community standards for schemas and/or data formats through human auditing and wrangling of the data is not feasible at scale. This work therefore suggests new approaches for the multi-disciplinary communities to build a shared tool ecosystem for big data. We discuss both the larger context of data wrangling of epidemiological data sets for novel artificial intelligence algorithms and the specific lessons from working with these multi-disciplinary data sets. Adopting a more model-driven, automatable approach promises not only better efficiency but also removes key sources of human-generated errors and promotes reuse and reproducibility of science data.

AB - Reusing data is difficult even within well-defined science communities and only gets worse when combining data from multiple communities and disciplines. Through the lens of current work on constructing an environmental epidemiological data set from multiple disciplinary sources, we demonstrate the need for a new tool ecosystem to support heterogeneous Big Data science. Extending existing community standards for schemas and/or data formats through human auditing and wrangling of the data is not feasible at scale. This work therefore suggests new approaches for the multi-disciplinary communities to build a shared tool ecosystem for big data. We discuss both the larger context of data wrangling of epidemiological data sets for novel artificial intelligence algorithms and the specific lessons from working with these multi-disciplinary data sets. Adopting a more model-driven, automatable approach promises not only better efficiency but also removes key sources of human-generated errors and promotes reuse and reproducibility of science data.

KW - data wrangling

KW - domain-specific modeling

KW - spatial time-series data

UR - http://www.scopus.com/inward/record.url?scp=85125292245&partnerID=8YFLogxK

U2 - 10.1109/BigData52589.2021.9671683

DO - 10.1109/BigData52589.2021.9671683

M3 - Conference contribution

AN - SCOPUS:85125292245

T3 - Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021

SP - 3705

EP - 3708

BT - Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021

A2 - Chen, Yixin

A2 - Ludwig, Heiko

A2 - Tu, Yicheng

A2 - Fayyad, Usama

A2 - Zhu, Xingquan

A2 - Hu, Xiaohua Tony

A2 - Byna, Suren

A2 - Liu, Xiong

A2 - Zhang, Jianping

A2 - Pan, Shirui

A2 - Papalexakis, Vagelis

A2 - Wang, Jianwu

A2 - Cuzzocrea, Alfredo

A2 - Ordonez, Carlos

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2021 IEEE International Conference on Big Data, Big Data 2021

Y2 - 15 December 2021 through 18 December 2021

ER -

Logan J, Agasthya G, Hanson H, Wolf M, Lee H, Dewji S et al. Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse. In Chen Y, Ludwig H, Tu Y, Fayyad U, Zhu X, Hu XT, Byna S, Liu X, Zhang J, Pan S, Papalexakis V, Wang J, Cuzzocrea A, Ordonez C, editors, Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021. Institute of Electrical and Electronics Engineers Inc. 2021. p. 3705-3708. (Proceedings - 2021 IEEE International Conference on Big Data, Big Data 2021). doi: 10.1109/BigData52589.2021.9671683

Creating a Tools Ecosystem for Cross-Discipline Environmental Data Reuse

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this