Abstract
We introduce the Atmospheric Radiation Measurement (ARM) Data Workbench, a web-based interface that combines access to atmospheric datasets and computational resources. It is developed to facilitate a interactive data exploration and data analysis for the research community. The ARM Data Workbench offers a comprehensive solution that combines data locality, user-friendly access, and collaborative capabilities within a single platform. To empower researchers with a familiar analysis and compute environment, the data workbench integrates a JupyterHub which is a popular platform for scientific computing. In this paper, we discuss the features of ARM Data Workbench through which users can access the ARM hosted scientific datasets, order them and get them delivered. We discuss different types of user accounts we provide in order to have access to ARM data and the compute platform to perform analysis. We explain the process of navigating to ARM's Data Discovery interface to access datasets and JupyterHub platform for scientific users with an example case study. The platform targets new researchers, graduate students and established researchers to help them in their research in a collaborative environment.
| Original language | English |
|---|---|
| Title of host publication | Proceedings - 2024 IEEE International Conference on Big Data, BigData 2024 |
| Editors | Wei Ding, Chang-Tien Lu, Fusheng Wang, Liping Di, Kesheng Wu, Jun Huan, Raghu Nambiar, Jundong Li, Filip Ilievski, Ricardo Baeza-Yates, Xiaohua Hu |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| Pages | 2320-2325 |
| Number of pages | 6 |
| ISBN (Electronic) | 9798350362480 |
| DOIs | |
| State | Published - 2024 |
| Event | 2024 IEEE International Conference on Big Data, BigData 2024 - Washington, United States Duration: Dec 15 2024 → Dec 18 2024 |
Publication series
| Name | Proceedings - 2024 IEEE International Conference on Big Data, BigData 2024 |
|---|
Conference
| Conference | 2024 IEEE International Conference on Big Data, BigData 2024 |
|---|---|
| Country/Territory | United States |
| City | Washington |
| Period | 12/15/24 → 12/18/24 |
Funding
This research was supported by the Atmospheric Radiation Measurement (ARM) user facility, a U.S. Department of Energy (DOE) Office of Science user facility managed by the Office of Biological and Environmental Research Program. This manuscript has been authored by UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the US Department of Energy. The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (https://www.energy.gov/downloads/doe-public-access-plan).
Keywords
- Atmospheric Radiation Measurement (ARM)
- Data Discovery
- Data Workbench
- Earth and Atmospheric Science
- Jupyter Notebook