An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources

Ashwin Kumar Vajantri; Kunwar Deep Singh Toor; Edmon Begoli; Jack Bates

doi:10.1109/BigData.2017.8258303

An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources

Ashwin Kumar Vajantri, Kunwar Deep Singh Toor, Edmon Begoli, Jack Bates

Cyber Resilience and Intelligence Divisi

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

A Polystore concept, either in its orthodox form, or in a more general interpretation is relevant for a variety of the important, data-centric scenarios, most markedly precision medicine. As we continue to examine the feasibility and maturity of this concept, we are exploring both core and related technologies that are bringing us closer to a comprehensive solution of managing and efficient retrieval of the heterogeneous data. In this paper, we are presenting our exploration of Apache Calcite as a foundation for the more general polystore concept. To this end, we are discussing architectural characteristics of the platform, its performance, implementation, and usability trade-offs, and the readiness of the technology to serve as a polystore foundation. We examine Calcite against relational (SQL Server), array (TileDB), and text data engines (Elasticsearch).

Original language	English
Title of host publication	Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017
Editors	Jian-Yun Nie, Zoran Obradovic, Toyotaro Suzumura, Rumi Ghosh, Raghunath Nambiar, Chonggang Wang, Hui Zang, Ricardo Baeza-Yates, Ricardo Baeza-Yates, Xiaohua Hu, Jeremy Kepner, Alfredo Cuzzocrea, Jian Tang, Masashi Toyoda
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	3221-3227
Number of pages	7
ISBN (Electronic)	9781538627143
DOIs	https://doi.org/10.1109/BigData.2017.8258303
State	Published - Jul 1 2017
Event	5th IEEE International Conference on Big Data, Big Data 2017 - Boston, United States Duration: Dec 11 2017 → Dec 14 2017

Publication series

Name	Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017
Volume	2018-January

Conference

Conference	5th IEEE International Conference on Big Data, Big Data 2017
Country/Territory	United States
City	Boston
Period	12/11/17 → 12/14/17

Funding

This manuscript has been in part co-authored by UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the U.S. Department of Energy, and under a joint program (MVP CHAMPION), between the U.S. Department of Energy (DOE), and the U.S. Department of Veterans Affairs (VA). The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a non-exclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan(http://energy.gov/downloads/doe-public-access-plan).

Funders	Funder number
UT-Battelle, LLC

Access to Document

10.1109/BigData.2017.8258303

Cite this

Vajantri, A. K., Toor, K. D. S., Begoli, E., & Bates, J. (2017). An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources. In J.-Y. Nie, Z. Obradovic, T. Suzumura, R. Ghosh, R. Nambiar, C. Wang, H. Zang, R. Baeza-Yates, R. Baeza-Yates, X. Hu, J. Kepner, A. Cuzzocrea, J. Tang, & M. Toyoda (Eds.), Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017 (pp. 3221-3227). (Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017; Vol. 2018-January). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BigData.2017.8258303

Vajantri, Ashwin Kumar ; Toor, Kunwar Deep Singh ; Begoli, Edmon et al. / An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources. Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017. editor / Jian-Yun Nie ; Zoran Obradovic ; Toyotaro Suzumura ; Rumi Ghosh ; Raghunath Nambiar ; Chonggang Wang ; Hui Zang ; Ricardo Baeza-Yates ; Ricardo Baeza-Yates ; Xiaohua Hu ; Jeremy Kepner ; Alfredo Cuzzocrea ; Jian Tang ; Masashi Toyoda. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 3221-3227 (Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017).

@inproceedings{326d9f893299432689983ba264ac673e,

title = "An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources",

abstract = "A Polystore concept, either in its orthodox form, or in a more general interpretation is relevant for a variety of the important, data-centric scenarios, most markedly precision medicine. As we continue to examine the feasibility and maturity of this concept, we are exploring both core and related technologies that are bringing us closer to a comprehensive solution of managing and efficient retrieval of the heterogeneous data. In this paper, we are presenting our exploration of Apache Calcite as a foundation for the more general polystore concept. To this end, we are discussing architectural characteristics of the platform, its performance, implementation, and usability trade-offs, and the readiness of the technology to serve as a polystore foundation. We examine Calcite against relational (SQL Server), array (TileDB), and text data engines (Elasticsearch).",

author = "Vajantri, {Ashwin Kumar} and Toor, {Kunwar Deep Singh} and Edmon Begoli and Jack Bates",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE.; 5th IEEE International Conference on Big Data, Big Data 2017 ; Conference date: 11-12-2017 Through 14-12-2017",

year = "2017",

month = jul,

day = "1",

doi = "10.1109/BigData.2017.8258303",

language = "English",

series = "Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "3221--3227",

editor = "Jian-Yun Nie and Zoran Obradovic and Toyotaro Suzumura and Rumi Ghosh and Raghunath Nambiar and Chonggang Wang and Hui Zang and Ricardo Baeza-Yates and Ricardo Baeza-Yates and Xiaohua Hu and Jeremy Kepner and Alfredo Cuzzocrea and Jian Tang and Masashi Toyoda",

booktitle = "Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017",

}

Vajantri, AK, Toor, KDS, Begoli, E & Bates, J 2017, An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources. in J-Y Nie, Z Obradovic, T Suzumura, R Ghosh, R Nambiar, C Wang, H Zang, R Baeza-Yates, R Baeza-Yates, X Hu, J Kepner, A Cuzzocrea, J Tang & M Toyoda (eds), Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017. Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017, vol. 2018-January, Institute of Electrical and Electronics Engineers Inc., pp. 3221-3227, 5th IEEE International Conference on Big Data, Big Data 2017, Boston, United States, 12/11/17. https://doi.org/10.1109/BigData.2017.8258303

An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources. / Vajantri, Ashwin Kumar; Toor, Kunwar Deep Singh; Begoli, Edmon et al.
Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017. ed. / Jian-Yun Nie; Zoran Obradovic; Toyotaro Suzumura; Rumi Ghosh; Raghunath Nambiar; Chonggang Wang; Hui Zang; Ricardo Baeza-Yates; Ricardo Baeza-Yates; Xiaohua Hu; Jeremy Kepner; Alfredo Cuzzocrea; Jian Tang; Masashi Toyoda. Institute of Electrical and Electronics Engineers Inc., 2017. p. 3221-3227 (Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017; Vol. 2018-January).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources

AU - Vajantri, Ashwin Kumar

AU - Toor, Kunwar Deep Singh

AU - Begoli, Edmon

AU - Bates, Jack

PY - 2017/7/1

Y1 - 2017/7/1

N2 - A Polystore concept, either in its orthodox form, or in a more general interpretation is relevant for a variety of the important, data-centric scenarios, most markedly precision medicine. As we continue to examine the feasibility and maturity of this concept, we are exploring both core and related technologies that are bringing us closer to a comprehensive solution of managing and efficient retrieval of the heterogeneous data. In this paper, we are presenting our exploration of Apache Calcite as a foundation for the more general polystore concept. To this end, we are discussing architectural characteristics of the platform, its performance, implementation, and usability trade-offs, and the readiness of the technology to serve as a polystore foundation. We examine Calcite against relational (SQL Server), array (TileDB), and text data engines (Elasticsearch).

AB - A Polystore concept, either in its orthodox form, or in a more general interpretation is relevant for a variety of the important, data-centric scenarios, most markedly precision medicine. As we continue to examine the feasibility and maturity of this concept, we are exploring both core and related technologies that are bringing us closer to a comprehensive solution of managing and efficient retrieval of the heterogeneous data. In this paper, we are presenting our exploration of Apache Calcite as a foundation for the more general polystore concept. To this end, we are discussing architectural characteristics of the platform, its performance, implementation, and usability trade-offs, and the readiness of the technology to serve as a polystore foundation. We examine Calcite against relational (SQL Server), array (TileDB), and text data engines (Elasticsearch).

UR - http://www.scopus.com/inward/record.url?scp=85047821782&partnerID=8YFLogxK

U2 - 10.1109/BigData.2017.8258303

DO - 10.1109/BigData.2017.8258303

M3 - Conference contribution

AN - SCOPUS:85047821782

T3 - Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017

SP - 3221

EP - 3227

BT - Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017

A2 - Nie, Jian-Yun

A2 - Obradovic, Zoran

A2 - Suzumura, Toyotaro

A2 - Ghosh, Rumi

A2 - Nambiar, Raghunath

A2 - Wang, Chonggang

A2 - Zang, Hui

A2 - Baeza-Yates, Ricardo

A2 - Hu, Xiaohua

A2 - Kepner, Jeremy

A2 - Cuzzocrea, Alfredo

A2 - Tang, Jian

A2 - Toyoda, Masashi

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 5th IEEE International Conference on Big Data, Big Data 2017

Y2 - 11 December 2017 through 14 December 2017

ER -

Vajantri AK, Toor KDS, Begoli E, Bates J. An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources. In Nie JY, Obradovic Z, Suzumura T, Ghosh R, Nambiar R, Wang C, Zang H, Baeza-Yates R, Baeza-Yates R, Hu X, Kepner J, Cuzzocrea A, Tang J, Toyoda M, editors, Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017. Institute of Electrical and Electronics Engineers Inc. 2017. p. 3221-3227. (Proceedings - 2017 IEEE International Conference on Big Data, Big Data 2017). doi: 10.1109/BigData.2017.8258303

An apache calcite-based polystore variation for federated querying of heterogeneous healthcare sources

Abstract

Publication series

Conference

Funding

Access to Document

Other files and links

Fingerprint

Cite this