[Profile picture of Ruben Verborgh]

Ruben Verborgh

Scaling out federated queries for life science data in production

by Dieter De Witte, Laurens De Vocht, Kenny Knecht, Filip Pattyn, Hans Constandt, Erik Mannens, and Ruben Verborgh

There exists an abundance of Linked Data storage solutions, but only few meet the requirements of a production environment with interlinked life sciences data. In such environments, a triple store has to support complex SPARQL queries and handle large datasets with hundreds of millions of triples. The Ontoforce platform DisQover offers federated search for life sciences, relying on complex federated queries over open life science data, run in an ETL-pipeline to anticipate user actions in its exploratory search interface. Different state-of-the-art approaches for scaling out are compared, both in terms of their ability to execute the queries as in terms of ETL pipeline performance. This paper analyzes and discusses the features of the datasets and query mixes. An in-depth analysis is provided on an individual query basis revealing the strengths and weaknesses with respect to certain query types.

BibTeX Mendeley

Published in 2016 in Proceedings of the 9th International Conference on Semantic Web Applications and Tools for Life Sciences.

Keywords: Linked Data, SPARQL

Read this article online

Cite this article in your publications

Use the BibTeX entry to easily refer to this article, or any of these snippets:

IEEE
D. De Witte, L. De Vocht, K. Knecht, F. Pattyn, H. Constandt, E. Mannens, and R. Verborgh, “Scaling out federated queries for life science data in production,” in Proceedings of the 9th International Conference on Semantic Web Applications and Tools for Life Sciences, 2016.
ACM
Dieter De Witte et al. 2016. Scaling out federated queries for life science data in production. In Proceedings of the 9th International Conference on Semantic Web Applications and Tools for Life Sciences.
LNCS
De Witte, D., De Vocht, L., Knecht, K., Pattyn, F., Constandt, H., Mannens, E., Verborgh, R.: Scaling out federated queries for life science data in production. In: Proceedings of the 9th International Conference on Semantic Web Applications and Tools for Life Sciences (2016).
APA
De Witte, D., De Vocht, L., Knecht, K., Pattyn, F., Constandt, H., Mannens, E., & Verborgh, R. (2016). Scaling out federated queries for life science data in production. In Proceedings of the 9th International Conference on Semantic Web Applications and Tools for Life Sciences.
MLA
De Witte, Dieter et al. “Scaling out Federated Queries for Life Science Data in Production.” Proceedings of the 9th International Conference on Semantic Web Applications and Tools for Life Sciences. 2016. Print.

Discuss this article