[Profile picture of Ruben Verborgh]

Ruben Verborgh

Challenges as Enablers for High Quality Linked Data: Insights from the Semantic Publishing Challenge

Anastasia Dimou, Sahar Vahdati, Angelo Di Iorio, Christoph Lange, Ruben Verborgh, and Erik Mannens

While most challenges organized so far in the Semantic Web domain are focused on comparing tools with respect to different criteria such as their features and competencies, or exploiting semantically enriched data, the Semantic Web Evaluation Challenges series, co-located with the ESWC Semantic Web Conference, aims to compare them based on their output, namely the produced dataset. The Semantic Publishing Challenge is one of these challenges. Its goal is to involve participants in extracting data from heterogeneous sources on scholarly publications, and producing Linked Data that can be exploited by the community itself. This paper reviews lessons learned from both (i) the overall organization of the Semantic Publishing Challenge, regarding the definition of the tasks, building the input dataset and forming the evaluation, and (ii) the results produced by the participants, regarding the proposed approaches, the used tools, the preferred vocabularies and the results produced in the three editions of 2014, 2015 and 2016. We compared these lessons to other Semantic Web Evaluation challenges. In this paper, we (i) distill best practices for organizing such challenges that could be applied to similar events, and (ii) report observations on Linked Data publishing derived from the submitted solutions. We conclude that higher quality may be achieved when Linked Data is produced as a result of a challenge, because the competition becomes an incentive, while solutions become better with respect to Linked Data publishing best practices when they are evaluated against the rules of the challenge.

full text BibTeX other citation formats

Published in 2017 in PeerJ Computer Science.

Keywords:

Read this article online

Cite this article in your work

Cite this article easily using its BibTeX entry: 

@article{dimou_peerjcs_2017,
  title = {Challenges as Enablers for High Quality {Linked Data:} Insights from the {Semantic Publishing Challenge}},
  author = {Dimou, Anastasia and Vahdati, Sahar and Di Iorio, Angelo and Lange, Christoph and Verborgh, Ruben and Mannens, Erik},
  journal = {PeerJ Computer Science},
  year = 2017,
  month = jan,
  volume = 3,
  pages = {e105},
  issn = {2376-5992},
  doi = {10.7717/peerj-cs.105},
  url = {https://peerj.com/articles/cs-105/},
}

Alternatively, pick a reference of your choice below:

ACM
Anastasia Dimou, Sahar Vahdati, Angelo Di Iorio, Christoph Lange, Ruben Verborgh, and Erik Mannens. 2017. Challenges as Enablers for High Quality Linked Data: Insights from the Semantic Publishing Challenge. PeerJ Computer Science 3, (January 2017), e105.
APA
Dimou, A., Vahdati, S., Di Iorio, A., Lange, C., Verborgh, R., & Mannens, E. (2017). Challenges as Enablers for High Quality Linked Data: Insights from the Semantic Publishing Challenge. PeerJ Computer Science, 3, e105.
IEEE
A. Dimou, S. Vahdati, A. Di Iorio, C. Lange, R. Verborgh, and E. Mannens, “Challenges as Enablers for High Quality Linked Data: Insights from the Semantic Publishing Challenge,” PeerJ Computer Science, vol. 3, p. e105, Jan. 2017.
LNCS
Dimou, A., Vahdati, S., Di Iorio, A., Lange, C., Verborgh, R., Mannens, E.: Challenges as Enablers for High Quality Linked Data: Insights from the Semantic Publishing Challenge. PeerJ Computer Science. 3, e105 (2017).
MLA
Dimou, Anastasia, et al. “Challenges as Enablers for High Quality Linked Data: Insights from the Semantic Publishing Challenge.” PeerJ Computer Science, vol. 3, Jan. 2017, p. e105.

Discuss this article