[Profile picture of Ruben Verborgh]

Ruben Verborgh

A preliminary Open Data publishing strategy for real-time data in Flanders

Julián Rojas Meléndez, Brecht Van de Vyvere, Arne Gevaert, Ruben Taelman, Pieter Colpaert, and Ruben Verborgh

For smart decision making, user agents need real-time and historic access to open data from sensors installed in the public domain. In contrast to a closed environment, for Open Data and federated query processing algorithms, the data publisher cannot anticipate in advance on specific questions, nor can it deal with a bad cost-efficiency of the server interface when data consumers increase. When publishing observations from sensors, different fragmentation strategies can be thought of depending on how the historic data needs to be queried. Furthermore, both publish/subscribe and polling strategies exist to publish real-time updates. Each of these strategies come with their own trade-offs regarding cost-efficiency of the server-interface, user-perceived performance and CPU use. A polling strategy where multiple observations are published in a paged collection was tested in a proof of concept for parking space availabilities. In order to understand the different resource trade-offs presented by publish/subscribe and polling publication strategies, we devised an experiment on two machines, for a scalability test. The preliminary results were inconclusive and suggest more large scale tests are needed in order to see a trend. While the large-scale tests will be performed in future work, the proof of concept helped to identify the technical Open Data principles for the 13 biggest cities in Flanders.

BibTeX other citation formats

Published in 2018 in Proceedings of the Web Stream Processing Workshop.

Keywords:

Read this article online

Cite this article in your work

Cite this article easily using its BibTeX entry: 

@inproceedings{rojas_wsp_2018,
  author = {Rojas Mel\'endez, Juli\'an and Van de Vyvere, Brecht and Gevaert, Arne and Taelman, Ruben and Colpaert, Pieter and Verborgh, Ruben},
  title = {A preliminary {Open Data} publishing strategy for real-time data in {Flanders}},
  booktitle = {Proceedings of the Web Stream Processing Workshop},
  pages = {1847--1853},
  year = 2018,
  month = apr,
  doi = {10.1145/3184558.3191650},
  isbn = {978-1-4503-5640-4},
}

Alternatively, pick a reference of your choice below:

ACM
Julián Rojas Meléndez, Brecht Van de Vyvere, Arne Gevaert, Ruben Taelman, Pieter Colpaert, and Ruben Verborgh. 2018. A preliminary Open Data publishing strategy for real-time data in Flanders. In Proceedings of the Web Stream Processing Workshop, 1847–1853.
APA
Rojas Meléndez, J., Van de Vyvere, B., Gevaert, A., Taelman, R., Colpaert, P., & Verborgh, R. (2018). A preliminary Open Data publishing strategy for real-time data in Flanders. Proceedings of the Web Stream Processing Workshop, 1847–1853.
IEEE
J. Rojas Meléndez, B. Van de Vyvere, A. Gevaert, R. Taelman, P. Colpaert, and R. Verborgh, “A preliminary Open Data publishing strategy for real-time data in Flanders,” in Proceedings of the Web Stream Processing Workshop, 2018, pp. 1847–1853.
LNCS
Rojas Meléndez, J., Van de Vyvere, B., Gevaert, A., Taelman, R., Colpaert, P., Verborgh, R.: A preliminary Open Data publishing strategy for real-time data in Flanders. In: Proceedings of the Web Stream Processing Workshop. pp. 1847–1853 (2018).
MLA
Rojas Meléndez, Julián, et al. “A Preliminary Open Data Publishing Strategy for Real-Time Data in Flanders.” Proceedings of the Web Stream Processing Workshop, 2018, pp. 1847–53.

Discuss this article