Category Archives: Blog

EDF 2016 is now over and HOBBIT was present in several functions. We disseminated the idea of a universal benchmarking platform to the many European organizations and research projects that were present at the forum. Potential collaborations were established with data-driven projects pertaining to geo-spatial data and societal challenges, which will be followed through. Beware […]

In this post, we will present some preliminary results of the survey we ran for the past few months. At the time of writing, there were 61 survey participants. These were evenly divided among the different profiles, namely solution providers, technology users and scientific community. Most of the participants have two or more of these profiles. All […]

ESWC is one of the major hubs for academia and industry interested in Linked Data and the Semantic Web. Accordingly, the HOBBIT project was present and gave an overview of its goals to the Semantic Web community. Two major events were at the center of HOBBIT’s attendance to ESWC. On June 1st, the first HOBBIT […]

In one of its key tasks, HOBBIT will continuously collect various datasets (i.e., not limited to specific domains) as the base for benchmarks. Those data will initially be provided by the project industrial partners, and later on by members of the HOBBIT community. A data management plan will be used as a guideline when handling […]

In a former blog post, we presented the predecessor of the HOBBIT platform, the General Entity Annotator Benchmarking Framework (GERBIL) [1]. This framework has been adopted by two evaluation campaigns as described in this post. These campaigns focus on tasks such as entity recognition, entity typing and question answering. Open Knowledge Extraction Challenge The OKE […]

The idea of creating a platform to host different benchmarking tools for the Big Linked Data lifecycle was born with the creation of the General Entity Annotator Benchmarking Framework [1](GERBIL). GERBIL is designed to facilitate the benchmarking of named entity recognition (NER), named entity disambiguation (NED) and other semantic tagging approaches. GERBIL’s objective is to […]

Graph-TA, organised by the DAMA-UPC (Data Management) group of Universitat Politècnica de Catalunya – BarcelonaTech, aims at encouraging researchers to present their current work and interact in an informal set up in order to foster collaboration with other colleagues. Thus, the workshop provides a forum for presenting and discussing research results and applications in the […]

We opened up a short survey to question the industry and other potential partners on how they are evaluating their software. The goal of this survey is to determine industry-relevant key performance indicators (KPI’s) for building benchmarks that measure these factors. With this survey, we aim to raise awareness about the HOBBIT project and lay a foundation for […]

Linked Data technologies are proving their efficiency in creating interoperable IT systems that integrate disparate data sources. However, it is still unclear which solutions scale up the needs of modern business applications. Benchmarks have been created to support decisions on choosing the best software solution. However, they commonly fail to reflect business requirements in terms […]

The HOBBIT Kickoff meeting took in Luxembourg on the 18 and 19 January 2016. All 10 partners were present and showed the firsts results of the first month of the project. These, corresponde to creating a online presence, description of the datasets in the consortium and collecting events where the partners are to disseminate and […]