GE4

Which protein regulate p65 (UniProt:Q04206), and how? Show me the provenence!

The BioNLP-ST GE task has been promoting development of fine-grained information extraction (IE) from biomedical documents, since 2009. Particularly, it has focused on the domain of NFkB as a model domain of Biomedical IE.

As its fourth edition, in this year, the focus is moved from IE to KB construction as an application case of IE, which means the goal of IE is not IE itself any more but to make IE useful for KB construction. In the end, GE task 2016 aims at delivering a KB on NFkB to the public.

A preliminary version of a NFkB KB is prepared at http://bionlp.dbcls.jp/sparql/. It is a SPARQL endpoint populated with information pieces extracted from the banchmark data set of GE task 2016. The goal of GE task 2016 to enrich it, using knowledge pieces extracted from any other resources.

Note that GE task 2016 is organized with more emphasis on "contribution" than on "competition".
Participants can provide contribution from any aspect of knowledge extraction. It may be event extraction, static relation extraction, coreference resolution, and so on.

Contribution will be evaluated in terms of how many new knowledge pieces can be contributed by individual participanting systems. For example, a participant may think about addressing coreference resolution, utilzing a publicly available event extraction system, e.g. TEE, as a baseline event extraction system, and in the end claiming that how many new knowledge pieces can be extracted by adding the coreference resolution system to TEE.

We call this way of evaluation a "KB evaluation" to distinguish it from the "IE evaluation" which was performed as official evaluation of previous editions of GE task. In short, while an IE evaluation will count correctly predicted pieces of annotations, a KB evaluation will count the number of correct answers to pre-defined questions.