An Overview of Biomolecular Event Extraction from Scientific Documents

Table 5

Core event extraction performance comparison. BioNLP shared task comparison results in recall/precision/F-score (%) on the test set for Task 1 (core event extraction). (A) abstracts only and (F) full papers. Data extracted from BioNLP-ST 2009, BioNLP-ST 2011, and BioNLP-ST 2013 overviews [51, 52, 109].

Year	System		Event type			Total
			Simple	Binding	Regulation
2009	UTurku; Björne et al. [86]	(A)	64.21/77.45/70.21	40.06/49.82/44.41	35.63/45.87/40.11	46.73/58.48/51.95
2010	Miwa; Miwa et al. [87]	(A)	65.31/76.44/70.44	52.16/53.08/52.62	35.93/46.66/40.60	48.62/58.96/53.29
2011	FAUST; Riedel et al. [111]	(A); (F)	66.16/81.04/72.85; 75.58/78.23/76.88	45.53/58.09/51.05; 40.97/44.70/42.75	39.38/58.18/46.97; 34.99/48.24/40.56	50.00/67.53/57.46; 47.92/58.47/52.67
	UMass; Riedel and McCallum [104]	(A); (F)	64.21/80.74/71.54; 75.58/83.14/79.18	43.52/60.89/50.76; 41.67/47.62/44.44	38.78/55.07/45.51; 34.72/47.51/40.12	48.74/65.94/56.05; 47.84/59.76/53.14
2013	EVEX; Hakala et al. [91]	(F)	73.83/79.56/76.59	41.14/44.77/42.88	32.41/47.16/38.41	45.44/58.03/50.97
	TEES-2.1; Björne and Salakoski [97]	(F)	74.19/79.64/76.82	42.34/44.34/43.32	33.08/44.78/38.05	46.17/56.32/50.74
	BioSEM; Bui et al. [99]	(F)	67.71/86.90/76.11	47.45/52.32/49.76	28.19/49.06/35.80	42.47/62.83/50.68