Research Article

Recognizing Continuous and Discontinuous Adverse Drug Reaction Mentions from Social Media Using LSTM-CRF

Table 3

Performances of different methods on continuous and discontinuous ADR mentions, respectively (using strict criterion).

MethodRepresentationContinuous ADR mentionDiscontinuous ADR mention

CRFBIOHD0.68820.59500.63820.30930.24950.2762
Multilabel0.68960.59930.64130.52170.24050.3293
LSTM-CRF (baseline)BIOHD0.67200.70020.68580.35790.35630.3571
Multilabel0.67030.70620.68770.48250.35330.4079
LSTM-CRF + subjectBIOHD0.68000.70920.69430.35730.36130.3593
Multilabel0.68820.71090.69940.44000.32630.3747
LSTM-CRF + knowledgeBIOHD0.66980.71650.69240.34170.38020.3600
Multilabel0.67530.70620.69040.50960.35530.4187
LSTM-CRF + allBIOHD0.68130.71730.69880.34060.35130.3459
Multilabel0.67180.71540.69290.48410.36230.4144