Rule-Based Information Extraction from Free-Text Pathology Reports Reveals Trends in South African Female Breast Cancer Molecular Subtypes and Ki67 Expression

Table 2

Evaluation of the matching algorithm extractions on 300 random validation samples.

Parameter	Category	Precision (CI)	Recall (CI)	-score (CI)	Kappa (CI)
ER	Negative	0.96 (0.91-0.98)	0.93 (0.87-0.97)	0.95 (0.89-0.98)	0.92 (0.89-0.95)
	Positive	0.97 (0.94-0.98)	0.98 (0.96-0.99)	0.98 (0.95-0.99)
PR	Negative	0.95 (0.91-0.98)	0.99 (0.96-0.99)	0.97 (0.93-0.99)	0.98 (0.96-0.99)
	Positive	0.99 (0.97-0.99)	0.96 (0.92-0.98)	0.98 (0.94-0.99)
HER2	Negative	1.00 (0.98-1.00)	1.00 (0.99-1.00)	1.00 (0.98-1.00)	0.99 (0.97-1.00)
	Positive	1.00 (0.98-1.00)	0.99 (0.94-0.99)	0.99 (0.95-0.99)
Ki67	<14	0.84 (0.73-0.91)	0.98 (0.90-0.97)	0.91 (0.81-0.95)	0.95 (0.91-0.97)
	≥14	0.99 (0.97-0.99)	0.94 (0.91-0.98)	0.97 (0.93-0.98)
Grade	I	0.83 (0.60-0.93)	1.00 (0.89-1.00)	0.91 (0.91-0.98)	0.97 (0.94-0.98)
	II	0.97 (0.92-0.99)	0.97 (0.92-0.99)	0.97 (0.92-0.99)
	III	0.99 (0.94-0.99)	0.95 (0.89-0.98)	0.97 (0.91-0.98)
Type	IDC	1.00 (0.99-0.99)	1.00 (0.99-0.99)	1.00 (0.99-0.99)	1.00(0.99-1.00)
	Others	1.00 (0.95-1.00)	1.00 (0.95-1.00)	1.00 (0.95-1.00)
Laterality	Left breast	0.99(0.95-0.99)	0.99 (0.96-0.99)	0.99 (0.96-0.99)	0.99 (0.95-0.99)
	Right breast	0.99 (0.96-0.99)	0.98 (0.94-0.99)	0.99 (0.95-0.99)