EmoHeart: Conveying Emotions in Second Life Based on Affect Sensing from Text

Table 2

The results of experiment with Affect Analysis Model employing Stanford Parser.

Gold standard	Measure	Fine-grained emotion categories										Merged labels
		neut	ang	disg	fear	guilt	inter	joy	sad	sh	sur	Pos	Neg	Neut
2-3 annotators agreed	Averaged accuracy	0.649										0.747
	Precision	0.30	0.77	0.64	0.74	0.71	0.61	0.83	0.74	0.50	0.76	0.84	0.91	0.28
	Recall	0.55	0.34	0.70	0.80	0.55	0.81	0.71	0.64	0.67	0.72	0.80	0.75	0.55
	F-score	0.39	0.47	0.67	0.76	0.62	0.70	0.76	0.69	0.57	0.74	0.82	0.82	0.37
3 annotators agreed	Averaged accuracy	0.751										0.814
	Precision	0.15	0.92	0.83	0.87	0.80	0.50	0.96	0.88	0.50	0.82	0.94	0.98	0.08
	Recall	0.75	0.65	0.56	0.83	0.67	0.75	0.78	0.74	0.33	0.82	0.85	0.79	0.75
	F-score	0.24	0.76	0.67	0.85	0.73	0.60	0.86	0.80	0.40	0.82	0.89	0.88	0.14