Research Article
EmoHeart: Conveying Emotions in Second Life Based on Affect Sensing from Text
Table 5
Comparison of accuracy of Affect Analysis Model employing different parsers (Connexor Machinese Syntax versus Stanford Parser).
| Measure | Gold standard | 2-3 annotators agreed | 3 annotators agreed | Fine-grained emotions | Merged labels | Fine-grained emotions | Merged labels | 656 sentences, Kappa 0.51 | 692 sentences, Kappa 0.60 | 249 sentences, Kappa 1.0 | 447 sentences, Kappa 1.0 |
| Accuracy of AAM with Connexor Machinese Syntax | 0.726 | 0.816 | 0.815 | 0.890 |
| Accuracy of AAM with Stanford Parser | 0.649 | 0.747 | 0.751 | 0.814 |
| Difference in % | 7.7 | 6.9 | 6.4 | 7.6 |
|
|