Research Article
A Supervised Approach to Predict the Hierarchical Structure of Conversation Threads for Comments
Table 6
Experimental results with declarative evaluation metrics.
| Datasets | Method | | | | | | | | | | AccCTD |
|
Thestandard | SLARTS | 0.3782 ±0.008 | 0.4155 ±0.011 | 0.3960 ±0.006 | 0.1565 ±0.007 | 0.1713 ±0.008 | 0.1636 ±0.007 | 0.3628 ±0.012 | 0.4166 ±0.016 | 0.3876 ±0.005 | 0.7525 ±0.005 | Seo et al.’s [2] | 0.3014 ±0.031 | 0.1414 ±0.015 | 0.1921 ±0.016 | 0.1544 ±0.025 | 0.0576 ±0.011 | 0.0835 ±0.013 | 0.3013 ±0.038 | 0.1319 ±0.018 | 0.1831 ±0.021 | 0.5831 ±0.007 | Difference | 0.0778 | 0.2741 | 0.2039 | 0.0021 | 0.1137 | 0.0801 | 0.0615 | 0.2847 | 0.2045 | 0.1694 |
|
ENENews | SLARTS | 0.3797 ±0.038 | 0.3891 ±0.019 | 0.3839 ±0.024 | 0.1873 ±0.040 | 0.1855 ±0.026 | 0.1857 ±0.030 | 0.3768 ±0.048 | 0.3768 ±0.017 | 0.3759 ±0.025 | 0.6872 ±0.014 | Seo et al.’s [2] | 0.4060 ±0.030 | 0.1713 ±0.016 | 0.2407 ±0.018 | 0.2378 ±0.034 | 0.0837 ±0.016 | 0.1235 ±0.021 | 0.3947 ±0.035 | 0.1523 ±0.015 | 0.2196 ±0.019 | 0.5954 ±0.009 | Difference | −0.0263 | 0.2178 | 0.1432 | −0.0505 | 0.1018 | 0.0622 | −0.0179 | 0.2245 | 0.1563 | 0.0918 |
|
Courantblogs | SLARTS | 0.5236 ±0.030 | 0.3963 ±0.073 | 0.4495 ±0.052 | 0.4220 ±0.057 | 0.3110 ±0.058 | 0.3566 ±0.049 | 0.5325 ±0.049 | 0.3853 ±0.075 | 0.4452 ±0.057 | 0.7625 ±0.033 | Seo et al.’s [2] | 0.7320 ±0.090 | 0.2049 ±0.062 | 0.3189 ±0.082 | 0.6815 ±0.105 | 0.1896 ±0.070 | 0.2951 ±0.093 | 0.7309 ±0.094 | 0.2010 ±0.065 | 0.3140 ±0.086 | 0.7001 ±0.031 | Difference | −0.2084 | 0.1914 | 0.1306 | −0.2595 | 0.1214 | 0.0615 | −0.1984 | 0.1843 | 0.1312 | 0.0624 |
|
Russianblog | SLARTS | 0.5940 ±0.028 | 0.5674 ±0.022 | 0.5803 ±0.023 | 0.4907 ±0.031 | 0.4664 ±0.020 | 0.4782 ±0.024 | 0.5878 ±0.028 | 0.5823 ±0.021 | 0.5849 ±0.020 | 0.9116 ±0.011 | Seo et al.’s [2] | 0.4705 ±0.020 | 0.3030 ±0.015 | 0.3685 ±0.016 | 0.3823 ±0.023 | 0.2534 ±0.013 | 0.3046 ±0.015 | 0.4682 ±0.020 | 0.2822 ±0.014 | 0.3521 ±0.015 | 0.5862 ±0.013 | Difference | 0.1235 | 0.2644 | 0.2118 | 0.1084 | 0.213 | 0.1736 | 0.1196 | 0.3001 | 0.2328 | 0.3254 |
|
Alef | SLARTS | 0.6189 ±0.028 | 0.4131 ±0.040 | 0.4952 ±0.037 | 0.5639 ±0.027 | 0.3819 ±0.037 | 0.4551 ±0.034 | 0.6277 ±0.027 | 0.4069 ±0.043 | 0.4934 ±0.039 | 0.8044 ±0.013 | Seo et al.’s [2] | 0.8827 ±0.052 | 0.2637 ±0.051 | 0.4045 ±0.060 | 0.8797 ±0.053 | 0.2631 ±0.051 | 0.4034 ±0.060 | 0.8840 ±0.052 | 0.2635 ±0.051 | 0.4043 ±0.060 | 0.7846 ±0.018 | Difference | −0.2638 | 0.1494 | 0.0907 | −0.3158 | 0.1188 | 0.0517 | −0.2563 | 0.1434 | 0.0891 | 0.0198 |
|
|
The bold style shows the best result in each metric.
|