A Supervised Approach to Predict the Hierarchical Structure of Conversation Threads for Comments

Table 4

Example of calculation of declarative metrics for the example shown in Figure 18.

Evaluation metric	Calculation
AccCTD	TP={1,2,9,10,11}; TN={3,4,5,6,8}; FN={7}; FP={}; 5+55+5+1+0≈0.91
𝑃edge; 𝑅edge; 𝐹1edge	TP={3⟶1,5⟶2,6⟶5}      𝑃edge=33+3=0.5; FN={4⟶3,8⟶5}        𝑅edge=33+2=0.6; FP={4⟶1,7⟶2,8⟶7}      𝐹1−scoreedge≈0.55
𝑃path; 𝑅path; 𝐹1path	𝑃path=|{3⟶1,5⟶2,6⟶5⟶2}||{}|=33⟶1,4⟶1,5⟶2,6⟶5⟶2,7⟶2,8⟶7⟶26=0.5; 𝑅path=|{3⟶1,5⟶2,6⟶5⟶2}||{}|=33⟶1,4⟶3⟶1,5⟶2,6⟶5⟶2,8⟶5⟶25=0.6; 𝐹1-score𝑅-path≈0.55
𝑃𝑅-path; 𝑅𝑅-path; 𝐹1𝑅-path	𝑃𝑅-path={3⟶1,4⟶1,5⟶2,6⟶5⟶2,7⟶2,8⟶7⟶2}|{}|=3,4,5,6,7,81+1+1+1+0+1/26=4.56=0.75; 𝑅𝑅-path={3⟶1,4⟶3⟶1,5⟶2,6⟶5⟶2,8⟶5⟶2}|{}|=3,4,5,6,81+1/2+1+1+1/25=45=0.8; 𝐹1-score𝑅-path=2∗0.75∗0.80.75+0.8≈0.77