Evidence-Based Complementary and Alternative Medicine / 2018 / Article / Tab 3

Research Article

Tongue Image Database Construction Based on the Expert Opinions: Assessment for Individual Agreement and Methods for Expert Selection

Table 3

Improving process of the interrater agreement for “the moderate tongue texture.”

Recognition timesIdentified discordant expertsRest expertsInter-rater agreement for the rest of the experts

1rater 45, rater 49, rater 32, rater 42, rater 34, rater 40440.1674
2rater 20, rater 16, rater 13, rater 3400.2220
3rater 5, rater 43380.2470
4rater 15, rater 25360.2707
5rater 29, rater 39, rater 33, rater 47320.3247
6rater 31, rater 35, rater 50, rater 26, rater 38270.4098
7rater 41, rater 17, rater 1, rater 10230.4890
8rater 46, rater 19, rater 44, rater 37, rater 30, rater 18, rater 11160.6333

Article of the Year Award: Outstanding research contributions of 2020, as selected by our Chief Editors. Read the winning articles.