Research Article
Reliability and External Validity of AMSTAR in Assessing Quality of TCM Systematic Reviews
Table 1
Assessment of the interrater agreement for AMSTAR.
| Item | Agreement (%, 95% CI) | Kappa (95% CI) |
| (1) Was an “a priori” design provided? | 92.7 (80.1–98.5) | −0.03 (−0.10, 0.04) | (2) Was there duplicate study selection and data extraction? | 85.4 (70.8–94.4) | 0.70 (0.49, 0.91) | (3) Was a comprehensive literature search performed? | 87.8 (73.8–95.9) | 0.75 (0.55, 0.95) | (4) Was the status of publication (i.e., grey literature) used as an inclusion criterion? | 95.1 (83.5–99.4) | 0.72 (0.37, 1.00) | (5) Was a list of studies (included and excluded) provided? | 48.8 (32.9–64.9) | 0.16 (0.03, 0.30) | (6) Were the characteristics of the included studies provided? | 78.1 (62.4–89.4) | 0.40(0.08, 0.71) | (7) Was the scientific quality of the included studies assessed and documented? | 92.7 (80.1–98.5) | 0.36 (−0.20, 0.92) | (8) Was the scientific quality of the included studies used appropriately in formulating conclusions? | 92.7 (80.1–98.5) | 0.36 (−0.20, 0.92) | (9) Were the methods used to combine the findings of studies appropriate? | 56.1 (39.8–71.5) | 0.17 (0.01, 0.33) | (10) Was the likelihood of publication bias assessed? | 97.6 (87.1–99.9) | 0.95 (0.85, 1.00) | (11) Were potential conflicts of interest included? | 100 (91.4-100) | 1.00 (1.00, 1.00) | Total | 84 (71.1–91.9) | 0.50 (0.26, 0.73) |
|
|