Mixed Methods in CAM Research: A Systematic Review of Studies Published in 2012
Table 2
Results of quality appraisal of 80 mixed methods studies using MMAT [33].
Yes
No
Cannot tell
%
%
%
Qualitative Component
(1.1) Are the sources of qualitative data relevant to address the research question?
35
43.8%
2
2.5%
43
53.8%
(1.2) Is the process for analyzing qualitative data relevant to address the research question?
44
55.0%
3
3.8%
33
41.3%
(1.3) Is appropriate consideration given to how findings relate to the context in which the data were collected?
30
37.5%
50
62.5%
0
0.0%
(1.4) Is appropriate consideration given to how findings relate to researchers’ influence?
17
21.3%
63
78.8%
0
0.0%
Quantitative Component—RCTs
(2.1) Is there a clear description of the randomization (or an appropriate sequence generation)?
8
80.0%
2
20.0%
0
0.0%
(2.2) Is there a clear description of the allocation concealment (or blinding when applicable)?
7
70.0%
3
30.0%
0
0.0%
(2.3) Are there complete outcome data (80% or above)?
10
100.0%
0
0.0%
0
0.0%
(2.4) Is there low withdrawal/dropout (below 20%)?
8
80.0%
2
20.0%
0
0.0%
Quantitative Component—Nonrandomised
(3.1) Are participants (organizations) recruited in a way that minimizes selection bias?
5
71.4%
0
0.0%
2
28.6%
(3.2) Are measurements appropriate regarding the exposure/intervention and outcomes?
7
100.0%
0
0.0%
0
0.0%
(3.3) In the groups being compared, are the participants comparable, or do researchers take into account (control for) the difference between these groups?
4
57.1%
0
0.0%
3
42.9%
(3.4) Are there complete outcome data (80% or above) and, when applicable, an acceptable response rate (60% or above) or an acceptable follow-up rate for cohort studies (depending on duration of followup)?
4
57.1%
2
28.6%
1
14.3%
Quantitative Component—Descriptive
(4.1) Is the sampling strategy relevant to address the quantitative research question?
18
28.6%
2
3.2%
43
68.3%
(4.2) Is the sample representative of the population understudy?
12
19.0%
2
3.2%
49
77.8%
(4.3) Are measurements appropriate (clear origin, or validity known, or standard instrument)?
51
81.0%
8
12.7%
4
6.3%
(4.4) Is there an acceptable response rate (60% or above)?
7
11.1%
6
9.5%
50
79.4%
Mixed Methods
(5.1) Is the mixed methods research design relevant to address the qualitative and quantitative research questions?
64
80.0%
12
15.0%
4
5.0%
(5.2) Is the integration of qualitative and quantitative data (or results) relevant to address the research question?
65
81.3%
10
12.5%
5
6.3%
(5.3) Is appropriate consideration given to the limitations associated with this integration?