Review Article

Mixed Methods in CAM Research: A Systematic Review of Studies Published in 2012

Table 2

Results of quality appraisal of 80 mixed methods studies using MMAT [33].

YesNoCannot tell
% % %

Qualitative Component
(1.1) Are the sources of qualitative data relevant to address the research question?3543.8%22.5%4353.8%
(1.2) Is the process for analyzing qualitative data relevant to address the research question?4455.0%33.8%3341.3%
(1.3) Is appropriate consideration given to how findings relate to the context in which the data were collected?3037.5%5062.5%00.0%
(1.4) Is appropriate consideration given to how findings relate to researchers’ influence?1721.3%6378.8%00.0%

Quantitative Component—RCTs
(2.1) Is there a clear description of the randomization (or an appropriate sequence generation)?880.0%220.0%00.0%
(2.2) Is there a clear description of the allocation concealment (or blinding when applicable)?770.0%330.0%00.0%
(2.3) Are there complete outcome data (80% or above)?10100.0%00.0%00.0%
(2.4) Is there low withdrawal/dropout (below 20%)?880.0%220.0%00.0%

Quantitative Component—Nonrandomised
(3.1) Are participants (organizations) recruited in a way that minimizes selection bias?571.4%00.0%228.6%
(3.2) Are measurements appropriate regarding the exposure/intervention and outcomes?7100.0%00.0%00.0%
(3.3) In the groups being compared, are the participants comparable, or do researchers take into account (control for) the difference between these groups?457.1%00.0%342.9%
(3.4) Are there complete outcome data (80% or above) and, when applicable, an acceptable response rate (60% or above) or an acceptable follow-up rate for cohort studies (depending on duration of followup)?457.1%228.6%114.3%

Quantitative Component—Descriptive
(4.1) Is the sampling strategy relevant to address the quantitative research question?1828.6%23.2%4368.3%
(4.2) Is the sample representative of the population understudy?1219.0%23.2%4977.8%
(4.3) Are measurements appropriate (clear origin, or validity known, or standard instrument)?5181.0%812.7%46.3%
(4.4) Is there an acceptable response rate (60% or above)?711.1%69.5%5079.4%

Mixed Methods
(5.1) Is the mixed methods research design relevant to address the qualitative and quantitative research questions?6480.0%1215.0%45.0%
(5.2) Is the integration of qualitative and quantitative data (or results) relevant to address the research question?6581.3%1012.5%56.3%
(5.3) Is appropriate consideration given to the limitations associated with this integration?45.0%7695.0%00.0%