- About this Journal ·
- Abstracting and Indexing ·
- Advance Access ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Gastroenterology Research and Practice
Volume 2014 (2014), Article ID 510494, 10 pages
Physician Perceptions on Colonoscopy Quality: Results of a National Survey of Gastroenterologists
1Center for Health Services Research in Primary Care, Durham Veterans Affairs Medical Center, Durham, NC 27710, USA
2Department of Medicine, Duke University Medical Center, Durham, NC 27705, USA
3Duke Clinical Research Institute, Duke University Medical Center, Durham, NC 27705, USA
4VA Cooperative Studies Epidemiology Center, Durham, NC 27710, USA
Received 26 September 2013; Accepted 28 January 2014; Published 6 March 2014
Academic Editor: Hazem T. Hammad
Copyright © 2014 Ziad F. Gellad et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Background. Quality indicators for colonoscopy have been developed, but the uptake of these metrics into practice is uncertain. Our aims were to assess physician perceptions regarding colonoscopy quality measurement and to quantify the perceived impact of quality measurement on clinical practice. Methods. We conducted in-person interviews with 15 gastroenterologists about their perceptions regarding colonoscopy quality. Results from these interviews informed the development of a 34-question web-based survey that was emailed to 1,500 randomlyselected members of the American College of Gastroenterology. Results. 160 invitations were undeliverable, and 167 out of 1340 invited physicians (12.5%) participated in the survey. Respondents and nonrespondents did not differ in age, sex, practice setting, or years since training. 38.8% of respondents receive feedback on their colonoscopy quality. The majority of respondents agreed with the use of completion rate (90%) and adenoma detection rate (83%) as quality indicators but there was less enthusiasm for withdrawal time (61%). 24% of respondents reported usually or always removing diminutive polyps solely to increase their adenoma detection rate, and 20% reported prolonging their procedure time to meet withdrawal time standards. Conclusions. A minority of respondents receives feedback on the quality of their colonoscopy. Interventions to increase continuous quality improvement in colonoscopy screening are needed.
The use of colonoscopy for colorectal cancer (CRC) screening is increasing in frequency [1–3] and has become the dominant screening modality in the United States Medicare population . Numerous observational studies have demonstrated the preventive benefits of colonoscopy [5–10], and several large randomized clinical trials are underway. However, colonoscopy is not a perfect test; population-based studies suggest that colonoscopy can miss cancerous lesions in 2%–6% of exams [11–14]. Furthermore, recent studies have underscored the limitation of colonoscopy in preventing CRC, especially on the right side of the colon [8, 15, 16].
While there may be biologic explanations for this suboptimal impact, studies have found that endoscopist behavior also plays a key role [17–19]. In fact, there is well established variation among endoscopists in colonoscopy surveillance recommendations [20, 21] and adenoma and polyp detection rates [22–24]. Furthermore, low detection rates have been associated with interval cancer risk . Quality metrics for colonoscopy have been proposed by the national gastroenterology societies  and advocated in high-profile settings , but the dissemination and use of these metrics in practice is uncertain. Furthermore, few studies have attempted to understand the reasons underlying this variation in quality metrics.
To address these uncertainties, we undertook a survey of gastroenterologists to better understand the dissemination of best practices in colonoscopy and to assess physician perceptions regarding colonoscopy quality and quality measurement. Our hypothesis was twofold: firstly, we anticipated that, as has been observed in other fields , the implementation of quality measurement in colonoscopy practice, as indicated by the proportion of endoscopists who receive feedback, would be low; secondly, we believed that the perceived impact of quality measurement on clinical practice would vary widely among physicians.
2.1. Study Overview
The survey methodology, including a copy of the final survey instrument, has been reported  and is summarized below. The Duke University Medical Center Institutional Review Board approved the study and the consent procedures. Written informed consent was obtained from participating physicians for the qualitative interviews. Waiver of written informed consent for the web survey was approved by the Duke Institutional Review Board based on three factors: first, the research presented no more than minimal risk to subjects; second, participants were informed in writing of the purpose of the survey and potential risks prior to participating and had the opportunity to opt out of the survey at any point; third, the study involved no procedures for which written consent is normally required outside of the research context.
2.2. Qualitative Interviews
We conducted in-person interviews with 15 gastroenterologists about their perceptions regarding colonoscopy quality and quality measurement. Physicians were eligible if they were actively practicing gastroenterologists in Durham, Chapel Hill, or Raleigh, North Carolina. Electronic and mailed invitations were sent to eligible physicians. Respondents were offered a meal and a $50 cash incentive for participation. Because responses may differ according to practice setting and experience, maximum variation sampling was used, with the goal of obtaining physicians both from academic and community practice as well as those with fewer and greater than five years in practice.
Interviews occurred between October 2010 and December 2010 in a private setting. Interviews were conducted by a single nonphysician investigator (C. I. Voils) skilled in qualitative methodology. The interviewer used a structured interview guide to probe physicians about clinical practice patterns and beliefs regarding colonoscopy quality. Interviews were digitally audiorecorded. Data analysis and data collection occurred iteratively; after each interview was conducted, two team members (Z. F. Gellad and C. I. Voils) listened to the interview and compared responses to previous interviews to identify issues deserving more attention in future interviews and to determine when thematic saturation was reached.
Interviews were transcribed for analysis. Directed content analysis was used to identify important themes and concepts regarding colonoscopy quality . Two team members (Z. F. Gellad, C. I. Voils) generated descriptive labels to describe themes; the coding scheme was finalized through discussion, and then the final coding scheme was applied to all transcripts by one team member (Z. F. Gellad). Responses were stratified by respondent practice type (academic versus community) and years in practice (≤5 years versus >5 years).
2.3. Survey Design
After reviewing the results of the qualitative work discussed above, we composed a 34-question web-based closed survey instrument, which was administered using REDCap (Research Electronic Data Capture) tools hosted at Duke University . The survey was pretested and revised using cognitive interviewing with five volunteer gastroenterologists varying in age and years in practice to assure clarity . Although the survey queried a variety of factors related to endoscopy practice, only results regarding colonoscopy practice and performance quality are reported herein.
2.4. Survey Distribution and Data Collection
Active full members of the American College of Gastroenterology (ACG) were eligible to participate (, 154). Members were excluded if they were Duke physicians () or did not have an email address available in the database (). The database was used with permission from the ACG.
We distributed the survey in two phases. In the first phase, we invited 500 randomly selected ACG members to participate in July 2011. Physicians received an introductory email from a dedicated study email account with a duke.edu domain, signed by all of the investigators, with an invitation to participate in the survey. This email contained a unique link to the online survey. Respondents were able to opt out of the study by clicking in an embedded URL link that would terminate any further contact. An email reminder was sent to all nonresponders at one week and three weeks after the introductory email. The survey was closed four weeks after the introductory email. As an incentive for participation, respondents were entered into a drawing for one of two Apple iPad2s.
Because the response rate to this first phase was less than we had foreseen, we randomly selected another 1000 physicians from the same population to participate. These ACG members were invited in the same fashion as described above in September 2011 and are included together in the analysis that follows.
2.5. Statistical Analysis
Physicians’ characteristics are described using frequencies and percentages or medians with interquartile ranges, as appropriate. To examine the association between physician characteristics and responses to the survey questions, we performed Wilcoxon rank sum tests (for continuous variables) or test (for categorical variables) for bivariate comparisons of physician responses by respondent sex, median years in practice, gastroenterology board certification, practice setting (academic, private/mixed), weekly colonoscopy volume (<10, 10–20, 21–30, 31–40, and >40), productivity bonus, and receipt of feedback on colonoscopy quality. We then performed multivariable analyses with the abovementioned covariates using logistic regression for items with dichotomous response options and general linear regression modeling for items with ordinal scaled polytomous responses. Items with ordinal polytomous responses were coded with higher scores corresponding to greater agreement or frequency. We used variance inflation factors to quantify collinearity among the predictor variables and removed age from the models because it showed severe redundancy with years since training. To facilitate interpretation of the model results, we reported the effect size for each covariate, namely, the proportion of total variation accounted for by the effect () in general linear models and odds ratios in the logistic regressions.
We used SAS version 9.2 (SAS Institute, Inc., Cary, North Carolina) for all analyses and considered a 2-tailed α level of 0.05 to be significant without adjusting for multiple comparisons.
2.6. Nonresponse Analysis
We retrieved demographic and training information from the American Medical Association (AMA) Physician Masterfile for 1,251 of the 1,340 physicians who received an invitation to participate in the survey. Physicians were matched to Masterfile data by name, address, email address, and National Provider Identifier. We compared respondents and nonrespondents by sex, practice setting, gastroenterology board certification, and years since most recent training using the test for categorical variables and the Wilcoxon rank sum test for continuous variables. Due to the possibility that nonclinicians would be represented in the nonrespondent category group, gastroenterology board certification was compared only in those classified by the AMA as gastroenterologists, hepatologists, internists, and colorectal surgeons.
3.1. Response Rate & Physician Demographics
Of the 1500 email survey invitations, 160 were returned as undeliverable, resulting in an invited population of 1340 physicians. 167 physicians responded to the survey, resulting in a participation rate of 12.5%. The demographic characteristics of survey respondents are shown in Table 1. The majority of respondents were male (87.2%), board certified (91.3%), and in private practice (67.3%). Female respondents were more likely to be employed in academic settings (60.0% versus 18.7%, ) and were younger (median of 4.5 years in practice versus 20.0 years, ) than male respondents.
3.2. Nonresponse Analysis
Responders and nonresponders did not differ significantly in age (), sex (), practice setting (), or years in practice (). There were more specialists in the nonresponder group that would not be expected to obtain GI board certification (data not shown). When these specialists were excluded from the sample and only colorectal surgeons, hepatologists, gastroenterologists, and internists were included, the respondents and nonrespondents did not significantly differ in terms of board certification in gastroenterology (91.3% versus 87.5%, ).
3.3. Receipt of Quality Feedback
38.8% of respondents reported receiving feedback on the quality of their colonoscopy. There were no significant differences in receipt of feedback by endoscopist sex, years in practice, board certification, practice setting, receipt of a productivity bonus, or colonoscopy volume (Table 2). As shown in Table 3, the odds of discussing missed lesions were greater among respondents who received feedback than those that did not receive feedback (OR 4.05, 95% CI 1.53–10.8), independent of other factors. The odds of retroflexing in the right colon were also greater among respondents who received feedback (), although the effect size was small (Table 4). There was no association between receipt of feedback and attempt to intubate the terminal ileum (), retroflexion in the rectum (), prolongation of the procedure to meet quality standards for withdrawal time (), or removal of polyps solely to increase adenoma detection rate ().
3.4. Physician Perceptions Regarding Colonoscopy Quality Measurement
Figure 1 presents survey results of physician perceptions regarding colonoscopy quality measures. The majority of respondents agreed with the use of completion rate (90%) and adenoma detection rate (83%) as quality indicators. Although they are still a majority, fewer respondents supported the use of withdrawal time (61%) as an appropriate quality indicator. Respondents felt that the benchmark rates for withdrawal time and adenoma detection were too low (24% and 25%), about right (69% and 66%), or too high (8% and 9%). Respondents who receive feedback on the quality of their colonoscopy were more likely to say recommended detection rates were too low, even after adjusting for other factors () (Table 5). In contrast, increasing years in practice were significantly associated with answering that the recommended rates were too high (). In regard to a benchmark withdrawal time of 6 minutes, responses did not significantly differ among measured covariates.
3.5. Colonoscopy Practice Variation: Detection and Removal
Figure 2 displays the variation in colonoscopy practice among respondents. While the majority of respondents (94%) reported usually or always attempting to retroflex in the rectum, only 13% reported usually or always attempting to retroflex in the right colon and 48% to intubate the terminal ileum. In multivariable analysis (Table 4), receipt of quality feedback () and male sex () were significantly associated with retroflexion in the right colon. Also, twice as many respondents in academic practice reported usually or always attempting retroflexion in the right colon as compared to private/mixed practice (22.3% versus 11.3%, ). 24% of respondents reported usually or always removing diminutive polyps solely to increase their adenoma detection rate. Similarly, 20% of respondents reported usually or always prolonging their procedure to meet quality standards for withdrawal time. None of the examined covariates was associated with respondents’ responses to these questions (Table 4).
3.6. Colonoscopy Practice Variation: Surveillance
The survey also asked respondents to rate factors that result in shortened surveillance recommendations (Figure 3). While financial incentives did not appear to be a major driver of behavior, difficulty of procedure, adequacy of preparation, and, to a lesser extent, patient preference and malpractice concerns did play a role. For example, 62% of respondents reported usually or always shortening a surveillance recommendation because of a suboptimal preparation. 10% of respondents reported shortening a surveillance recommendation because of a difficult procedure. While only 6% of respondents reporting usually or always shortening surveillance intervals based on patient preference, respondents in private practice were significantly more likely, than those in academic practice, to do so in multivariable analysis () (Table 6). Respondents in private practice were also more likely to shorten surveillance intervals based on malpractice concerns () as were the respondents with fewer years in practice () and lower colonoscopy volume (), although effect sizes were small. Surveillance patterns in response to adequacy of the colon prep varied only by sex, with 85.7% of females reporting usually or always shortening a surveillance recommendation based on inadequacy of the preparation as compared to 58.9% of men ().
In this national sample of gastroenterologists, we detected a number of noteworthy findings. For one, the majority of respondents do not yet receive feedback on the quality of their colonoscopy, even a decade after quality measures were first proposed . Nonetheless, the majority of respondents support the use of completion rate (90%) and adenoma detection rate (83%) for quality improvement. There was significantly less support for withdrawal time as a quality measure, perhaps in part related to the controversy regarding its clinical significance .
The slow dissemination and implementation of quality measurement in practice is not surprising given the experience in other fields . Our survey instrument did not specifically explore reasons for lack of feedback, but we speculate that a number of factors play an important role, including the uncertainty regarding the eventual use of these measures by external forces and the logistical and technical difficulties in collecting necessary data [34–36]. These challenges are not new to quality measurement  nor are they unique to gastroenterology . Nonetheless, they represent important issues to address in advancing the implementation of continuous quality improvement into gastroenterology practice. Indeed, practices that embrace quality measurement will be better positioned to demonstrate their value to payers and patients  and will assure they are providing the best care available to their patients .
Another notable finding from our survey is the acknowledgment of the part of practicing physicians of behavior change as a response to colonoscopy quality measures. For example, a minority of respondents acknowledged that they may prolong procedures to meet withdrawal time standards and remove diminutive polyps solely to increase their adenoma detection rate. The impact of these behaviors on patient outcome is unclear and underscores the difficulty in relying on process measures rather than outcomes for quality assessment .
Finally, survey respondents identified a number of factors that may lead them to shorten surveillance intervals compared to recommendations, including inadequacy of bowel preparation, malpractice concerns, difficulty of the procedure, and patient preferences. While other studies have extrapolated potential reasons for nonadherence with surveillance guidelines from physician survey data [21, 42], our analysis is unique in that it first identified potential factors from qualitative interviews and then quantified through the survey the extent to which those factors exist among physicians. Adequacy of preparation had the strongest impact and is a known factor affecting surveillance recommendations. Our results also confirm the speculation that physicians may sometimes shorten surveillance intervals because of concerns regarding malpractice; respondents in private practice and those with fewer years in practice were significantly more likely to do so when compared to their colleagues. Patient preference and the difficulty of the procedure also contributed to shortened surveillance intervals. While the contribution of each of these individual factors may be small, the collective impact may help explain some of observed “overuse” of surveillance colonoscopy [20, 43].
This study had some limitations. Most notable is the low participation rate (12.5%). Although this rate is lower than that we had anticipated in designing the survey, it falls within the range reported by other GI society-based surveys (9.5%–29%) [44–46]. Furthermore, nonresponse bias is a bigger threat to the validity of findings than a low response rate per se [47, 48]. In support of our findings, we found no evidence of such bias in our analysis. Another limitation is that we did not have sufficient numbers of nongastroenterology physicians in our survey population to make inferences regarding other physicians performing colonoscopy. Finally, despite the lack of detectable nonresponse bias, we cannot exclude selection bias if members of the American College of Gastroenterology systematically differ from nonmembers.
In summary, in a survey of practicing gastroenterologists, we found that a minority of physicians reported receiving feedback on the quality of their colonoscopy and that the majority of respondents support currently available colonoscopy quality process measures. In addition, we found evidence that quality metrics have led to changes in physician practice, both in academic and community settings. Studies assessing reasons for lack of performance feedback and the best mechanism for feedback will be helpful in identifying opportunities for interventions to increase the implementation of continuous quality improvement in practice.
The views expressed in this paper are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the United States government.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This study was funded by a Career Development Research Award from the American Society for Gastrointestinal Endoscopy to Dr. Gellad. This award also supported Dr. Voils. This material is the result of work supported by resources and the use of facilities at the Durham Veterans Affairs Medical Center.
- G. C. Harewood and D. A. Lieberman, “Colonoscopy practice patterns since introduction of medicare coverage for average-risk screening,” Clinical Gastroenterology and Hepatology, vol. 2, no. 1, pp. 72–77, 2004.
- D. A. Lieberman, J. Holub, G. Eisen, D. Kraemer, and C. D. Morris, “Utilization of colonoscopy in the United States: results from a national consortium,” Gastrointestinal Endoscopy, vol. 62, no. 6, pp. 875–883, 2005.
- L. C. Seeff, D. L. Manninen, F. B. Dong et al., “Is there endoscopic capacity to provide colorectal cancer screening to the unscreened population in the United States?” Gastroenterology, vol. 127, no. 6, pp. 1661–1669, 2004.
- A. P. Schenck, S. C. Peacock, C. N. Klabunde, P. Lapin, J. F. Coan, and M. L. Brown, “Trends in colorectal cancer test use in the medicare population, 1998–2005,” American Journal of Preventive Medicine, vol. 37, no. 1, pp. 1–7, 2009.
- N. N. Baxter, M. A. Goldwasser, L. F. Paszat, R. Saskin, D. R. Urbach, and L. Rabeneck, “Association of colonoscopy and death from colorectal cancer,” Annals of Internal Medicine, vol. 150, no. 1, pp. 1–8, 2009.
- C. J. Kahi, T. F. Imperiale, B. E. Juliar, and D. K. Rex, “Effect of screening colonoscopy on colorectal cancer incidence. Clin. Gastroenterol,” Clinical Gastroenterology and Hepatology, vol. 7, no. 7, pp. 770–775, 2009.
- H. Brenner, J. Chang-Claude, C. M. Seiler, A. Rickert, and M. Hoffmeister, “Protection from colorectal cancer after colonoscopy: a population-based, case-control study,” Annals of Internal Medicine, vol. 154, no. 1, pp. 22–30, 2011.
- N. N. Baxter, J. L. Warren, M. J. Barrett, et al., “Association between colonoscopy and colorectal cancer mortality in a US cohort according to site of cancer and colonoscopist specialty,” Journal of Clinical Oncology, vol. 30, no. 21, pp. 2664–2669, 2012.
- C. N. Manser, L. M. Bachmann, J. Brunner, F. Hunold, P. Bauerfeind, and U. A. Marbet, “Colonoscopy screening markedly reduces the occurrence of colon carcinomas and carcinoma-related death: a closed cohort study,” Gastrointestinal Endoscopy, vol. 76, no. 1, pp. 110–117, 2012.
- A. G. Zauber, S. J. Winawer, M. J. O'Brien et al., “Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths,” The New England Journal of Medicine, vol. 366, no. 8, pp. 687–696, 2012.
- B. Bressler, L. F. Paszat, Z. Chen, D. M. Rothwell, C. Vinden, and L. Rabeneck, “Rates of new or missed colorectal cancers after colonoscopy and their risk factors: a population-based analysis,” Gastroenterology, vol. 132, no. 1, pp. 96–102, 2007.
- T. F. Gorski, L. Rosen, R. Riether, J. Stasik, and I. Khubchandani, “Colorectal cancer after surveillance colonoscopy: false-negative examination or fast growth?” Diseases of the Colon and Rectum, vol. 42, no. 7, pp. 877–880, 1999.
- W. D. Farrar, M. S. Sawhney, D. B. Nelson, et al., “Colorectal cancers found after a complete colonoscopy,” Clinical Gastroenterology and Hepatology, vol. 4, no. 10, pp. 1259–1264, 2006.
- O. Hosokawa, S. Shirasaki, Y. Kaizaki, H. Hayashi, K. Douden, and M. Hattori, “Invasive colorectal cancer detected up to 3 years after a colonoscopy negative for cancer,” Endoscopy, vol. 35, no. 6, pp. 506–510, 2003.
- H. Brenner, M. Hoffmeister, V. Arndt, C. Stegmaier, L. Altenhofen, and U. Haug, “Protection from right-and left-sided colorectal neoplasms after colonoscopy: population-based study,” Journal of the National Cancer Institute, vol. 102, no. 2, pp. 89–95, 2010.
- H. Singh, Z. Nugent, A. A. Demers, E. V. Kliewer, S. M. Mahmud, and C. N. Bernstein, “The reduction in colorectal cancer mortality after colonoscopy varies by site of the cancer,” Gastroenterology, vol. 139, no. 4, pp. 1128–1137, 2010.
- L. Rabeneck, L. F. Paszat, and R. Saskin, “Endoscopist specialty is associated with incident colorectal cancer after a negative colonoscopy,” Clinical Gastroenterology and Hepatology, vol. 8, no. 3, pp. 275–279, 2010.
- H. Singh, Z. Nugent, A. A. Demers, and C. N. Bernstein, “Rate and predictors of early/missed colorectal cancers after colonoscopy in Manitoba: a population-based study,” American Journal of Gastroenterology, vol. 105, no. 12, pp. 2588–2596, 2010.
- N. N. Baxter, R. Sutradhar, S. S. Forbes, L. F. Paszat, R. Saskin, and L. Rabeneck, “Analysis of administrative data finds endoscopist quality measures associated with postcolonoscopy colorectal cancer,” Gastroenterology, vol. 140, no. 1, pp. 65–72, 2011.
- P. A. Mysliwiec, M. L. Brown, C. N. Klabunde, and D. F. Ransohoff, “Are physicians doing too much colonoscopy? A national survey of colorectal surveillance after polypectomy,” Annals of Internal Medicine, vol. 141, no. 4, pp. 264–271, 2004.
- S. D. Saini, R. S. Nayak, L. Kuhn, and P. Schoenfeld, “Why don't gastroenterologists follow colon polyp surveillance guidelines? Results of a national survey,” Journal of Clinical Gastroenterology, vol. 43, no. 6, pp. 554–558, 2009.
- R. L. Barclay, J. J. Vicari, A. S. Doughty, J. F. Johanson, and R. L. Greenlaw, “Colonoscopic withdrawal times and adenoma detection during screening colonoscopy,” The New England Journal of Medicine, vol. 355, no. 24, pp. 2533–2541, 2006.
- T. F. Imperiale, E. A. Glowinski, B. E. Juliar, F. Azzouz, and D. F. Ransohoff, “Variation in polyp detection rates at screening colonoscopy,” Gastrointestinal Endoscopy, vol. 69, no. 7, pp. 1288–1295, 2009.
- D. T. Simmons, G. C. Harewood, T. H. Baron et al., “Impact of endoscopist withdrawal speed on polyp yield: implications for optimal colonoscopy withdrawal time,” Alimentary Pharmacology and Therapeutics, vol. 24, no. 6, pp. 965–971, 2006.
- M. F. Kaminski, J. Regula, E. Kraszewska et al., “Quality indicators for colonoscopy and the risk of interval cancer,” The New England Journal of Medicine, vol. 362, no. 19, pp. 1795–1803, 2010.
- D. K. Rex, “Maximizing detection of adenomas and cancers during colonoscopy,” American Journal of Gastroenterology, vol. 101, no. 12, pp. 2866–2877, 2006.
- Department of Veterans Affairs: Strategic Plan Refresh FY 2011-2015.
- T. H. Lee, “Eulogy for a quality measure,” The New England Journal of Medicine, vol. 357, no. 12, pp. 1175–1177, 2007.
- Z. F. Gellad, C. I. Voils, L. Lin, et al., “Clinical practice variation in the management of diminutive colorectal polyps: results of a national survey of gastroenterologists,” The American Journal of Gastroenterology, vol. 108, no. 6, pp. 873–878, 2013.
- H.-F. Hsieh and S. E. Shannon, “Three approaches to qualitative content analysis,” Qualitative Health Research, vol. 15, no. 9, pp. 1277–1288, 2005.
- P. A. Harris, R. Taylor, R. Thielke, J. Payne, N. Gonzalez, and J. G. Conde, “Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support,” Journal of Biomedical Informatics, vol. 42, no. 2, pp. 377–381, 2009.
- G. B. Willis, Cognitive Interviewing: A Tool For Improving Questionnaire Design, SAGE, 2005.
- D. K. Rex, J. H. Bond, S. Winawer et al., “Quality in the technical performance of colonoscopy and the continuous quality improvement process for colonoscopy: recommendations of the U.S. Multi-Society Task Force on Colorectal Cancer,” American Journal of Gastroenterology, vol. 97, no. 6, pp. 1296–1308, 2002.
- S. D. Dorn, “Gastroenterology in a new rra of accountability: part 2. developing and implementing performance measures,” Clinical Gastroenterology and Hepatology, vol. 9, no. 8, pp. 660–664, 2011.
- M. D. Kappelman, S. D. Dorn, E. Peterson, T. Runge, and J. I. Allen, “Quality of care for gastrointestinal conditions: a primer for gastroenterologists,” American Journal of Gastroenterology, vol. 106, no. 7, pp. 1182–1187, 2011.
- D. Lieberman, “Quality in medicine: Raising the accountability bar,” Gastrointestinal Endoscopy, vol. 73, no. 3, pp. 561–566, 2011.
- E. A. McGlynn, “Six challenges in measuring the quality of health care,” Health Affairs, vol. 16, no. 3, pp. 7–21, 1997.
- A. M. Kilbourne, D. Keyser, and H. A. Pincus, “Challenges and opportunities in measuring the quality of mental health care,” Canadian Journal of Psychiatry, vol. 55, no. 9, pp. 549–557, 2010.
- P. Gabow, G. Halvorson, and G. Kaplan, “Marshaling leadership for high-value health care: an institute of medicine discussion paper,” Japan Automobile Manufacturers Association, vol. 308, no. 3, pp. 239–240, 2012.
- D. Lieberman, “A call to action—measuring the quality of colonoscopy,” The New England Journal of Medicine, vol. 355, no. 24, pp. 2588–2589, 2006.
- D. G. Hewett and D. K. Rex, “Improving colonoscopy quality through health-care payment reform,” American Journal of Gastroenterology, vol. 105, no. 9, pp. 1925–1933, 2010.
- T. U. Shah, C. I. Voils, R. McNeil, et al., “Understanding gastroenterologist adherence to polyp surveillance guidelines,” The American Journal of Gastroenterology, vol. 107, no. 9, pp. 1283–1287, 2012.
- J. S. Goodwin, A. Singh, N. Reddy, et al., “Overuse of screening colonoscopy in the medicare population,” Archives of Internal Medicine, vol. 171, no. 15, pp. 1335–1343, 2011.
- G. C. Hillyer, C. H. Basch, C. E. Basch et al., “Gastroenterologists' perceived barriers to optimal pre-colonoscopy bowel preparation: results of a national survey,” Journal of Cancer Education, vol. 27, pp. 526–532, 2012.
- A. Tinsley, S. Naymagon, A. J. Trindade, D. B. Sachar, B. E. Sands, and T. A. Ullman, “A survey of current practice of venous thromboembolism prophylaxis in hospitalized inflammatory bowel disease patients in the United States,” Journal of Clinical Gastroenterology, vol. 47, no. 1, pp. e1–e6, 2012.
- M. J. Whitson, C. A. Bodian, J. Aisenberg, and L. B. Cohen, “Is production pressure jeopardizing the quality of colonoscopy? A survey of U.S. endoscopists' practices and perceptions,” Gastrointestinal Endoscopy, vol. 75, no. 3, pp. 641–e8, 2012.
- T. P. Johnson and J. S. Wislar, “Response rates and nonresponse errors in surveys,” Journal of the American Medical Association, vol. 307, no. 17, pp. 1805–1806, 2012.
- J. Y. Ziegenfuss, N. D. Shah, J. Fan, et al., “Patient characteristics of provider survey respondents: no evidence of nonresponse bias,” Evaluation & the Health Professions, vol. 35, no. 4, pp. 507–516, 2012.