Machine Learning-Augmented Propensity Score-Adjusted Multilevel Mixed Effects Panel Analysis of Hands-On Cooking and Nutrition Education versus Traditional Curriculum for Medical Students as Preventive Cardiology: Multisite Cohort Study of 3,248 Trainees over 5 Years

Monlezun, Dominique J.; Dart, Lyn; Vanbeber, Anne; Smith-Barbaro, Peggy; Costilla, Vanessa; Samuel, Charlotte; Terregino, Carol A.; Abali, Emine Ercikan; Dollinger, Beth; Baumgartner, Nicole; Kramer, Nicholas; Seelochan, Alex; Taher, Sabira; Deutchman, Mark; Evans, Meredith; Ellis, Robert B.; Oyola, Sonia; Maker-Clark, Geeta; Dreibelbis, Tomi; Budnick, Isadore; Tran, David; DeValle, Nicole; Shepard, Rachel; Chow, Erika; Petrin, Christine; Razavi, Alexander; McGowan, Casey; Grant, Austin; Bird, Mackenzie; Carry, Connor; McGowan, Glynis; McCullough, Colleen; Berman, Casey M.; Dotson, Kerri; Niu, Tianhua; Sarris, Leah; Harlan, Timothy S.; Co-investigators, on behalf of the CHOP

doi:https://doi.org/10.1155/2018/5051289

BioMed Research International

On this page

Abstract Introduction Methods Results Discussion Conclusion Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2018 | Article ID 5051289 | https://doi.org/10.1155/2018/5051289

Machine Learning-Augmented Propensity Score-Adjusted Multilevel Mixed Effects Panel Analysis of Hands-On Cooking and Nutrition Education versus Traditional Curriculum for Medical Students as Preventive Cardiology: Multisite Cohort Study of 3,248 Trainees over 5 Years

Dominique J. Monlezun,^1,2Lyn Dart,³Anne Vanbeber,³Peggy Smith-Barbaro,⁴Vanessa Costilla,⁵Charlotte Samuel,⁵Carol A. Terregino,⁶Emine Ercikan Abali,⁶Beth Dollinger,⁷Nicole Baumgartner,⁷Nicholas Kramer,⁸and Alex Seelochan⁸ et al.

Academic Editor: Abdelaziz M. Thabet

Received15 Dec 2017

Accepted28 Feb 2018

Published15 Apr 2018

Abstract

Background. Cardiovascular disease (CVD) annually claims more lives and costs more dollars than any other disease globally amid widening health disparities, despite the known significant reductions in this burden by low cost dietary changes. The world’s first medical school-based teaching kitchen therefore launched CHOP-Medical Students as the largest known multisite cohort study of hands-on cooking and nutrition education versus traditional curriculum for medical students. Methods. This analysis provides a novel integration of artificial intelligence-based machine learning (ML) with causal inference statistics. 43 ML automated algorithms were tested, with the top performer compared to triply robust propensity score-adjusted multilevel mixed effects regression panel analysis of longitudinal data. Inverse-variance weighted fixed effects meta-analysis pooled the individual estimates for competencies. Results. 3,248 unique medical trainees met study criteria from 20 medical schools nationally from August 1, 2012, to June 26, 2017, generating 4,026 completed validated surveys. ML analysis produced similar results to the causal inference statistics based on root mean squared error and accuracy. Hands-on cooking and nutrition education compared to traditional medical school curriculum significantly improved student competencies (OR 2.14, 95% CI 2.00–2.28, ) and MedDiet adherence (OR 1.40, 95% CI 1.07–1.84, ), while reducing trainees’ soft drink consumption (OR 0.56, 95% CI 0.37–0.85, ). Overall improved competencies were demonstrated from the initial study site through the scale-up of the intervention to 10 sites nationally (). Discussion. This study provides the first machine learning-augmented causal inference analysis of a multisite cohort showing hands-on cooking and nutrition education for medical trainees improves their competencies counseling patients on nutrition, while improving students’ own diets. This study suggests that the public health and medical sectors can unite population health management and precision medicine for a sustainable model of next-generation health systems providing effective, equitable, accessible care beginning with reversing the CVD epidemic.

1. Introduction

The global leader among mortality causes is cardiovascular disease (CVD), claiming the lives of over 1 in 3 people annually throughout the world and nearly 1 in 5 dollars of the total United States health expenditures [1, 2]. This epidemic for both medical and public health sectors is only projected to increase, as CVD is expected to affect nearly half the population with at least double the cost by 2035 [3, 4]. Yet nearly 40% of CVD is attributed to modifiable social determinants of health including poor diet, exercise, and smoking which worsen endothelial function and arterial compliance [5]. These trends are further complicated by health disparities including racial and sexual [6]. Aside from the ethical toll, health disparities every year account for over 1 in 10 health expenditure dollars or $1.24 trillion every three years [7, 8].

Amid this backdrop, diet-driven improvements in such nutrition-related CVD risk factors as obesity, diabetes, and hypertension have been shown in a simulated trial with the Archimedes Model to reduce the collective risk of myocardial infarctions and stroke by 46% under real-world conditions [9]. The Mediterranean Diet (MedDiet) in particular has increasingly emerged in multiple systematic reviews and meta-analyses of randomized controlled trials (RCTs) and large cohorts as a clinically effective and low-cost intervention to improve CVD risk factors and also mortality [10–16]. However only 1 in 2 primary care physicians regularly educate their patients on nutrition [17], while over 7 out of 10 American medical school graduates report inadequate training in how to provide nutrition counseling for patients [18].

Not only nutrition, but more broadly medical education has failed to keep pace with some of the most fundamental shifts in medicine and public health to match global patient health needs particularly with CVD—there are no known medical education institutions actively training future physicians in the societal transition from the Information Age to the Age of Artificial Intelligence (AI) [19]. AI is rapidly transforming nearly every aspect of society in clinically relevant ways, including how patients’ outcomes are impacted by finances, education, infrastructure, politics, and ecology [20]. AI through machine learning (ML) self-learning algorithms are playing an increasingly pivotal role in precision medicine by accelerating the speed and accuracy of cost-effective health system interventions to improve population health from both the medical and public health sectors [21–23]. A recent demonstration of this potential is the collaboration between Mayo Clinic and UnitedHealth Group to create Optum Labs, allowing an unprecedented clinical and claims dataset of 150 million patients, compliant with the Health Insurance Portability and Accountability Act (HIPAA) [24]. By rapidly integrating -omics, clinical, and claims datasets, AI is advancing the synergistic role of precision medicine and population health to improve patient outcomes through improved diagnostics and treatments by clinicians, resource management by learning health system executives and policymakers, and ultimately more efficient and ethical outcomes generated for patient populations by the medical and public health sectors [19–25].

Driven by these larger trends, the Goldring Center for Culinary Medicine (GCCM) at Tulane University School of Medicine (GCCM) was created in 2012 as the world’s first known medical school-based teaching kitchen to reverse the CVD epidemic through sustainable, scalable culinary medicine programs. GCCM increasingly has incorporated ML to increase the speed and accuracy identifying at-risk patients in addition to optimal intervention, study design, and implementation aspects in culturally and socioeconomically diverse communities throughout America. By first training medical students in nutrition education through hands-on cooking classes in a lower-income former food desert-based grocery store complex, GCCM provides free cooking and nutrition classes to community members, taught by those students. The force multiplying effect of this two-part education model was intended to train a more well-equipped generation of physicians, while providing clinically efficacious, financially sustainable, culturally-sensitive cooking and nutrition classes throughout America’s health system particularly with the ultimate goal of reversing the CVD epidemic.

To establish the evidence-base foundation for this nutrition curriculum, GCCM through its collaboration network of 45+ medical schools, colleges, and hospitals launched Cooking for Health Optimization with Patients (CHOP). This study serves as the largest and longest-running known multisite cohort trial on hands-on cooking and nutrition education for medical students, in addition to the first known to incorporate causal inference traditional statistics augmented by ML. Previous attempts to test efficacy for similar interventions have been limited by no validated surveys tools [26–29], multisite design [28–32], long-term follow-up [26–28, 30–32], or adequately powered sample sizes [27–33]. CHOP therefore seeks to test causal inference if hands-on cooking and nutrition education compared to standard of training and care for medical trainees (through the cohort study) and patients (through nested Bayesian adaptive randomized trials), respectively, can improve trainee competencies in providing patients nutrition education and patient outcomes. The study reported here is a substudy within CHOP, CHOP-Medical Students, with the objectives of determining if hands-on cooking and nutrition education versus traditional education for medical students can have inferred causality to improve student competencies and attitudes about providing patients with nutrition education along with students’ own diet and if such a program could be scalable.

2. Methods

2.1. Study Design

Due to the logistical and ethical prohibitive challenges, a randomized controlled trial design was not implemented. Rather, CHOP-Medical Students features a prospective multisite cohort study design. Inclusion criteria were any medical student responder to the validated survey [34] sent electronically to the first 20 GCCM collaborating medical schools licensing the GCCM curriculum from August 1, 2012, to June 26, 2017, stretching from Oregon to Pennsylvania and Chicago to New Orleans. Exclusion criteria were any responder who completed more than one survey per survey cycle within each semester or failed to report number of GCCM classes received if any.

2.2. Control and Treatment

Control was the standard medical school curriculum, which was assumed to be adequately homogenous to allow comparison due to the common accreditation standards outlined by the United States Department of Education-recognized Liaison Committee on Medical Education, jointly sponsored by the American Medical Association (AMA) and the Association of American Medical Colleges (AAMC) [35]. Further, there is no evidence-based nutrition education widely provided within school curricula nationally, with the wide majority not meeting even the minimum nutrition hours outlined by the National Academy of Sciences (NAS) of 25 [36]. Treatment was the GCCM nutrition education curriculum, designed and implemented as a supplement to school curricula, annually updated based on the GCCM CHOP collaborating schools and latest literature [34]. The GCCM curriculum utilizes the active learning approach of hands-on cooking and nutrition education in medical school-based teaching kitchens, in contrast to solely utilizing the lecture or small group-based format of nutrition teaching in traditional medical school curriculum. This active approach, indicated in a recent meta-analysis to be superior to traditional clinical education [37], translates the latest evidence-based medical education model of simulation-based medical education with deliberate practice (SBME-DP) into training for patient nutrition counseling. To exceed the NAS minimum, the GCCM elective curriculum consists of 28 hours of instruction over 8 classes, each divided up by 0.5-hour preclass lecture videos, 1.5 hours of hands-on cooking, and 0.75-hour postclass problem-based learning (PBL) sessions as the trainees eat their prepared meals. These sessions serve to foster clinical application of the lecture material, constructed based on national board exam questions.

2.3. Study Endpoints

The primary endpoint was 20% increased odds of medical trainees achieving competency mastery educating patients on 25 nutrition topics selected based on the above literature and their clinical significance to improve patient outcomes (Figure 1, Table 1). The secondary endpoint was 10% increased odds of medical trainees’ high and medium versus low adherence to the MedDiet. These endpoints were selected based on the existing literature on medical student nutrition education [26–33] including the first phase of this trial [34] and the clinically significant threshold to pragmatically justify an educational intervention for trainees with the ultimate purpose of producing superior patient outcomes.

2.4. Data Source

The primary data source was the odd-number, Likert scale-based survey described above. Ethical standards required no coercion for survey completion including no threat of negative impact on student grades, and so it had to remain voluntary. Subsequently there was notable incomplete follow-up at the individual level and incomplete time to track all individuals joining the study rapidly from new collaborating sites from their first through fourth years of schooling. The MedDiet score utilized in the survey was adapted from the 9-point scale described in the seminal New England Journal of Medicine article by Trichopoulou et al. [14, 15].

2.5. Power Analysis

The required calculated sample size to achieve 80% power and detect an odds ratio (OR) of at least 1.50 with a two-sided test set at 5% was 263 cases.

2.6. Machine Learning and Statistical Analysis

The first phase of the analysis was conducted with ML within a supervised learning framework to test 43 algorithms with 10-fold cross-validation, selected based upon the data type. Algorithm performance was assessed favorably based on higher accuracy, lower root relative squared error (RRSE) with model acceptability set at 100% (for comparison among ML algorithms), and lower root mean squared error (RMSE, for comparison to traditional statistical models) [38]. Performance could be improved further if the relevant ML algorithms would be additionally permitted to select which variables should be included in the models. But to improve comparison to traditional statistical results, all the variables based on the above literature to be included in the statistical regression models were included first in the ML algorithms. The following algorithms by type were tested: Bayesian (Bayes Net, Naive Bayes, Naive Bayes Multinomial Text, and Naive Bayes Updateable), Functions (Logistic, Multilayer perceptron, SGD, SGD Text, Simple Logistic, SMO, and Voted Perceptron), Lazy (IBK, KStar, and LWL), Meta (AdaBoostM1, Attribute Selected Classifier, Bagging, Classification via Regression, CV Parameter Selection, Iterative Classifier Optimizer, Logit Boost, Multiclass Classifier, Multiclass Classifier Updateable, Multi-Scheme, Random Committee, Randomizable Filtered Classifier, Random Sub-Space, Stacking, Vote, and Weighted Instances Handler Wrapper), Miscellaneous (Input Mapped Classifier), Rules (Decision Table, JRip, OneR, Part, and ZeroR), and Trees (Decision Stump, Hoeffding Tree, J48, LMT, Random Forest, Random Tree, and REP Tree).

The second phase of analysis was conducted with traditional statistics using a novel integration of three statistical methods. Panel analysis of longitudinal data with triply robust propensity score (PS) adjusted multilevel mixed effects multivariable regression was conducted for causal inference. There is extensive, well-accepted statistical literature that causation can be inferred in observational trials without randomization through certain rigorous statistical methods, with fixed effects and propensity score being two of the most popular and well validated particularly with panel data [39–43].

Doubly robust estimation features a dual strategy of outcome regression that also accounts for the likelihood of receiving an exposure or treatment, such as with a PS [39, 44–46]. Simply using multivariable regression or PS analysis can lead to biased treatment estimates if either model is incorrectly specified. But with doubly robust estimation using both concurrently, only one model must be correctly specified to produce unbiased estimates. Of all the forms of PS analysis (i.e., matching, stratification, weighting, and adjustment), regression that includes the PS as one of the adjusted variables has quantitative evidence as being the top performing PS method [47]. Finally, mixed effects regression further provides a powerful approach to causal inference. This mixed method contains both fixed effects (FE) and random effects (RE) components [48], with FE having the distinct advantage of controlling even for nonobserved traits by controlling for all time-invariant traits [41, 42]. FE does this by setting each individual subject as his/her own control and thus models within-person effects. Aside from the theoretical advantages, FE has shown quantitative strengths over competing methods [49–51]. RE was used to control for what FE cannot, namely, time-varying traits at the individual level with repeated observations over time (as students progressed through their medical education). The multilevel aspect was used to account for the hierarchical nature of the data in which medical trainees responded from different medical institutions. Inverse-variance weighted fixed effects (IVWFE) meta-analysis was used to produce a composite estimate across the 25 competency topics [52].

This triply robust approach can be represented by the following mathematical formula:for independent clusters conditioned on random effects for clusters with cluster constituting observations, outcome , FE covariate , RE covariate , and regression coefficient , all within a logistic regression equation with logistic cumulative distribution function of [53]. The PS is utilized as an additional variable in the above model and is represented asin which exposure probability is conditioned on the covariate observed [54].

The competing causal inference methods of instrumental variable and difference in difference analyses were not utilized due to their methodological weaknesses, respectively, of having varying degrees of reliable instrumental variables and having a prevalence of unobserved confounders exerting time-varying effects before and after the exposure/treatment [55]. The above methods of doubly robust PS adjustment in multivariable regression were therefore integrated with multilevel mixed effects to provide a novel triply robust approach to causal inference. Aside from controlling for the likelihood of receiving GCCM education (via the PS) and unobserved time-invariant traits (via FE) and time variant along with intracluster correlation (via RE), this integrative method controlled via regression for age, gender, race, prior nutrition education, special diet, school year, intended specialty, and medical school. This multilevel approach has a Bernoulli conditional distribution of the response given the random effects and logistic cumulative distribution function for the success probability.

All results are reported as fully adjusted ORs. ORs rather than relative risks were calculated due to the complex data source described above and due to the rare disease assumption [56, 57]. Statistical significance was set at a two-tailed value < 0.05. ML analysis was performed in R 3.3.2 (The R Foundation for Statistical Computing, Vienna, Austria). Statistical analysis was performed in STATA 14.2 (STATACorp, College Station, Texas, United States of America). Ethics approval was obtained through the Institutional Review Board (IRB) of Tulane University.

3. Results

Across the 20 medical education institutions nationally, 3,248 unique medical trainees met study criteria and produced 4,026 completed surveys over the 5 years of the study period. The mean (standard deviation, SD) age was 25.71 years (SD 2.91), 548 (61.43%) were female, 202 (22.65%) had nutrition education prior to medical school, 207 (23.21%) adhered to a special diet, 270 (30.27%) were in their clinical years, and 225 (25.22%) intended to enter a primary care specialty.

ML logistic regression for the primary endpoint indicated that GCCM versus traditional curriculum significantly improved student mastery of 25 competency topics (OR 1.97, accuracy 89.39%, RRSE 97.33%, and RMSE 0.30). Model performance was mildly boosted by using the top performing algorithm across the 43 tested, namely, simple logistic (OR 3.23, accuracy 89.32%, RRSE 97.10%, and RMSE 0.30).

Statistical analysis produced similar results with IVWFE meta-analysis of the estimates produced by triply robust propensity score adjusted multilevel mixed effects multivariable regression panel analysis. GCCM versus traditional curriculum significantly improved student mastery (OR 2.14, 95% CI 2.00–2.28, , accuracy 89.39%, and RMSE = 0.30) (Figure 1, Table 1). Notably, GCCM significantly improved every competency topic individually as well, with the largest improvements being in educating patients on the MedDiet (OR 9.41, 95% CI 4.73–18.75, and ), low fat diet (OR 3.13, 95% CI 1.98–4.96, and ), and fiber (OR 3.06, 95% CI 2.23–4.19, and ), but also in nonnutrition areas including exercise (OR 1.72, 95% CI 1.34–2.21, and ). In the first year of GCCM versus control exposure (with only Tulane University included as a study site), there was no significant improvement. By the second year with the same study site participating in CHOP, GCCM versus control significantly improved overall competencies (OR 2.52, 95% CI 2.06–3.08, and ). Significance was retained with the scale-up of the intervention to 10 sites by Spring 2016 (OR 1.69, 95% CI 1.34–2.13, and ), with increased magnitude of the association by Spring 2017 when 20 total sites were included (OR 2.14, ).

GCCM versus traditional curriculum also significantly improved MedDiet high or medium versus low adherence (OR 1.40, 95% CI 1.07–1.84, and ) and strong belief that nutrition counseling should be routine clinical practice (OR 2.56, 95% CI 1.95–3.38, and ). GCCM also reduced by nearly half the odds of daily soft drink consumption (OR 0.56, 95% CI 0.37–0.85, and ).

4. Discussion

CHOP-Medical Students is the largest known machine learning (ML) and causal inference statistical-driven multisite cohort study of nutrition education intervention for medical students. It is also the first known to utilize an evidence-based hands-on cooking modality to train future physicians in how to counsel patients on nutrition while improving their own diets. This trial provides robust evidence of causal inference across 3,248 unique medical trainees from 20 medical schools throughout America over 5 years that Goldring Center for Culinary Medicine (GCCM) hands-on cooking and nutrition education compared to traditional medical school curriculum improves student competency educating patients on 25 nutrition topics, in addition to students’ own diet through increased Mediterranean Diet (MedDiet) adherence. The analysis features an innovative integration of artificial intelligence-based ML with advanced causal inference-based statistical methodologies that combines propensity score analysis with multilevel mixed effects regression within a longitudinal panel analysis, with both methods producing similar results. Additionally, the analysis suggests that this intervention is scalable and sustainable. Once the initial GCCM pilot program was optimized based on the latest research and student feedback after the first year, these significant improvements were first shown and then consistently shown despite scale-up of the program to 20 medical schools nationally with different cultures, resources, and infrastructures.

There are several important implications of these findings. First, these findings strongly suggest that the active teaching modality of hands-on cooking and nutrition education can significantly improve students’ readiness to improve patients’ health outcomes particularly for cardiovascular disease (CVD) through low-cost nutrition education. Second, these findings suggest that this intervention may add direct and indirect benefit to health systems, first by immediately improving patient outcomes through cooking classes taught by medical students and in the longer term by strengthening public health and medical sectors’ capacities to bridge population health management and precision medicine through future physicians equipped with culinary medicine competencies. Third, these results provide evidence improving not only the quality of care delivered to patients, but also the societal equity of health outcomes. Not every patient can afford coronary stents, for instance, but the vast majority can afford optimizing their diet through practical tips physician can support them in implementing.

Next, this study suggests that this intervention is scalable and sustainable operationally, but also analytically. These results suggest medical students can be trained through GCCM classes to subsequently counsel patients in hands-on cooking and nutrition classes led by the same students who previously went through those classes as a supplement to the students’ curriculum. Students and patients can benefit as the cost of such patient cooking classes can be kept low by students teaching the courses, financially backed by local health systems who could potentially benefit from having reduced costly hospital readmissions from the patients who would instead be better managed through their own optimized diets after the classes. Thus, by having results from well-established causal inference statistical analyses confirmed by the faster, automated ML algorithms, population health management and precision medicine can more accurately complement each other. Such ML algorithms can identify patient families most likely to benefit from the GCCM medical student-led cooking and nutrition classes, those classes can be provided to them, and the patients’ health outcomes are tracked as they diffuse through their social networks as increasingly robust and diverse data sources including epigenetic and genomic data can be integrated into further refining the predictive accuracy and utility of those ML algorithms.

GCCM’s larger CHOP cohort study is investigating the above implications currently through several Bayesian adaptive randomized trials. Phase I of the pilot randomized trial, CHOP-Diabetes, has previously shown that GCCM versus standard of care for patients with type 2 diabetes can significantly improve their diastolic blood pressure and total cholesterol, in addition to HbA1c (albeit nonstatistically significant for HbA1c in the smaller sample size of Phase I design) [58]. This trial suggested that lower-income residents from food desert communities had even greater benefit from the intervention than nonfood desert residents. Phase II trial of this study, CHOP-Family, has concluded study recruitment with forthcoming published results analyzing GCCM versus standard of care for parent-child pairs, while including a hospital readmission and cost effectiveness subanalysis. This analysis notably uses grocery store receipts not simply self-reported MedDiet consumption for improved study internal validity. If the target can be reached to improve family’s MedDiet adherence by 30%, as the above CHOP-Medical Student analysis indicated GCCM can improve student adherence odds by 40%, then this could have substantive clinical and financial implications. Estruch et al. in the PREDIMED trial have prior shown in The New England Journal of Medicine that MedDiet adherence can reduce the likelihood of myocardial infarction, stroke, and cardiovascular disease- (CVD-) related mortality by 30% [15]. As CHOP-Family scales up to the other sites of CHOP-Medical Students, the question remains to be answered about how much of these health outcomes can be achieved and sustained in the long term through the classes.

These CHOP substudies are part of the larger CHOP cohort with a target recruitment goal of 19,500 subjects in its four tracks working toward establishing the evidence-based standard in nutrition education for medical professional, trainees, and patients: CHOP-Medical Professionals, CHOP-Community, CHOP-Employee, and CHOP-RCT (including Diabetes and Family substudies). This study features the GCCM moderated open curriculum, improved annually through the GCCM Annual Summit gathering physicians, dietitians, chefs, public health researchers, medical school administrators, industry representatives, and trainees from 45+ collaborating sites. This elective curriculum spans medical school, residency, physician continuing medical education (CME) credits, and community and patient cooking classes. Amid this collaboration since the center’s founding in 2012 up to July 2017, GCCM has provided 53,674+ teaching hours to 4,051+ medical trainees/professionals and patients, including over 24,680 education hours to 444 medical students and 3,728 patients nationally.

5. Conclusion

CVD continues to be the most common and costliest mortality cause with the disease affecting nearly 1 in 2 patients, running up a bill of $555 billion annually [3]. Despite the well-accepted role of nutrition and other lifestyle interventions to reduce the incidence and disease impact on patients globally, physicians are ill equipped to respond to this growing global epidemic. As the incidence only is projected to increase with at least double the cost to $1.1 trillion over the next 20 years, American medical schools are faced with the growing need to train the next generation of physicians in evidence-based, equitable, scalable, clinical, and cost-effective interventions. This study, CHOP-Medical Students, provides the first known robust evidence of superior performance of a scalable nutrition education intervention for trainees, using a large, multisite prospective cohort, along with a novel integration of automated ML with causal inference statistics. Future studies are required to validate these findings internationally, in addition to concluding the ongoing nested Bayesian adaptive randomized trials within the larger CHOP cohort to determine clinical efficacy and cost effectiveness for patients when medical students teach their hands-on cooking and nutrition education classes. Such an interdisciplinary approach may accelerate the growing collaboration between the public health and medical sectors to bridge population health management and precision medicine to deliver the efficacious and equitable outcomes our patients deserve. The father of medicine, Hippocrates (460-370 B.C.), once asserted “let food be thy medicine and medicine be thy food” [59]. This study suggests that stretching into the future using our generation’s latest artificial intelligence-based analytics and statistical methodologies and lifestyle interventions, we may together be discovering the wisdom of the past in making medicine what our patients deserve for it to be.

Conflicts of Interest

The authors have no financial disclosures.

Acknowledgments

The authors would like to gratefully acknowledge the dedicated medical school, college, and hospital administrators, community members, medical professionals, and trainees who made this intervention possible to build healthier communities, together. Additionally, the authors are indebted to the remaining CHOP coinvestigators: Dr. Darrin D’Agostino, Dr. Keith Argenbright, Dr. Jaclyn Albin, Dr. Milette Siler, Dr. Dennis Muscato, Dr. Louise Muscato, Rachel Bross, Dr. Nadia Aibani, Dr. Holly Johnson, Dr. David Martins, Dr. Barbara Tangel, Dr. Alyse Van Lieu, Dr. Sheryl Harnas, Dr. Ann Andrada, Dr. Eugenia Edmonds, Dr. Jeremy Beer, Dr. Tisha Lunsford, Dr. Margaret Kim, Dr. Irma Hasham, Dr. Debra Stulberg, Dr. Katherine Palmer, Dr. Jennifer Boryk-Ratner, Dr. Tomi Dreilbelbis, Dr. Shannon Kelleher, Dr. Richard Streiffer, Dr. Jennifer Clam, Dr. Jeannine Lawrence, Dr. Linda Knol, Dr. Melanie Tucker, Dr. John Higginbotham, Dr. Joan Han, Dr. Chantis Mantilla, Dr. Patricia Griffin, Dr. Lindsey Grant, Dr. Caroline Compretta, Dr. Loretta Jackson, Dr. Rob Karch, Dr. Rosemarie Lorenzetti, Dr. Konrad Nau, Dr. Mike Finan, Dr. Connie Cooper, Dr. Laurie Macaulay, Dr. Elaine Chen, Dr. John Billimek, Dr. David Kilgore, Dr. Beverly Wilson, Dr. Suzanne Bertollo, Dr. Shreela Sharma, Dr. Laura Moore, Dr. Deanna Hoelscher, Dr. Lawrence Deyton, Dr. Seema Kakar, Dr. Chris D’Adamo, Dr. Deborah Cohen, Louise Merriman, Dr. Kristen Mathieson, Dr. Emily Rosenthal, Dr. Swana De Gisel, Dr. Roma Gianchandani, Dr. Brigid Gregg, Dr. Dianne Habash, Dr. Farzaneh, Dr. Lori Whelan, Jennifer Newton, Dr. Ashley Bunnard, Dr. Tanmeet Sethi, Dr. Ala Shaikhkhalil, Dr. Rebecca Mathews, Dr. Ann Langston, Dr. Carolyn Nichols, Dr. Sharon Moore, Dr. Lisa Hamilton, Dr. Laura Robertson-Boyd, Dr. Leanne Mauriello, Dr. Lora Boroff, Dr. Kate Swanic, Dr. Kelly Fackel, Dr. Jim Schoen, Dr. Josie Elrod, Dr. Rebecca Collins, Jill Gallin, Annie Sanford, Dr. Daniel Fry, Gina DeVito, Dr. Leonard, Walsh, Dr. Evan Siau, Dr. Glenn Mack, Dr. Joan Hendrix, and Dr. Jonathan Woodward.

References

I. I. Abubakar, T. Tillmann, and A. Banerjee, Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990-2013: a systematic analysis for the Global, Lancet, 2015.
D. Lloyd-Jones, R. J. Adams, T. M. Brown et al., “Heart disease and stroke statistics--2010 update: a report from the American Heart Association,” Circulation, vol. 121, no. 7, pp. e46–e215, 2010.
View at: Google Scholar
RTI International: “Cardiovascular disease: A costly burden for America. Projections through 2035.” American Heart Association , 2017.
P. A. Heidenreich, J. G. Trogdon, O. A. Khavjou et al., “Forecasting the future of cardiovascular disease in the United States: a policy statement from the American Heart Association,” Circulation, vol. 123, no. 8, pp. 933–944, 2011.
View at: Publisher Site | Google Scholar
A. V. Mattioli, P. Palmiero, O. Manfrini et al., “Mediterranean diet impact on cardiovascular diseases,” Journal of Cardiovascular Medicine, vol. 18, no. 12, pp. 925–935, 2017.
View at: Publisher Site | Google Scholar
L. R. Pool, H. Ning, D. M. Lloyd‐Jones, and N. B. Allen, “Trends in Racial/Ethnic Disparities in Cardiovascular Health Among US Adults From 1999–2012,” Journal of the American Heart Association, vol. 6, no. 9, p. e006027, 2017.
View at: Publisher Site | Google Scholar
Centers for Medicare and Medicaid Services, National health expenditure fact sheet, 2017.
T. Laveist, D. Gaskin, and P. Richard, “Estimating the economic burden of racial health inequalities in the United States,” International Journal of Health Services, vol. 41, no. 2, pp. 231–238, 2011.
View at: Publisher Site | Google Scholar
R. Kahn, R. M. Robertson, R. Smith, and D. Eddy, “The impact of prevention on reducing the burden of cardiovascular disease,” Diabetes Care, vol. 31, no. 8, pp. 1686–1696, 2008.
View at: Publisher Site | Google Scholar
T. B. Huedo-Medina, M. Garcia, J. D. Bihuniak, A. Kenny, and J. Kerstetter, “Methodologic quality of meta-analyses and systematic reviews on the Mediterranean diet and cardiovascular disease outcomes: A review,” American Journal of Clinical Nutrition, vol. 103, no. 3, pp. 841–850, 2016.
View at: Publisher Site | Google Scholar
E. Koloverou, K. Esposito, D. Giugliano, and D. Panagiotakos, “The effect of Mediterranean diet on the development of type 2 diabetes mellitus: a meta-analysis of 10 prospective studies and 136,846 participants,” Metabolism - Clinical and Experimental, vol. 63, no. 7, pp. 903–911, 2014.
View at: Publisher Site | Google Scholar
O. Ajala, P. English, and J. Pinkney, “Systematic review and meta-analysis of different dietary approaches to the management of type 2 diabetes1-3,” American Journal of Clinical Nutrition, vol. 97, no. 3, pp. 505–516, 2013.
View at: Publisher Site | Google Scholar
F. Sofi, F. Cesari, R. Abbate, G. F. Gensini, and A. Casini, “Adherence to Mediterranean diet and health status: meta-analysis,” British Medical Journal, vol. 337, article a1344, 2008.
View at: Publisher Site | Google Scholar
A. Trichopoulou, T. Costacou, C. Bamia, and D. Trichopoulos, “Adherence to a Mediterranean diet and survival in a Greek population,” The New England Journal of Medicine, vol. 348, no. 26, pp. 2599–2608, 2003.
View at: Publisher Site | Google Scholar
R. Estruch, E. Ros, J. Salas-Salvadó et al., “Primary prevention of cardiovascular disease with a Mediterranean diet,” The New England Journal of Medicine, vol. 368, no. 14, pp. 1279–1290, 2013.
View at: Publisher Site | Google Scholar
M. Fitó, M. Guxens, D. Corella et al., “Effect of a traditional Mediterranean diet on lipoprotein oxidation: A randomized controlled trial,” JAMA Internal Medicine, vol. 167, no. 11, pp. 1195–1203, 2007.
View at: Publisher Site | Google Scholar
A. W. Smith, L. A. Borowski, B. Liu et al., “U.S. primary care physicians' diet-, physical activity—, and weight-related care of adult patients,” American Journal of Preventive Medicine, vol. 41, no. 1, pp. 33–42, 2011.
View at: Publisher Site | Google Scholar
D. J. Frantz, S. A. McClave, R. T. Hurt, K. Miller, and R. G. Martindale, “Cross-sectional study of U.S. interns' perceptions of clinical nutrition education,” Journal of Parenteral and Enteral Nutrition, 2015.
View at: Publisher Site | Google Scholar
S. A. Wartman and C. D. Combs, “Medical Education Must Move from the Information Age to the Age of Artificial Intelligence,” Academic Medicine: Journal of the Association of American Medical Colleges, p. 1, 2018.
View at: Publisher Site | Google Scholar
IBM., Preparing for the future of artificial intelligence: IBM response to the White House Office of Science and Technology’s Policy Request for information, IBM, 2016.
J. H. Chen and S. M. Asch, “Machine learning and prediction in medicine-beyond the peak of inflated expectations,” The New England Journal of Medicine, vol. 376, no. 26, pp. 2507–2509, 2017.
View at: Publisher Site | Google Scholar
Z. Obermeyer and E. J. Emanuel, “Predicting the future-big data, machine learning, and clinical medicine,” The New England Journal of Medicine, vol. 375, no. 13, pp. 1216–1219, 2016.
View at: Publisher Site | Google Scholar
M. J. Khoury and S. Galea, “Will precision medicine improve population health?” Journal of the American Medical Association, vol. 316, no. 13, pp. 1357-1358, 2016.
View at: Publisher Site | Google Scholar
P. J. Wallace, N. D. Shah, T. Dennen, P. A. Bleicher, and W. H. Crown, “Optum labs: Building a novel node in the learning health care system,” Health Affairs, vol. 33, no. 7, pp. 1187–1194, 2014.
View at: Publisher Site | Google Scholar
L. Lessard, W. Michalowski, M. Fung-Kee-Fung, L. Jones, and A. Grudniewicz, “Architectural frameworks: Defining the structures for implementing learning health systems,” Implementation Science, vol. 12, no. 1, article no. 78, 2017.
View at: Publisher Site | Google Scholar
K. O. Lewis, G. R. Frank, R. Nagel et al., “Pediatric trainees' engagement in the online nutrition curriculum: preliminary results,” BMC Medical Education, vol. 14, no. 1, article 190, 2014.
View at: Publisher Site | Google Scholar
S. Ray, R. Udumyan, M. Rajput-Ray et al., “Evaluation of a novel nutrition education intervention for medical students from across England,” BMJ Open, vol. 2, Article ID e000417, 2012.
View at: Publisher Site | Google Scholar
A. Afaghi, A. A. H. A. Mohamadi, A. Ziaee, and R. Sarchami, “Effect of an integrated case-based nutrition curriculum on medical education at Qazvin University of Medical Sciences, Iran,” Global Journal of Health Science, vol. 4, no. 1, pp. 112–117, 2012.
View at: Google Scholar
P. Barss, M. Grivna, F. Al-Maskari, and G. Kershaw, “Strengthening public health medicine training for medical students: development and evaluation of a lifestyle curriculum,” Medical Teacher, vol. 30, no. 9-10, pp. e196–e218, 2008.
View at: Publisher Site | Google Scholar
S. Schlair, K. Hanley, C. Gillespie et al., “How medical students’ behaviors and attitudes affect the impact of a brief curriculum on nutrition counseling,” Journal of Nutrition Education and Behavior, vol. 44, no. 6, pp. 653–657, 2012.
View at: Publisher Site | Google Scholar
M. B. Conroy, H. K. Delichatsios, J. P. Hafler, and N. A. Rigotti, “Impact of a preventive medicine and nutrition curriculum for medical students,” American Journal of Preventive Medicine, vol. 27, no. 1, pp. 77–80, 2004.
View at: Publisher Site | Google Scholar
M. Kohlmeier, W. J. McConathy, K. Cooksey Lindell, and S. H. Zeisel, “Adapting the contents of computer-based instruction based on knowledge tests maintains effectiveness of nutrition education,” American Journal of Clinical Nutrition, vol. 77, no. 4, pp. 1025S–1027S, 2003.
View at: Publisher Site | Google Scholar
P. Lebensohn, B. Kligler, S. Dodds et al., “Integrative medicine in residency education: developing competency through online curriculum training,” Journal of Graduate Medical Education, vol. 4, no. 1, pp. 76–82, 2012.
View at: Publisher Site | Google Scholar
D. J. Monlezun, B. Leong, E. Joo, A. G. Birkhead, L. Sarris, and T. S. Harlan, “Novel longitudinal and propensity score matched analysis of hands-on cooking and nutrition education versus traditional clinical education among 627 medical students,” Advances in Preventive Medicine, vol. 2015, pp. 1–8, 2015.
View at: Publisher Site | Google Scholar
Liaison Committee on Medical Education: “Functions and structure of a medical school: Accreditation and the Liaison Committee on Medical Education: Standards for accreditation of medical education programs leading to the M.D. degree.” Association of American Medical Colleges , 2016.
K. M. Adams, M. Kohlmeier, and S. H. Zeisel, “Nutrition education in U.S. medical schools: latest update of a national survey,” Academic Medicine: Journal of the Association of American Medical Colleges, vol. 85, no. 9, pp. 1537–1542, 2010.
View at: Publisher Site | Google Scholar
W. C. McGaghie, S. B. Issenberg, E. R. Cohen, J. H. Barsuk, and D. B. Wayne, “Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence,” Academic Medicine: Journal of the Association of American Medical Colleges, vol. 86, no. 6, pp. 706–711, 2011.
View at: Publisher Site | Google Scholar
A. Garcia-Arce, F. Rico, and J. L. Zayas-Castro, “Comparison of Machine Learning Algorithms for the Prediction of Preventable Hospital Readmissions,” Journal for Healthcare Quality, p. 1, 2018.
View at: Publisher Site | Google Scholar
M. J. Funk, D. Westreich, C. Wiesen, T. Stürmer, M. A. Brookhart, and M. Davidian, “Doubly robust estimation of causal effects,” American Journal of Epidemiology, vol. 173, no. 7, pp. 761–767, 2011.
View at: Publisher Site | Google Scholar
A. Yazdani and E. Boerwinkle, “Causal Inference in the Age of Decision Medicine,” Journal of Data Mining in Genomics & Proteomics, vol. 06, no. 01, 2015.
View at: Publisher Site | Google Scholar
M. Shardell and L. Ferrucci, “Joint mixed-effects models for causal inference with longitudinal data,” Statistics in Medicine, vol. 37, no. 5, pp. 829–846, 2018.
View at: Publisher Site | Google Scholar
F. I. Gunasekara, K. Richardson, K. Carter, and T. Blakely, “Fixed effects analysis of repeated measures data,” International Journal of Epidemiology, vol. 43, no. 1, pp. 264–269, 2014.
View at: Publisher Site | Google Scholar
E. A. Stuart, “Matching methods for causal inference: A review and a look forward,” Statistical Science, vol. 25, no. 1, pp. 1–21, 2010.
View at: Publisher Site | Google Scholar
B. Koch, D. M. Vock, and J. Wolfson, “Covariate selection with group lasso and doubly robust estimation of causal effects,” Biometrics, 2017.
View at: Publisher Site | Google Scholar
A. Rotnitzky, J. M. Robins, and D. . Scharfstein, “Semiparametric regression for repeated outcomes with nonignorable nonresponse,” Journal of the American Statistical Association, vol. 93, no. 444, pp. 1321–1339, 1998.
View at: Publisher Site | Google Scholar | MathSciNet
D. B. Rubin and N. Thomas, “Combining propensity score matching with additional adjustments for prognostic covariates,” Journal of the American Statistical Association, vol. 95, no. 450, pp. 573–585, 2000.
View at: Publisher Site | Google Scholar
M. C. Elze, J. Gregson, U. Baber et al., “Comparison of Propensity Score Methods and Covariate Adjustment: Evaluation in 4 Cardiovascular Studies,” Journal of the American College of Cardiology, vol. 69, no. 3, pp. 345–357, 2017.
View at: Publisher Site | Google Scholar
G.M. Verbeke: “G., 2000. Linear Mixed Models for Longitudinal Data.” New YorkSpringer.
R. Chu, L. Thabane, J. Ma, A. Holbrook, E. Pullenayegum, and P. J. Devereaux, “Comparing methods to estimate treatment effects on a continuous outcome in multicentre randomized controlled trials: A simulation study,” BMC Medical Research Methodology, vol. 11, article no. 21, 2011.
View at: Publisher Site | Google Scholar
J. L. Dieleman and T. Templin, “Random-effects, fixed-effects and the within-between specification for clustered data in observational health studies: a simulation study,” PLoS ONE, vol. 9, no. 10, Article ID e110257, 2014.
View at: Publisher Site | Google Scholar
J. D. Y. Kang and J. L. Schafer, “Demystifying double robustness: A comparison of alternative strategies for estimating a population mean from incomplete data,” Statistical Science, vol. 22, no. 4, pp. 523–539, 2007.
View at: Publisher Site | Google Scholar
J. P. T. Higgins, S. G. Thompson, J. J. Deeks, and D. G. Altman, “Measuring inconsistency in meta-analyses,” British Medical Journal, vol. 327, no. 7414, pp. 557–560, 2003.
View at: Publisher Site | Google Scholar
L. P. StataCorp, Stata multilevel mixed-effects Reference manual, StataCorp LP, College Station, TX, 2013.
P. R. Rosenbaum and D. B. Rubin, “The central role of the propensity score in observational studies for causal effects,” Biometrika, vol. 70, no. 1, pp. 41–55, 1983.
View at: Publisher Site | Google Scholar | MathSciNet
A. J. Streeter, N. X. Lin, L. Crathorne et al., “Adjusting for unmeasured confounding in nonrandomized longitudinal studies: a methodological review,” Journal of Clinical Epidemiology, vol. 87, pp. 23–34, 2017.
View at: Publisher Site | Google Scholar
A. S. Robbins, S. Y. Chao, and V. P. Fonseca, “What's the relative risk? A method to directly estimate risk ratios in cohort studies of common outcomes,” Annals of Epidemiology, vol. 12, no. 7, pp. 452–454, 2002.
View at: Publisher Site | Google Scholar
S. Greenland, D. C. Thomas, and H. Morgenstern, “The rare-disease assumption revisited: A CRITIQUE of "estimators OF relative RISK for case-control studies",” American Journal of Epidemiology, vol. 124, no. 6, pp. 869–876, 1986.
View at: Publisher Site | Google Scholar
D. J. Monlezun, E. Kasprowicz, and K. W. Tosh, “Medical school-based teaching kitchen improves HbA1c, blood pressure, and cholesterol for patients with type 2 diabetes: results from a novel randomized controlled trial,” Diabetes Research and Clinical Practice, vol. 109, no. 2, pp. 420–426, 2015.
View at: Publisher Site | Google Scholar
R. Smith, ““Let food be thy medicine…”,” BMJ, vol. 328, no. 7433, p. 0, 2004.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2018 Dominique J. Monlezun et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

3684

Downloads

1815

Citations