The Next Frontier in Communication and the ECLIPPSE Study: Bridging the Linguistic Divide in Secure Messaging

Schillinger, Dean; McNamara, Danielle; Crossley, Scott; Lyles, Courtney; Moffet, Howard H.; Sarkar, Urmimala; Duran, Nicholas; Allen, Jill; Liu, Jennifer; Oryn, Danielle; Ratanawongsa, Neda; Karter, Andrew J.

doi:https://doi.org/10.1155/2017/1348242

Journal of Diabetes Research

On this page

Abstract Introduction Materials and Methods Discussion Conclusions Acknowledgments References Copyright Related Articles

Special Issue

mHealth and Health Information Technology Tools for Diverse Patients with Diabetes

View this Special Issue

Review Article | Open Access

Volume 2017 | Article ID 1348242 | https://doi.org/10.1155/2017/1348242

The Next Frontier in Communication and the ECLIPPSE Study: Bridging the Linguistic Divide in Secure Messaging

Dean Schillinger,¹Danielle McNamara,²Scott Crossley,³Courtney Lyles,¹Howard H. Moffet,⁴Urmimala Sarkar,¹Nicholas Duran,²Jill Allen,⁴Jennifer Liu,⁴Danielle Oryn,⁵Neda Ratanawongsa,¹and Andrew J. Karter⁴

Academic Editor: Raffaele Marfella

Received04 Aug 2016

Accepted12 Dec 2016

Published07 Feb 2017

Abstract

Health systems are heavily promoting patient portals. However, limited health literacy (HL) can restrict online communication via secure messaging (SM) because patients’ literacy skills must be sufficient to convey and comprehend content while clinicians must encourage and elicit communication from patients and match patients’ literacy level. This paper describes the Employing Computational Linguistics to Improve Patient-Provider Secure Email (ECLIPPSE) study, an interdisciplinary effort bringing together scientists in communication, computational linguistics, and health services to employ computational linguistic methods to (1) create a novel Linguistic Complexity Profile (LCP) to characterize communications of patients and clinicians and demonstrate its validity and (2) examine whether providers accommodate communication needs of patients with limited HL by tailoring their SM responses. We will study >5 million SMs generated by >150,000 ethnically diverse type 2 diabetes patients and >9000 clinicians from two settings: an integrated delivery system and a public (safety net) system. Finally, we will then create an LCP-based automated aid that delivers real-time feedback to clinicians to reduce the linguistic complexity of their SMs. This research will support health systems’ journeys to become health literate healthcare organizations and reduce HL-related disparities in diabetes care.

1. Introduction

“The single biggest problem in communication is the illusion that it has taken place.” George Bernard Shaw.

Health literacy (HL) refers to a patient’s capacity to obtain, process, communicate, and understand basic health information and services needed to make appropriate health decisions [1]. Limited HL can place individuals at greater risk of type 2 diabetes (DM2) and its complications, making limited HL a critical clinical and public health problem [2, 3]. Suboptimal communication exchange, and resultant problems with medication adherence, is a mediator between limited HL and DM2 outcomes. However, effective communication between patients and providers can mitigate the impact of limited HL. Online patient portals that support asynchronous, between-visit electronic communications (secure messages [SM]) are heavily promoted by health systems and patient uptake is high [4, 5]. Secure messaging (SM) represents a “disruptive” innovation that is rapidly expanding (~5–10%/year) in systems such as Kaiser Permanente (KP), thereby complementing, and at times, supplanting, or stimulating in person/visit-based communication. Enabling patients with DM2 to easily access their medical information is a novel approach to facilitate patient engagement and activation; empowering patients in this fashion improves disease knowledge, enhances patient-provider communication, and increases adherence to treatment [6]. While research demonstrates that patients who access portals are more likely to have favorable healthcare utilization patterns, adhere to prescribed regimens, and achieve better outcomes, minority status, low levels of income, limited HL, and older age are all associated with lower portal usage. In addition, patients specifically require a certain degree of linguistic facility to take advantage of SM as a means of communication, and patients with limited HL may have difficulty messaging their provider or understanding the provider’s replies or instructions. Providers too must engage with patients in a manner that provides meaningful and actionable information and support in an easily comprehended style that promotes shared meaning.

Secure messaging has been shown to be particularly relevant for patients with DM2, given their need for relatively frequent communication between outpatient encounters. No studies have examined how DM2 patients with limited HL and their providers interact via SM. In the Employing Computational Linguistics to Improve Patient-Provider Secure Email (ECLIPPSE) study, funded by National Library of Medicine, we examine to what extent clinicians accommodate the communication needs of their DM2 patients with limited HL. The IOM recently advocated that health systems and clinicians must accommodate the communication needs of patients with limited HL to overcome the challenges facing this clinical vulnerable population. The degree to which providers adjust linguistic complexity in their SM exchanges to “match” the level observed in their patients will serve as one indicator of the extent to which providers are, or are not, making such accommodations.

This study integrates 3 conceptual frameworks and theories to assess the effect of LCP discordance in SM on a range of DM2 outcomes. The Conceptual Framework (Figure 1) integrates 3 complementary research and operational paradigms: (1) communication in Chronic Illness Care Framework of Schillinger [7], (2) Information-Motivation-Behavior Model (IMB) of DM2 medication adherence [2], and (3) IOM attributes of “health literate healthcare organizations.” [8] Our framework revolves around achieving provider-patient concordance and shared meaning across 4 domains involving elicitation-type communication and explanatory-type communication. Communication concordance can improve chronic disease outcomes [9, 10]. We will examine whether patient LCP is associated with medication adherence, HbA1c, hypoglycemia, or long-term outcomes. We augmented this framework with the IMB Model of DM2 medication adherence [11]. IMB elements explain >40% of variance in adherence and predict glycemic control, even in low SES populations [2]. Interventions that target IMB have been successful in previous studies [12]. In IMB, adherence is determined by the extent individuals are informed about their regimen, motivated to adhere, and possess or are provided with skills. All 3 domains of IMB are sensitive to interactive patient-provider communication, making them appropriate targets for discussions of barriers to adherence (Figure 1, Box ) or treatment (Figure 1, Box ). In 2012, the Institute of Medicine commissioned a White Paper to define attributes of “health literate healthcare organizations” [8]. This paper served as a national call to shift focus from HL skills of individuals toward HL-promoting actions of organizations, including providers. Five of 10 attributes bear relevance to this proposal: (1) meeting needs of populations with a range of HL; (2) using HL strategies in interpersonal communications and confirming understanding; (3) providing easy access to health information/services; (4) designing and distributing content that is easy to understand and act on; and (5) preparing workforce to be health literate [8]. Many providers are unprepared for communicating with patients with limited HL [4] and lack tools to improve communication-sensitive outcomes. A goal of this proposal is to create an automated communication aid prototype, based on provider LCPs, that delivers feedback to providers to reduce linguistic complexity of SMs. Implementation of this tool could advance an organizations’ journey to become more health literate.

2. Materials and Methods

Our study involves 2 settings. The first, Kaiser Permanente Northern California (KPNC), is a nonprofit, fully integrated healthcare delivery system, providing services through 37 outpatient centers and ~3,300 providers to 3.3 million plan members, in a 14-county region of Northern California. Except for extremes of income, sociodemographic characteristics of KP members are representative of the local population [13]. KP provides care to a population insured through employer-based plans, Medicare, Medicaid, and new health insurance exchanges. Thus, our study findings should be widely generalizable outside of KP. KP has a very well-developed, mature patient portal, kp.org, used by KP members to SM their healthcare team. KP maintains integrated administrative and clinical databases (pharmacy, lab, diagnoses and procedures, clinical notes, SMs, utilization, and cost) linked to individual members. Part of our sample will be drawn from the KP DM2 Registry (9,027 between 1/06 and 6/14). Descriptions of the Registry have been published previously [14–17]. Nested within KP DM2 Registry are ~11,000 DM2 patients from the well-characterized DISTANCE cohort [18], for whom we have measures of self-reported HL [19], patient reports of provider’s communication quality, and a broad array of sociobehavioral and psychological measures obtained in 2006 [20]. Nearly 40% of DISTANCE respondents had limited HL, and the cohort is diverse (19% Hispanic, 17% African American, 23% Asian/Pacific Islander, 23% White/non-Hispanic, and 18% Multiracial). To achieve some of the aims of ECLIPPSE, we will use data from KP’s patient portal, which includes SM capabilities. The second site, The San Francisco Health Network (SFHN), is a public delivery system that includes the following: 13 primary care centers and specialty and inpatient services at SF General Hospital and provides >1.5 million visits and 24-hour care to ~120,000 low income patients annually. SFHN patients are insured by Medicaid (39%), Medicare (28%), and commercial health insurance (2%) or are of no insurance (32%, a number falling due to ACA). The population is 30% Hispanic, 20% African American, 32% Asian/Pacific Islander, 13% White/non-Hispanic, 3% Native American, and 2% Multiracial. SFHN cares for 8,105 DM2 patients who have seen their primary provider () >once in the prior year; ~50% have limited HL [21–26]. In 2013, 42% of SFHN DM2 patients had HbA1c >8% (versus 32% in KP). The SF Department of Public Health created The Hospital Record Electronic Data Set (THREDS) that contains demographics, pharmacy, lab, diagnoses, and utilization. In 10/14, SFHN’s EHR added a self-reported HL measure: “how confident are you filling out medical forms by yourself?” [27]. SFHN launched mySFHealth patient portal [28] in 10/14, which includes SM functionality in 2015. We anticipate that >10% of DM2 patients from SFHN will engage in SM by 2016, 20% in 2017, 30% by 2018, and 35% by 2019 (,837,225 providers) [29].

Our study includes 3 aims. The first aim is to develop and validate a novel, automated Linguistic Complexity Profile (LCP) to assess secure message content generated by English-speaking DM2 patients and their providers. We will employ natural language processing (NLP) indices to develop and validate the LCP, based on >5 million SM and covariate data from >150,000 ethnically diverse, DM2 patients receiving care in 2 integrated health systems: a large, integrated, healthcare delivery system with a mature patient portal (Kaiser Permanente Northern California, KPNC) and a county-run, integrated, public (safety net) delivery system with a newly launched patient portal (San Francisco Hospital Network, SFHN). We will first aggregate our selected automated linguistic indices into larger components using a principal component analysis [30, 31]. A PCA examines cooccurrence patterns among the selected linguistic indices and, using these cooccurrence patterns, we will develop larger component scores related to linguistic complexity. We will use these component scores in machine learning algorithms to patients’ self-reported HL when applied to SMs from ~12,000 patient SMs. We will also use the component scores to predict 9,535 DM2 patients’ ratings of physicians’ communication from 950 providers. These analyses will provide construct validity for the component scores and be used as the foundation of the LCP. We will then use the LCP models derived from the patient’s self-reported HL and ratings of physicians’ communications to determine, among >150,000 DM2 patients, whether patient LCP is associated with HbA1c, adherence for cardiometabolic medications, DM2 complications, hypoglycemia, and utilization of services.

We hypothesize that (1) patients’ and their providers’ LCP will demonstrate construct validity based on patients’ HL level and reports of provider communication (using the AHRQ Consumer Assessment of Healthcare Providers & Systems score, CAHPS), respectively; and (2) patient LCP will correlate with clinically relevant outcomes, for example, med adherence, HbA1c, hypoglycemia, and utilization of services. Patients’ HL level will be based on a previously validated instrument [19, 32] This item has test characteristics similar to the cumulative 3-item scale and is validated against in person, interview-based tools, such as REALM and TOFHLA (areas under ROC: 0.70–0,82) [19, 27]. We have shown its predictive value for DM2 outcomes in DISTANCE [27, 33]. We will use the CAHPS instrument to assess provider communication skills. Provider LCP will be assessed for construct validity against items from the patient-reported, provider communication subscale (over 12 months, how often their provider listens carefully to them; explains things in a way they could understand; spends enough time with them; and involves them in making decisions about care) from the CAHPS survey [34] in DISTANCE. We will calculate a summary CAHPS score [35] (range, 0–100) by linearly transforming and averaging responses (Cronbach in DISTANCE = 0.80) [20]. We will only measure provider LCP during the period the patient reported CAHPS. We hypothesize that higher CAHPS will correlate negatively with LCP of providers’ SMs. CAHPS data were captured by a previous survey conducted by the Diabetes Study of Northern California (DISTANCE) [18].

The second aim is to examine whether concordance between providers’ and patient’s LCP is associated with better adherence among DM2 patients newly prescribed insulin or an antidepressant, excluding patients with pharmacy dispensing in prior 2 years. We have previously shown that limited HL predicts poor adherence to communication-sensitive medications, for example, insulin and antidepressants in DM2 [33, 36]. Based on prior analyses, we estimate ~52,000 patients in KP Registry will have started insulin and ~28,000 antidepressants (selective serotonin reuptake inhibitor or serotonin norepinephrine reuptake inhibitor, mirtazapine or bupropion) during our study period [33]. We hypothesize that greater degrees of patient-provider concordance LCP in the period surrounding the start of insulin or antidepressant will be associated with better adherence to these newly prescribed medications. Our outcome measure will combine primary nonadherence (never filling Rx) and early nonpersistence (never refilling Rx). These standard adherence measures are obtained via pharmacy claims 6 months after initiation [20, 33, 37]. The third aim is to create an automated, LCP-based prototype to deliver automated feedback to providers to reduce their SM linguistic complexity and enhance shared meaning. After developing the prototype, we will enlist 42 providers to evaluate whether the prototype improves LCP concordance using a series of in vitro experiments with simulated, standardized clinical scenarios. We evaluate whether it improves LCP concordance for DM2 providers via 3-arm randomized controlled trial (RCT) design. Formative feedback must be timely, impersonal, suggestive, digestible, and not interrupting workflow [38]. Providers will be given automated feedback on SMs as they draft them. Issues flagged will be related to the SM (not the individual provider) and to potential (not definitive) problems. Feedback content will be developed and piloted with the team’s primary care physicians to ensure it is impersonal, suggestive, digestible, and actionable. Arm 1 (active control feedback) will receive automated linguistic feedback based on NLP algorithm related to socioemotional tone, rapport building, and degree of empathy and support. Support was selected as an active control because (a) it has face validity with providers, (b) we expect a high proportion to receive feedback [39], and (c) there is no evidence that increasing socioemotional content of SMs affects linguistic complexity [40, 41]. Arm 2 (Flesch-Kincaid feedback) will receive automated linguistic feedback based on Flesch-Kincaid’s algorithm [42], selected as a comparison because (a) it is ubiquitous and recognizable, (b) it generates grade level of text, which has face validity with providers, and (c) our pilot work suggests providers rarely generate SMs at <6th grade level; therefore, we expect a high proportion will receive feedback. In Arm 3 (LCP-based feedback), the LCP developed in Aims 1 and 2 will provide algorithms that assess complexity of patient and provider SMs. Algorithms will be translated to linguistic feedback to guide providers to generate more concordant SMs. The nature of feedback will allow for more granular, specific, and tailored feedback than Flesch-Kincaid, which we hypothesize will more likely lead to linguistically concordant SMs. We hypothesize that this automated communication aid deployed in clinical simulations can reduce provider’s linguistic complexity to better accommodate DM2 patients’ linguistic skills and HL.

3. Preliminary Results

Our preliminary research suggests that patients who access portals, albeit not necessary using SM, are more likely to have better (a) healthcare utilization [43], (b) prescription adherence [37], and (c) glycemic control [44, 45]. Among DM2 patients, better ratings of physician communication are associated with greater SM usage [46]. While we found that limited HL posed a barrier to portal and SM use [29], disparities have rapidly narrowed. In 2014, 68% versus 84% of Kaiser Permanente DM2 patients with limited versus adequate HL, respectively, accessed the portal. Overall, 46% used SM in 2014, compared to 30% in 2009. Those with limited HL are rapidly gaining ground, with a 65% increase in 5 years, compared to a 41% increase for adequate HL (20%–>33% for low HL versus 39%–>55%, with greatest gains among Latinos and African Americans) (unpublished data, 2014).

Our research further shows that SMs serve as a critical mode of communication of clinically relevant matter in DM2. Among a sample of DM2 subjects ( = 9,535), a mean of 19 SMs involving a mean of 8 SM threads (closed communication loops) were generated annually. While prevalence of SM use in this sample increased 53% (30 to 46%) from 2009 to 2014, the number of outpatient visits in SM users went down 4% (from 13.2 to 12.7 total visits per year) during the same timeframe. A SFHN study just before launch of their portal revealed 60% of safety net patients used email, 71% were interested in SM, and 19% currently use email with providers [47]. For SFHN, pilot work with 22 patients who engaged in email with providers in 2013 revealed a mean of 5 SMs, yielding a projection of ~15,000 SMs by 2019, assuming 35% uptake of SM among DM2 patients [48]. The KPMC DM2 Registry cohort who sent ≥1 SM to DM2 providers from 2006 to 2014 ( = 151,804) generated >1.5 million SMs in 2013 alone. We also calculated the number of patients from the KPNC Registry who initiated insulin or antidepressants from 2006 to 2010 and the proportion with SMs 3 months before and 3 months after initiation. We found that 37,628 patients (~25%) had insulin initiated in this timeframe: 7,264 (~20%) had SMs in the 3 months before, 9,231 (~25%) after, and 5,720 (~15%) before and after. For antidepressants, 20,440 DM2 patients (~13%) initiated in that timeframe. Of these, 16% had SM exchanges 3 months before, 20% after, and ~12% both before and after.

To further understand SM communication, we conducted a pilot examination of SM content among 50 ethnically diverse DISTANCE respondents. Major themes included the following: provision/explanation of lab/diagnostic tests; requests for/discussion of medications and side effects; requests for follow-up appointments and discussions about specialty visits; reports of symptoms/self-care; and preventive care and DM2 guideline-related reminders. In parallel, we carried out a study of email exchanges between 22 SFHN patients and their primary care physicians in 2013. The most common patient requests were the following: action regarding medication or treatment; lab tests, x-rays, and other studies; referral requests; information regarding symptoms, tests, or procedures; and information regarding medications, side effects, or treatments. Patients requested action in 77% of threads. The most common requests were for a prescription (22%), appointment (21%), clarification (16%), medical guidance (14%), and paperwork (13%), resulting in 62 physician actions. We found that SM content was highly relevant to DM2 patients’ clinical care in both health systems [48]. We also identified high degrees of clinical jargon use in clinicians’ SMs [49].

Qualitative analyses such as those reported above are time and resource intensive. To address these issues, we have shown that NLP tools involving automatic extraction of linguistic features using computer programming can supplant human ratings to a degree. NLP provides information about language at multiple levels and dimensions [50, 51] and affords the ability to glean just about any aspect of text, language, or discourse. Many NLP techniques are specialized, providing information about different aspects of language. A distinctive aspect of this study is that we will incorporate indices from a variety of tools to paint a rich picture of language, discourse, and communication patterns. We will also develop new NLP techniques for our data. We will use Coh-Metrix [50, 52], NLP tool developed by our team, which integrates various NLP indices, including pattern classifiers, part-of-speech taggers [53], syntactic parsers [54], and Latent Semantic Analysis [55]. This is the most commonly used tool to measure linguistic complexity on a broad profile of language [41, 56]. Other NLP tools developed by our team will augment our analyses. The Writing Assessment Tool (WAT) [57, 58] provides computational indices related to writing quality: global cohesion, contextual cohesion, rhetorical strategies, and -gram (contiguous sequence of items from a sequence of text or speech) accuracy. The Tool for the Automatic Analysis of Lexical Sophistication (TAALES) [59] examines text features specific to sophistication of word use: lexical frequency and range, academic words, concreteness, and meaningfulness. The Tool for Automatic Assessment of Cohesion (TAACO) [60] provides additional indices related to text cohesion including word, lemma (mental abstraction of a word to be uttered or written), argument, and synonym overlap between sentences and paragraphs. The Sentiment Analysis and Cognition Engine (SEANCE) provides an overview of a text’s affective, cognitive, and social features.

We have used NLP tools to assess linguistic complexity to estimate text comprehensibility. Cohesion, a construct central to Coh-Metrix and TAACO, is the degree that relations between concepts are explicit in text by using cues such as word overlap and connectives. High cohesion text enhances reading comprehension, particularly for less skilled readers with less knowledge. Coh-Metrix indices related to text cohesion, lexical sophistication, and syntactic complexity have been used to develop readability measures [50, 61–63]. In contrast, a popular index of readability, Flesch-Kincaid’s formula, estimates ease of readability of text by deriving ratios among only 3 linguistic units: numbers of syllables, words, and sentences. NLP indices found in tools such as Coh-Metrix demonstrate significant improvements in predicting readability compared to indices such as Flesch-Kincaid [64] and provide better theoretical overlap with cognitive models of text processing and comprehension [62]. Previous studies have reported that Coh-Metrix indices also perform better than traditional readability formulas in distinguishing among texts simplified to beginning, intermediate, and advanced reading levels [63]. Coh-Metrix, WAT, TAALES, and TAACO also predict quality of writing using linguistic indices related to lexical sophistication, syntactic complexity, and cohesion [57–59, 63, 65–67]. Measures of linguistic complexity and individual differences can also be used to examine links between writing skills and reading comprehension [68]. We have investigated relationships between latent factors underlying writing development and found correlations as high as between writing quality and reading comprehension [69]. Collectively, these studies demonstrate that linguistic features can be used to examine text complexity, readability, comprehensibility, and links between reading comprehension and writing skills.

In a pilot study, we assessed feasibility of using automated NLP queries to examine SM content in a stratified random sample of DM2 subjects. We were able to efficiently and reliably capture and distinguish provider SMs, patient SMs, and system-generated messages. These preliminary analyses used indices from TAALES and TAACO to examine the potential of developing LCPs from SMs. We examined 402 SMs generated by 13 providers and 51 English-speaking DM2 patients, stratified into 25 low and 26 high HL. We were able to assess provider-patient communication differences in SMs using a number of linguistic features. Preliminary findings were promising. Indices related to word frequency and entropy (i.e., number of documents or contexts in which a word occurs) distinguished SMs by low versus high HL patients, with high HL patients using more infrequent (less familiar) and more specific words that occur in fewer contexts (). Providers used more complex linguistic features than patients, producing more rare words (e.g., jargon), specific words, words with fewer associations to other concepts, and less semantic overlap between paragraphs (). Providers judged by patients to be less communicative on CAHPS used more infrequent (unfamiliar) words and word sequences. This preliminary work suggests that (a) providers’ use of complex linguistic features better correlated to high than low HL patients (i.e., providers and low HL patients demonstrated discordance in language use, ) and (b) providers modify linguistic output based on patient HL, using more familiar words with low HL patients than high HL patients (), although the gap between providers and adequate HL patients remained large. The findings suggested the feasibility of developing patient LCPs to assess construct and predictive validity with respect to DM2 outcomes, analyzing complexity of providers’ SMs, and using LCP to provide feedback to providers.

4. Discussion

Most clinicians are untrained in communicating with DM2 patients with limited HL, and health systems have no feasible means to identify patients with limited HL or those clinicians who need support in communicating effectively [4]. The Linguistic Complexity Profile (LCP) presented in this project represents methodological and measurement research focused on HL of individual providers and health systems that can facilitate comparisons across ethnicity and health system settings. Studying whether LCP gaps between provider and patient influence medication adherence reflects basic research into how HL impacts health processes and outcomes. Our communication aid based on LCP represents applied research addressing issues pertinent to HL.

Limited HL places individuals at risk of DM2 and its complications, making it a critical public health problem [2, 3]. In many settings, limited HL, as well as numeracy, has been associated with higher prevalence of DM2, poor glycemic control [21, 70], DM2 complications [21, 71], hypoglycemia [29], and poorer medication adherence [33, 72]. Inadequate health communication is a mediator of the relationship between limited HL and DM2 outcomes [7]. Provider communication shortcomings limit the effectiveness of DM2 self-management interventions, especially for patients with limited HL [9, 23]. DM2 providers often are poorly prepared to communicate with patients with limited HL [4, 5]. Secure messaging (SM) represents a “disruptive” innovation that is rapidly expanding (~5–10%/year) in systems such as KPNC, thereby complementing, and at times, supplanting, or stimulating [73–75] in person/visit-based communication. SM is especially important for patients with DM2, who use SM for critical self-management functions, use portals more often than healthier patients [76], and often have competing priorities during in person visits, creating greater communication needs between visits [75]. CMS has promoted meaningful use of electronic health records (EHRs) via substantial incentives (>$25 billion to date) for clinicians and systems that implement EHRs, encouraging patients to engage in EHR [77]. To receive incentives, systems must demonstrate that significant proportions of patients register for the EHR and exchange SMs with providers. While this program has stimulated uptake of SM in the private sector and has established SM as a new standard of care in the US, SM is now enjoying uptake in safety net and public healthcare systems which disproportionately care for patients with limited HL. However, there is very limited understanding of the impact of SM use across HL levels. Additionally we are unaware of intervention work to enhance the effectiveness of clinician SM use with DM2 patients with limited HL. We do know that ratings of physicians’ communication are associated with DM2 medication adherence [20] and that medication adherence is an important target for health communications and HL research. Poor adherence in DM2 is common and associated with higher costs and worse outcomes [2]. Limited HL predicts poor adherence to communication-sensitive medications, for example, insulin and antidepressants in DM2 [33, 36, 78]. To take full advantage of patient portals, patients must have the linguistic competencies to convey and comprehend clinical content from providers. Providers’ must encourage and elicit patient communication and must match or approximate patients’ linguistic complexity levels to enhance SM effectiveness (“linguistic complexity concordance”). These problems underlie the need to develop and test the LCP described in this paper. The ECLIPPSE Study will be the first systematic study of SM between DM2 patients and their clinicians and, to our knowledge, is the first study to employ computational linguistics to analyze and improve digital patient-provider communications.

5. Conclusions

This research has the potential to achieve important gains in the effort to translate both diabetes and HL research into meaningful action. First, measuring individual HL in healthcare populations is widely recognized to be a daunting and time-consuming undertaking, making it infeasible and cost-prohibitive to carry out. If the patient LCP proves to be a valid indicator of individual HL and is predictive of health outcomes in DM2, then health systems will have an efficient, automatic method to harness “big data” in order to identify patients with limited HL and that may benefit from outreach and additional self-management support. In addition, if patient-clinician discordance in LCP is found to be prevalent and is associated with suboptimal communication-sensitive outcomes, such as medication nonadherence or hypoglycemia, then health systems can target communication training efforts for those clinicians. Finally, if ECLIPPSE’s LCP-based prototype communication aids to provide real-time feedback to clinicians is found to be both feasible for clinicians and effective in increasing the degree of linguistic matching, then clinicians will be much better equipped to promote shared meaning in their communications with vulnerable patients. Insofar as electronic patient portals are being heavily promoted by health systems and becoming the standard of care, and insofar as patients who access them appear more likely to achieve better outcomes, the research products of ECLIPPSE will undoubtedly support health systems’ journeys to reduce HL-related disparities in diabetes care.

Competing Interests

The authors declare that they have no competing interests.

Acknowledgments

Support for this manuscript came from Grants NLM R01, LM012355, and NIH UL1TR000004. Drs. Schillinger and Karter are also supported by P30 Grant NIDDK092924.

References

E. G. Grossman and Office of the Legislative Counsel, Patient Protection and Affordable Care Act, Edited by U.D.o.H.H. Services, Department of Health & Human Services, Washington, DC, USA, 2010.
S. C. Bailey, A. G. Brega, T. M. Crutchfield et al., “Update on health literacy and diabetes,” Diabetes Educator, vol. 40, no. 5, pp. 581–604, 2014.
View at: Publisher Site | Google Scholar
Institute of Medicine, Health Literacy: A Prescription to End Confusion, Edited by L. Nielsen-Bohlman, A. Panzer, and D. A. Kindig, The National Academies Press, Washington, DC, USA, 2004.
H. K. Seligman, F. F. Wang, J. L. Palacios et al., “Physician notification of their diabetes patients' limited health literacy: a randomized, controlled trial,” Journal of General Internal Medicine, vol. 20, no. 11, pp. 1001–1007, 2005.
View at: Publisher Site | Google Scholar
N. K. Ali, R. P. Ferguson, S. Mitha, and A. Hanlon, “Do medical trainees feel confident communicating with low health literacy patients?” Journal of Community Hospital Internal Medicine Perspectives, vol. 4, no. 2, 2014.
View at: Publisher Site | Google Scholar
M. Jhamb, K. L. Cavanaugh, A. Bian et al., “Disparities in electronic health record patient portal use in nephrology clinics,” Clinical Journal of the American Society of Nephrology, vol. 10, no. 11, pp. 2013–2022, 2015.
View at: Publisher Site | Google Scholar
D. Schillinger, “Literacy and health communication: reversing the “inverse care law”,” American Journal of Bioethics, vol. 7, no. 11, pp. 15–18, 2007.
View at: Publisher Site | Google Scholar
C. Brach, D. Keller, L. M. Hernandez et al., Ten Attributes of Health Literate Health Care Organizations, Institute of Medicine of the National Academies, Washington, DC, USA, 2012.
E. L. Machtinger, F. Wang, L.-L. Chen, M. Rodriguez, S. Wu, and D. Schillinger, “A visual medication schedule to improve anticoagulation control: a randomized, controlled trial,” Joint Commission Journal on Quality and Patient Safety, vol. 33, no. 10, pp. 625–635, 2007.
View at: Publisher Site | Google Scholar
J. L. Barton, J. Imboden, J. Graf, D. Glidden, E. H. Yelin, and D. Schillinger, “Patient-physician discordance in assessments of global disease severity in rheumatoid arthritis,” Arthritis Care and Research, vol. 62, no. 6, pp. 857–864, 2010.
View at: Publisher Site | Google Scholar
C. Y. Osborn and L. E. Egede, “Validation of an information-motivation-behavioral skills model of diabetes self-care (IMB-DSC),” Patient Education and Counseling, vol. 79, no. 1, pp. 49–54, 2010.
View at: Publisher Site | Google Scholar
J. D. Fisher, W. A. Fisher, K. R. Amico, and J. J. Harman, “An information-motivation-behavioral skills model of adherence to antiretroviral therapy,” Health Psychology, vol. 25, no. 4, pp. 462–473, 2006.
View at: Publisher Site | Google Scholar
N. Krieger, “Overcoming the absence of socioeconomic data in medical records: validation and application of a census-based methodology,” American Journal of Public Health, vol. 82, no. 5, pp. 703–710, 1992.
View at: Publisher Site | Google Scholar
A. J. Karter, A. Ferrara, J. Y. Liu, H. H. Moffet, L. M. Ackerson, and J. V. Selby, “Ethnic disparities in diabetic complications in an insured population,” JAMA, vol. 287, no. 19, pp. 2519–2527, 2002.
View at: Publisher Site | Google Scholar
A. J. Karter, A. Ferrara, J. A. Darbinian, L. M. Ackerson, and J. V. Selby, “Self-monitoring of blood glucose: language and financial barriers in a managed care population with diabetes,” Diabetes Care, vol. 23, no. 4, pp. 477–483, 2000.
View at: Publisher Site | Google Scholar
A. J. Karter, L. M. Ackerson, J. A. Darbinian et al., “Self-monitoring of blood glucose levels and glycemic control: the Northern California Kaiser Permanente Diabetes registry,” The American Journal of Medicine, vol. 111, no. 1, pp. 1–9, 2001.
View at: Publisher Site | Google Scholar
C. Iribarren, A. J. Karter, A. S. Go et al., “Glycemic control and heart failure among adult patients with diabetes,” Circulation, vol. 103, no. 22, pp. 2668–2673, 2001.
View at: Publisher Site | Google Scholar
H. H. Moffet, N. Adler, D. Schillinger et al., “Cohort profile: the diabetes study of Northern California (DISTANCE)—objectives and design of a survey follow-up study of social health disparities in a managed care population,” International Journal of Epidemiology, vol. 38, no. 1, pp. 38–47, 2009.
View at: Publisher Site | Google Scholar
L. D. Chew, J. M. Griffin, M. R. Partin et al., “Validation of screening questions for limited health literacy in a large VA outpatient population,” Journal of General Internal Medicine, vol. 23, no. 5, pp. 561–566, 2008.
View at: Publisher Site | Google Scholar
N. Ratanawongsa, A. J. Karter, M. M. Parker et al., “Communication and medication refill adherence the diabetes study of Northern California,” JAMA Internal Medicine, vol. 173, no. 3, pp. 210–218, 2013.
View at: Publisher Site | Google Scholar
D. Schillinger, K. Grumbach, J. Piette et al., “Association of health literacy with diabetes outcomes,” JAMA, vol. 288, no. 4, pp. 475–482, 2002.
View at: Publisher Site | Google Scholar
D. Schillinger, J. Piette, K. Grumbach et al., “Closing the loop: physician communication with diabetic patients who have low health literacy,” Archives of Internal Medicine, vol. 163, no. 1, pp. 83–90, 2003.
View at: Publisher Site | Google Scholar
D. Schillinger, M. Handley, F. Wang, and H. Hammer, “Effects of self-management support on structure, process, and outcomes among vulnerable patients with diabetes,” Diabetes Care, vol. 32, no. 4, pp. 559–566, 2009.
View at: Publisher Site | Google Scholar
D. Schillinger, H. Hammer, F. Wang et al., “Seeing in 3-D: examining the reach of diabetes self-management support strategies in a public health care system,” Health Education and Behavior, vol. 35, no. 5, pp. 664–682, 2008.
View at: Publisher Site | Google Scholar
N. Ratanawongsa, M. A. Handley, U. Sarkar et al., “Diabetes health information technology innovation to improve quality of life for health plan members in urban safety net,” Journal of Ambulatory Care Management, vol. 37, no. 2, pp. 127–137, 2014.
View at: Publisher Site | Google Scholar
N. Ratanawongsa, V. K. Bhandari, M. Handley, T. Rundall, H. Hammer, and D. Schillinger, “Primary care provider perceptions of the effectiveness of two self-management support programs for vulnerable patients with diabetes,” Journal of Diabetes Science and Technology, vol. 6, no. 1, pp. 116–124, 2012.
View at: Publisher Site | Google Scholar
U. Sarkar, D. Schillinger, A. López, and R. Sudore, “Validation of self-reported health literacy questions among diverse english and spanish-speaking populations,” Journal of General Internal Medicine, vol. 26, no. 3, pp. 265–271, 2011.
View at: Publisher Site | Google Scholar
eClinicalWorks, http://www.eclinicalworks.com/.
U. Sarkar, A. J. Karter, J. Y. Liu, H. H. Moffet, N. E. Adler, and D. Schillinger, “Hypoglycemia is more common among type 2 diabetes patients with limited health literacy: the Diabetes Study of Northern California (DISTANCE),” Journal of General Internal Medicine, vol. 25, no. 9, pp. 962–968, 2010.
View at: Publisher Site | Google Scholar
Y. Attali and D. Powers, A Developmental Writing Scale, ETS Research Report Series, 2008.
S. A. Crossley, K. Kyle, L. Varner, L. Gou, and D. S. McNamara, “Linguistic microfeatures to predict L2 writing proficiency: a case study in automated writing evaluation,” Journal of Writing Assessment, vol. 7, no. 1, 2014.
View at: Google Scholar
L. D. Chew, K. A. Bradley, and E. J. Boyko, “Brief questions to identify patients with inadequate health literacy,” Family Medicine, vol. 36, no. 8, pp. 588–594, 2004.
View at: Google Scholar
A. M. Bauer, D. Schillinger, M. M. Parker et al., “Health literacy and antidepressant medication adherence among adults with diabetes: the diabetes study of Northern California (DISTANCE),” Journal of General Internal Medicine, vol. 28, no. 9, pp. 1181–1187, 2013.
View at: Publisher Site | Google Scholar
Agency for Healthcare Research and Quality, CAHPS Clinician & Group Survey, 2011.
L. S. Morales, M. N. Elliott, R. Weech-Maldonado, K. L. Spritzer, and R. D. Hays, “Differences in CAHPS adult survey reports and ratings by race and ethnicity: an analysis of the National CAHPS Benchmarking Data 1.0,” Health Services Research, vol. 36, no. 3, pp. 595–617, 2001.
View at: Google Scholar
A. J. Karter, U. Subramanian, C. Saha et al., “Barriers to insulin initiation: the translating research into action for diabetes insulin starts project,” Diabetes Care, vol. 33, no. 4, pp. 733–735, 2010.
View at: Publisher Site | Google Scholar
U. Sarkar, C. R. Lyles, M. M. Parker et al., “Use of the refill function through an online patient portal is associated with improved adherence to statins in an integrated health system,” Medical Care, vol. 52, no. 3, pp. 194–201, 2014.
View at: Publisher Site | Google Scholar
R. Roscoe, A. Varner, E. L. Snow, and D. S. McNamara, “Designing usable automated formative feedback for intelligent tutoring,” in Proceedings of the 11th International Conference of the Learning Sciences (ICLS '14), pp. 1423–1425, Boulder, Colo, USA, 2014.
View at: Google Scholar
D. L. Roter, S. Larson, D. Z. Sands, D. E. Ford, and T. Houston, “Can E-mail messages between patients and physicians be patient-centered?” Health Communication, vol. 23, no. 1, pp. 80–86, 2008.
View at: Publisher Site | Google Scholar
N. D. Duran, S. Crossley, C. Hall, P. McCarthy, and D. McNamara, “Expanding a catalogue of deceptive linguistic features with NLP technologies,” in Proceedings of the 22nd International Florida Artificial Intelligence Research Society Conference (FLAIRS-22 '09), pp. 243–248, Sanibel, Fla, USA, March 2009.
View at: Google Scholar
N. D. Duran, C. Hall, P. M. McCarthy, and D. S. McNamara, “The linguistic correlates of conversational deception: comparing natural language processing technologies,” Applied Psycholinguistics, vol. 31, no. 3, pp. 439–462, 2010.
View at: Publisher Site | Google Scholar
J. P. Kincaid, R. P. Fishburne Jr., R. L. Rogers, and B. S. Chissom, “Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel,” DTIC Document, 1975.
View at: Google Scholar
M. Reed, J. Huang, R. Brand et al., “Implementation of an outpatient electronic health record and emergency department visits, hospitalizations, and office visits among patients with diabetes,” JAMA, vol. 310, no. 10, pp. 1060–1065, 2013.
View at: Publisher Site | Google Scholar
M. Reed, J. Huang, I. Graetz et al., “Outpatient electronic health records and the clinical care and outcomes of patients with diabetes mellitus,” Annals of Internal Medicine, vol. 157, no. 7, pp. 482–489, 2012.
View at: Publisher Site | Google Scholar
L. T. Harris, T. D. Koepsell, S. J. Haneuse, D. P. Martin, and J. D. Ralston, “Glycemic control associated with secure patient-provider messaging within a shared electronic medical record: a longitudinal analysis,” Diabetes Care, vol. 36, no. 9, pp. 2726–2733, 2013.
View at: Publisher Site | Google Scholar
C. R. Lyles, U. Sarkar, J. D. Ralston et al., “Patient-provider communication and trust in relation to use of an online patient portal among diabetes patients: the Diabetes and Aging Study,” Journal of the American Medical Informatics Association, vol. 20, no. 6, pp. 1128–1131, 2013.
View at: Publisher Site | Google Scholar
A. Schickedanz, D. Huang, A. Lopez et al., “Access, interest, and attitudes toward electronic communication for health care among patients in the medical safety net,” Journal of General Internal Medicine, vol. 28, no. 7, pp. 914–920, 2013.
View at: Publisher Site | Google Scholar
J. B. Mirsky, L. Tieu, C. Lyles, and U. Sarkar, “A mixed-methods study of patient–provider e-mail content in a safety-net setting,” Journal of Health Communication, vol. 21, no. 1, pp. 85–91, 2016.
View at: Publisher Site | Google Scholar
C. M. Castro, C. Wilson, F. Wang, and D. Schillinger, “Babel babble: physicians' use of unclarified medical jargon with patients,” American Journal of Health Behavior, vol. 31, supplement 1, pp. s85–s95, 2007.
View at: Publisher Site | Google Scholar
A. C. Graesser and D. S. McNamara, “Computational analyses of multilevel discourse comprehension,” Topics in Cognitive Science, vol. 3, no. 2, pp. 371–398, 2011.
View at: Publisher Site | Google Scholar
S. A. Crossley, “Advancing research in second language writing through computational tools and machine learning techniques: a research agenda,” Language Teaching, vol. 46, no. 2, pp. 256–271, 2013.
View at: Publisher Site | Google Scholar
D. S. McNamara, A. C. Graesser, P. M. McCarthy, and Z. Cai, Automated Evaluation of Text and Discourse with Coh-Metrix, Cambridge University Press, 2014.
E. Brill, “Transformation-based error-driven learning and natural language processing: a case study in part-of-speech tagging,” Computational Linguistics, vol. 21, no. 4, 1995.
View at: Google Scholar
E. Charniak, “A maximum-entropy-inspired parser,” in Proceedings of the 1st North American Chapter of the Association for Computational Linguistics Conference, pp. 132–139, Association for Computational Linguistics, Seattle, Wash, USA, 2000.
View at: Google Scholar
T. K. Landauer, D. S. McNamara, S. Dennis, and W. Kintsch, Handbook of Latent Semantic Analysis, Psychology Press, 2013.
P. M. McCarthy, R. H. Guess, and D. S. McNamara, “The components of paraphrase evaluations,” Behavior Research Methods, vol. 41, no. 3, pp. 682–690, 2009.
View at: Publisher Site | Google Scholar
D. S. McNamara, S. A. Crossley, and R. Roscoe, “Natural language processing in an intelligent writing strategy tutoring system,” Behavior Research Methods, vol. 45, no. 2, pp. 499–515, 2013.
View at: Publisher Site | Google Scholar
S. A. Crossley, R. Roscoe, and D. S. McNamara, “Using automatic scoring models to detect changes in student writing in an intelligent tutoring system,” in Proceedings of the 26th International FLAIRS Conference, May 2013.
View at: Google Scholar
K. Kyle and S. A. Crossley, “Automatically assessing lexical sophistication: indices, tools, findings, and application,” TESOL Quarterly, vol. 49, no. 4, pp. 757–786, 2015.
View at: Publisher Site | Google Scholar
S. A. Crossley, K. Kyle, and D. S. McNamara, “The tool for the automatic analysis of text cohesion (TAACO): automatic assessment of local, global, and text cohesion,” Behavior Research Methods, vol. 48, no. 4, pp. 1227–1237, 2015.
View at: Publisher Site | Google Scholar
N. Duran, C. Bellissens, R. Taylor, and D. S. McNamara, “Qualifying text difficulty with automated indices of cohesion and semantics,” in Proceedings of the 29th Annual Meeting of the Cognitive Science Society, Austin, Tex, USA, 2007.
View at: Google Scholar
S. A. Crossley, J. Greenfield, and D. S. McNamara, “Assessing text readability using cognitively based indices,” TESOL Quarterly, vol. 42, no. 3, pp. 475–493, 2008.
View at: Publisher Site | Google Scholar
S. A. Crossley, R. Roscoe, and D. S. McNamara, “Predicting human scores of essay quality using computational indices of linguistic and textual features,” in Artificial Intelligence in Education, Springer, Berlin, Germany, 2011.
View at: Google Scholar
R. Flesch, “A new readability yardstick,” Journal of Applied Psychology, vol. 32, no. 3, pp. 221–233, 1948.
View at: Publisher Site | Google Scholar
S. A. Crossley, Z. Cai, and D. S. McNamara, “Syntagmatic, paradigmatic, and automatic N-gram approaches to assessing essay quality,” in Proceedings of the 25th International Florida Artificial Intelligence Research Society Conference (FLAIRS-25 '12), pp. 214–219, Marco Island, Fla, USA, May 2012.
View at: Google Scholar
L. Guo, S. A. Crossley, and D. S. McNamara, “Predicting human judgments of essay quality in both integrated and independent second language writing samples: a comparison study,” Assessing Writing, vol. 18, no. 3, pp. 218–238, 2013.
View at: Publisher Site | Google Scholar
D. S. McNamara, M. M. Louwerse, P. M. McCarthy, and A. C. Graesser, “Coh-Metrix: capturing linguistic features of cohesion,” Discourse Processes, vol. 47, no. 4, pp. 292–330, 2010.
View at: Publisher Site | Google Scholar
C. Juel, P. Griffith, and P. Gough, “A longitudinal study of the changing relationships of word recognition, spelling, reading comprehension, and writing from first to second grade,” Journal of Educational Psychology, vol. 78, no. 4, pp. 243–255, 1986.
View at: Publisher Site | Google Scholar
R. D. Abbott and V. W. Berninger, “Structural equation modeling of relationships among developmental skills and writing skills in primary-and intermediate-grade writers,” Journal of Educational Psychology, vol. 85, no. 3, pp. 478–508, 1993.
View at: Publisher Site | Google Scholar
A. G. Brega, A. Ang, W. Vega et al., “Mechanisms underlying the relationship between health literacy and glycemic control in American Indians and Alaska Natives,” Patient Education and Counseling, vol. 88, no. 1, pp. 61–68, 2012.
View at: Publisher Site | Google Scholar
A. S. Laramee, N. Morris, and B. Littenberg, “Relationship of literacy and heart failure in adults with diabetes,” BMC Health Services Research, vol. 7, article 98, 2007.
View at: Publisher Site | Google Scholar
A. J. Karter, M. M. Parker, H. H. Moffet, A. T. Ahmed, J. A. Schmittdiel, and J. V. Selby, “New prescription medication gaps: a comprehensive measure of adherence to new prescriptions,” Health Services Research, vol. 44, no. 5, pp. 1640–1661, 2009.
View at: Publisher Site | Google Scholar
R. Pearl, “Kaiser permanente Northern California: current experiences with internet, mobile, and video technologies,” Health Affairs, vol. 33, no. 2, pp. 251–257, 2014.
View at: Publisher Site | Google Scholar
L. T. Harris, S. J. Haneuse, D. P. Martin, and J. D. Ralston, “Diabetes quality of care and outpatient utilization associated with electronic patient-provider messaging: a cross-sectional analysis,” Diabetes Care, vol. 32, no. 7, pp. 1182–1187, 2009.
View at: Publisher Site | Google Scholar
R. W. Grant, A. S. Adams, E. A. Bayliss, and M. Heisler, “Establishing visit priorities for complex patients: a summary of the literature and conceptual model to guide innovative interventions,” Healthcare, vol. 1, no. 3-4, pp. 117–122, 2013.
View at: Publisher Site | Google Scholar
J. D. Ralston, C. M. Rutter, D. Carrell, J. Hecht, D. Rubanowice, and G. E. Simon, “Patient use of secure electronic messaging within a shared medical record: a cross-sectional study,” Journal of General Internal Medicine, vol. 24, no. 3, pp. 349–355, 2009.
View at: Publisher Site | Google Scholar
D. Blumenthal and M. Tavenner, “The ‘meaningful use’ regulation for electronic health records,” The New England Journal of Medicine, vol. 363, no. 6, pp. 501–504, 2010.
View at: Publisher Site | Google Scholar
N. Ratanawongsa, J. C. Crosson, D. Schillinger, A. J. Karter, C. K. Saha, and D. G. Marrero, “Getting under the skin of clinical inertia in insulin initiation: the translating research into action for diabetes (TRIAD) insulin starts project,” Diabetes Educator, vol. 38, no. 1, pp. 94–100, 2012.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2017 Dean Schillinger et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1699

Downloads

1124

Citations