Use of Expectation Disconfirmation Theory to Test Patient Satisfaction with Asynchronous Telemedicine for Diabetic Retinopathy Detection

Serrano, Christina I.; Shah, Vishal; Abràmoff, Michael D.

doi:https://doi.org/10.1155/2018/7015272

International Journal of Telemedicine and Applications

On this page

Abstract Introduction Results Discussion Conclusion Data Availability Conflicts of Interest Acknowledgments Supplementary Materials References Copyright Related Articles

Research Article | Open Access

Volume 2018 | Article ID 7015272 | https://doi.org/10.1155/2018/7015272

Use of Expectation Disconfirmation Theory to Test Patient Satisfaction with Asynchronous Telemedicine for Diabetic Retinopathy Detection

Christina I. Serrano,¹Vishal Shah,²and Michael D. Abràmoff³

Academic Editor: Max E. Stachura

Received07 Mar 2018

Revised28 May 2018

Accepted10 Jun 2018

Published11 Oct 2018

Abstract

Objective. The purpose of the study is to extend research on patient satisfaction with telemedicine services by employing the theoretical framework of Expectation Disconfirmation Theory (EDT) for diabetic retinopathy screenings focusing on rural patients. Method. Adult subjects (n=220) with diabetes were recruited from a single family practice office in rural Iowa. Subjects completed a “pre” survey concerning their forward-looking perceptions of telemedicine prior to using telemedicine for detection of diabetic retinopathy and a “post” survey after they received recommendations from the distant ophthalmologists. Results. All hypotheses of the EDT model were supported. Patient satisfaction is influenced by both patients’ expectations (P<.001) and disconfirmation of expectations (P<.001), and patient satisfaction has a positive impact on patient preference for telemedicine services (P<.001). Overall, patients who received telemedicine services were highly satisfied with telemedicine and developed a favorable disposition towards telemedicine services. Conclusions. The EDT model is a viable framework to study patient satisfaction of telemedicine services. While previous feasibility studies have shown that telemedicine for diabetic retinopathy screenings yields diagnostic efficacy, this study applies a theoretical framework to demonstrate the viability of telemedicine for diabetic retinopathy screenings in rural areas.

1. Introduction

In the United States (US), diabetic retinopathy is the main cause of blindness among individuals who are 20 to 74 years old [1, 2], and its estimated prevalence is approximately 29 percent among adults with diabetes [3]. Early detection and effective treatment of diabetic retinopathy can prevent blindness and visual loss in almost all cases, but most patients are symptomless until the retinopathy has reached advanced stages [4, 5]. Therefore, the American Diabetes Association, the American Academy of Ophthalmology, and other scientific organizations recommend regular or annual screenings for diabetic retinopathy; however, a significant proportion of people with diabetes do not undergo such examinations [4, 5]. Prior studies show that patient satisfaction is critical in improving patients’ decisions to seek appropriate healthcare [6, 7] and this extends to diabetic retinopathy exams [8]. In fact, recent work suggests that telemedicine shows promise for diabetic retinopathy screening, with the potential to increase patient adherence with prescribed disease management practices (e.g., blood sugar control, office visits, and medication compliance), all of which can help prevent end-organ damage [7]. Thus, it becomes important to investigate factors driving patients’ satisfaction and preferences, as they are important consumers of healthcare services. To this end, we develop a research model of patients’ preference for diabetic retinopathy exams using an asynchronous telemedicine service.

Telemedicine involves the use of telecommunication networks to enable information exchange between healthcare providers and patients who are geographically separated. The two primary modes of telemedicine delivery are store-and-forward, which is asynchronous, and real-time, which is synchronous. With increasing advances in telecommunications networks and technology, telemedicine has shown promise in providing healthcare services to patients remotely [9, 10], particularly to patients in rural areas, who have limited access to many healthcare services locally [11]. In rural areas, access to eye care specialists is limited; thus, applications of telemedicine that enable rural patients to access diabetic retinopathy screenings in their local primary care setting may facilitate their compliance with annual eye exams [12, 13]. Telemedicine has been successfully used to detect asymptomatic retinal abnormalities in Spain [14]. A recent meta-analysis showed that the use of telemedicine for type 2 diabetes mellitus (DM) patients showed promising results for self-management of the disease [15]. Thus, it becomes important to understand the disposition of diabetic patients towards telemedicine. Recent research [7] suggests designing telemedicine systems for diabetic retinopathy screening as well advocates studying patients’ perceptions.

For this application of telemedicine to be successful, patients with diabetes will need to have positive perceptions concerning the actual experience of using telemedicine services for these screenings. Research has shown that the application of telemedicine for diabetic retinopathy screenings is both feasible and efficacious [12, 13, 16–20], not only in the US, but also in other countries, such as India [21], South Africa [22], and China [23]. Although some studies have shown that patients reported high levels of satisfaction with using telemedicine for diabetic retinopathy screenings [20, 21, 24–27], none of these studies investigate changes in patient perceptions over time, before and after usage of telemedicine. Furthermore, no studies to date concerning telemedicine patient satisfaction have employed a theoretical framework to investigate patient satisfaction for diabetic retinopathy screenings. Thus, the purpose of this study is to examine the antecedents and consequences of patient satisfaction with telemedicine for diabetic retinopathy screenings by employing the theoretical framework of Expectation Disconfirmation Theory (EDT) with a longitudinal field study design (assessing “pre” and “post” service encounter beliefs) to gain a deeper understanding of this phenomenon.

We concentrate on patient satisfaction for two primary reasons. First, patient satisfaction is considered an important component of the quality of care a patient receives [28, 29] and is linked to improved treatment adherence and clinical outcomes [26, 30]. Second, existing studies of patient satisfaction have been criticized for their lack of conceptual unity and theoretical development [6], particularly within the context of telemedicine [31, 32]. In fact, many telemedicine patient satisfaction studies conflate the concept of satisfaction with related but conceptually distinct factors, such as telemedicine acceptance and perceived quality of care [31, 32]. A recent systematic review of the impact of medical informatics (including telemedicine) on patient satisfaction found that, though most studies report improvements in patient satisfaction, results are largely inconsistent across studies, and few studies focused on patient satisfaction [33]. Another recent systematic review focused on patient satisfaction with telemedicine for cardiology and found that none of the existing studies provided a clear definition or used the same measures for patient satisfaction [34]. There is a need to conduct scholarly research that grounds the empirical assessment of patient satisfaction within valid theoretical frameworks as scholars and practitioners alike generally agree that patient satisfaction is an important component of healthcare quality [35]. Otherwise, it becomes difficult to synthesize findings across patient satisfaction studies and to build on existing research in this domain.

Some healthcare studies have leveraged the well-established consumer satisfaction literature in the marketing discipline to conceptualize patient satisfaction [36], one of the most prominent theories being EDT [37, 38]. Studies in marketing have applied EDT to predict consumer preferences [39], repurchase intentions [40, 41], and customer loyalty [40, 42]. Furthermore, EDT has been used in the information systems literature to predict technology users’ intentions to continue using information technologies [43, 44]. In healthcare, the EDT model also has been adapted in patient satisfaction studies across a variety of contexts, such as medication-related services [45], surgical treatment outcomes [46], waiting times for surgery [47], emergency department services [48], and eHealth Website users [49]. Although several telemedicine studies concerning patient satisfaction exist [50, 51], they are largely atheoretical in nature [31, 32, 35].

We address this gap by building on existing research related to patient satisfaction with telemedicine [50, 51], specifically employing the theoretical framework of EDT to conceptualize and empirically investigate patient satisfaction with telemedicine for diabetic retinopathy screenings. Our goal is to develop a nomological model for patients’ preference behavior. Because our research stems from the behavioral psychology paradigm, our focus is on perceptions; i.e., various constructs/variables in the model represent patients’ perceptions of reality. It has been well established that perceptions offer valuable insights in studying human behavior, as is the case for this study [52, 53].

Although EDT has been leveraged in patient satisfaction studies, it is important to note that some scholars criticize research that employs theories of consumer behavior in the healthcare context. The criticism stems from the notion that market conditions in the US healthcare industry differ from markets that are traditionally studied in economically driven models [54]. At the same time, some scholars note that healthcare in various countries is increasingly becoming commoditized [55, 56] and patients can be regarded as consumers who make choices about their healthcare [57]. Given these rising shifts in healthcare, it becomes even more important to study patient perceptions and experiences, particularly because patient experiences and satisfaction are core components of the Triple Aim framework aimed at guiding healthcare improvements [58]. Furthermore, from a service point of view, it is important to understand what makes patients satisfied with a specific service. This need is more pronounced when trying to understand the feasibility of implementing telemedicine in rural areas. If potential patients do not “buy in” to the proposed method of medical delivery (in this case, telemedicine), then the exercise of rolling out such a service may be futile. Thus, there is merit to examining patient perceptions. Theories such as EDT provide an overarching framework to examine patient satisfaction and preferences systematically. This pilot study is a step in the same direction.

2. Theoretical Framework and Research Hypotheses

According to EDT, satisfaction is defined as a consumer’s judgment that a product or service provided a pleasurable level of consumption-related fulfillment [38]. Satisfaction is determined by consumers’ preconsumption expectations about a product or service and expectation disconfirmation; each explained next. Figure 1 shows the research model (because the focus of the study is on telemedicine services, at times, we refer to telemedicine services as services).

Expectations are forward-looking beliefs concerning the service encounter and reflect patient perceptions of the telemedicine encounter prior to receiving this service. A priori expectations represent a baseline standard of comparison or comparative referent, to form postconsumption judgments. In other words, the observed performance of a service postconsumption only has meaning if it is compared to some baseline standard, the a priori expectations [38]. Expectations can be influenced by prior perceived experience and communication messages from salespeople, physicians, nurses, other personnel, and social referents [37].

Expectation disconfirmation is defined as the difference between the preconsumption expectations and postconsumption observed performance [37]. Positive disconfirmation results when the observed performance of the service exceeds preconsumption expectations (i.e., “better than expected”); negative disconfirmation results when the observed performance of the service falls below preconsumption expectations (i.e., “worse than expected”). Both expectations and disconfirmation jointly positively predict consumer satisfaction, and these relationships are explained through two primary mechanisms: the assimilation effect and the contrast effect.

The positive relationship between expectations and satisfaction is explained through an assimilation effect. When patients observe that their postconsumption service experience performs closely to their preconsumption expectations, they tend to “assimilate” their postconsumption perceptions towards their baseline expectations (i.e., the service “meets expectations”) and rely heavily on these initial expectations to form satisfaction judgments [38]. Therefore, we hypothesize the following.

H1: Patient’s Preconsumption Expectations Will Positively Influence Satisfaction with Telemedicine Services. The positive relationship between disconfirmation and satisfaction is explained through a contrast effect. When individuals observe postconsumption experiences that deviate notably from their preconsumption expectations, they tend to exaggerate these differences such that service performance observed to be better than expected is considered exceptionally good, whereas service performance that is worse than anticipated is regarded as exceptionally bad [38]. When service performance is perceived as exceptionally good (i.e., positively disconfirmed), individuals are more satisfied as compared to when service performance is perceived as exceptionally bad (i.e., negatively disconfirmed), the latter leading to dissatisfaction.

H2: Patient’s Expectation Disconfirmation Will Positively Influence Satisfaction with Telemedicine Services. The relationship between expectations and disconfirmation has yielded mixed findings in empirical studies that have tested EDT [38, 43]. Typically, this relationship has been modeled as negative [42, 59]. Most commonly, the negative relationship between expectations and disconfirmation is explained through a ceiling/floor effect [38]. The “ceiling effect” refers to situations in which the actual performance of the service will be incapable of reaching extremely high (i.e., ceiling) expectation levels, leading to negative disconfirmation. The same applies to low levels of expectations, the lowest level possible representing “the floor.” There is a lower likelihood that the actual performance will reach these extreme low (i.e., floor) expectation levels, resulting in positive disconfirmation. In our telemedicine context, this means that the higher the patients’ expectations of the telemedicine service, the greater the likelihood of negative disconfirmation (i.e., perceptions of the telemedicine service being “worse than expected”), due to the ceiling effect. Alternatively, the lower the patients’ expectations of the telemedicine service, the greater the likelihood of positive disconfirmation (i.e., perceptions of the telemedicine service being “better than expected”), due to the floor effect.

H3: Patient’s Preconsumption Expectations Will Negatively Influence Expectation Disconfirmation. The EDT framework has been extended to include cognitive outcomes of satisfaction, including consumer preference, which is positively influenced by satisfaction [60]. In our study, this means that the more satisfied patients are with the telemedicine service, the higher their preference for consuming telemedicine.

H4: Patient Satisfaction Will Positively Influence Preference for Receiving Telemedicine Services. Two control variables, health insurance and prior perceived experience with ophthalmologist exams, which may influence patient satisfaction and patient preference, are included in the research model to control for rival explanations. Though these control variables are outside the scope of the EDT framework, they have been proposed as predisposing and enabling factors that influence patients’ utilization of health services and ultimately patient satisfaction [61].

3. Method

3.1. Sample and Procedure

Subjects were recruited from a single family practice office in rural Iowa. In this rural location, patients did not have an alternative to telemedicine, other than refusal of the service, because there were no available ophthalmologists within a reasonable driving distance of the rural community. The study protocol and consent procedures were approved by the Institutional Review Board of the University of Iowa and the family practice office. Written informed consent was obtained from all participants, and the study was performed according to the tenets of the Declaration of Helsinki. One week prior to the start of the study, the family practice office was equipped with a digital camera and other types of equipment required for Internet-based remote diabetic retinopathy screening using telemedicine. This equipment and the system, operational in the Netherlands as well as in the Midwest US, have been described previously [17].

To participate in the study, the patients had to be at least 18 years of age and must have had a diagnosis of diabetes 1 or 2 by the American Diabetes Association criteria. Patients were excluded if they had a documented dilated retinal exam within the last 12 months or had ever utilized telemedicine. By precluding patients with any previous experience with telemedicine, we attempted to ensure that we indeed measured expectations of first-time users.

Consecutive patients with diabetes that visited the primary care clinic for diabetes follow-up were identified and consented by one of the practice nurses. After explaining the nature of the study and the process of digital photography and remote detection, the “pre” survey was administered. Participants were then photographed by the same nurse with the Topcon NW-200 “nonmydriatic” digital fundus camera (Topcon, Paramus, NJ), with pharmacological dilation if deemed necessary by the nurse. Pharmacological dilation was done for certain patients to ensure sufficient image quality. The nurse entered the digital retinal images and clinical data including Haemoglobin A1c, (HbA1C), duration of diabetes, and any risk factors on a secure Internet website. Within two working days, the images were reviewed electronically by retina fellowship-trained ophthalmologists at the University of Iowa. The International Clinical Diabetic Retinopathy Disease Severity Scale was used to document the severity of diabetic retinopathy and the recommended course of action: annual follow-up with telemedicine or referral to an ophthalmologist for follow-up or treatment [62]. The subject then returned for a follow-up appointment, during which the nurse accessed the subject-specific report via the Internet website and explained the report to the subject. After this interaction, the subject completed the “post” survey. Both “pre” and “post” surveys were paper-based.

3.2. Measures and Descriptive Statistics

Variables used for the analysis were captured before consumption via the presurvey and after consumption via the post survey. Table 1 describes the variables measured in the study and specifies which are included in the research model and post hoc analysis. Given the behavioral perspective of this study, all constructs in this study are perceptual measures. Patients’ expectations (preusage) and their preference for telemedicine service prior to (preusage) and after its use (postusage) were measured. The difference between patients’ expectations of the quality of the retinal exam (preusage) and their postusage perceptions of the actual quality of the exam is referred to as “disconfirmation.” Expectations, disconfirmation, and satisfaction constitute the core ideas of EDT. Because the study is anchored in behavioral psychology, we used Likert scales to measure the various constructs in the study. Expectations about service are a construct that is relevant prior to using the service and hence only measured before use (i.e., pre). Patients’ preference for a particular service can change based on their actual experiences with the service; thus, patient preference is measured before and after use of a telemedicine retinal exam (i.e., pre and post). Satisfaction with the service is measured after use (i.e., post). Because we precluded participants with telemedicine experience from participating in the study, we did not measure satisfaction with telemedicine prior to its consumption. According to EDT, expectations and disconfirmation are the primary drivers of satisfaction.

Most scales were measured using a 5-point Likert scale. The two control variables were measured using a binary scale (yes/no), and the disconfirmation variable was computed using a difference score, which is one of two main approaches to measuring disconfirmation [63]. The measure of satisfaction was an overall (global) measure that captured patients’ level of satisfaction with the telemedicine service. Satisfaction can be measured at the overall service encounter level or at specific attribute levels to capture multidimensional aspects of satisfaction (e.g., wait time and staff friendliness) [27, 29, 30]. As EDT has not been employed in a telemedicine context, we opted to use an omnibus, unidimensional measure of satisfaction to improve parsimony and generalizability. Furthermore, a unidimensional measure of satisfaction is the most common approach in the consumer satisfaction literature, in which EDT is rooted [38].

A total of 247 respondents submitted both “pre” and “post” surveys. Of the 247 respondents, 101 (40.9%) were male, and 146 (59.1%) were female. Their ages ranged from 24 to 94. The vast majority of patients, 220 of the 247 patients (89.1%), were over 50 years of age, with 27 of the 247 patients (10.9%) being between 24 and 49 years of age. Because demographic data were collected separately and unpaired from the surveys, we were not able to use these variables as covariates in the data analysis. Descriptive statistics reported for age and sex reflect the total pool of respondents (n=247). Due to incomplete responses, 27 observations were dropped, yielding a final sample size of 220 patient surveys reflecting both “pre” and “post” perceptions. Descriptive statistics of the study variables are shown in Table 2. Because patients did not have an alternative to telemedicine, it precluded us from comparing results with a group that may have never wanted to use telemedicine, but our goal was not to compare two groups. Given our goal to develop a model to understand how patients’ perceptions about telemedicine changed once they consumed it firsthand, the current convenience sample served our purpose and can be considered a pilot study. Future studies can extend this work to include a group that receives the same retinopathy screening and diagnosis without the use of telemedicine (i.e., a face-to-face exam).

Because our sample included only those subjects who utilized telemedicine for remote diagnosis (as face-to-face services were not a feasible option), we investigated the extent to which our sample may be positively biased by self-selection. Using unpaired t-tests, we compared (1) answers on patient perceptions reported by subjects who participated in the first part of the telemedicine service only (“pre” survey) and never returned for the telemedicine diagnosis to (2) answers on expectations reported by subjects who experienced the full telemedicine service. This type of extrapolation method is commonly used in survey research to designate subjects who participate “less readily” (e.g., those who partially participate or require prodding to participate) as proxies for those who would choose not to participate at all [64]. Unpaired t-test results shown in Table 3 reveal that there were no significant differences between survey responses provided by subjects who received the telemedicine diagnosis and those who did not complete the study, providing some assurance that self-selection bias was not a major concern with our sample.

4. Results

To test our hypotheses, we used structural equation modeling (SEM) utilizing the partial least squares (PLS) method with SmartPLS version 2.0.M3 [65]. We used SEM because we want to explain the interaction of various latent variables (captured by constructs using Likert scales and difference scores) in the nomological model. Since we are proposing a model of patient satisfaction based on EDT, PLS is ideal for our theory building purposes [66–68]. PLS also has been employed in previous telemedicine research that proposes nomological models of psychological constructs [69]. Results of the PLS analysis are shown in Figure 2.

All hypotheses from our research model were supported, as illustrated in Figure 2. Both preusage expectation and disconfirmation positively predicted patient satisfaction with telemedicine (both at P <.001), and preusage expectation negatively influenced positive disconfirmation (P<.001). These factors explained 25.4% of the variance in patient satisfaction. Furthermore, patient satisfaction significantly and positively impacted patient preference for telemedicine (P<.001), explaining 30.9% of the variance in patient preference. The control variable of patients’ possession of health insurance was a nonsignificant predictor of patient satisfaction (P=.87) and patients’ preference for telemedicine services (P=.62). We surmise that since all patients had insurance, there was little variability in the data and, hence, its relationship with patient satisfaction and preference was not statistically significant. However, there was a significant negative relationship between the patients’ prior experience (within the past five years) with ophthalmologist exams and patients’ preference for telemedicine services (P=.04). In our case, the results suggest that if patients had prior experience with face-to-face ophthalmologist exams, they were less likely to prefer telemedicine services to screen for diabetic retinopathy. However, prior experience with face-to-face ophthalmologist exams had no significant effect on patient satisfaction with telemedicine services (P=.55).

As a post hoc analysis, we compared “pre” and “post” telemedicine usage beliefs using paired t-tests using SPSS 20.0 [70]. The results (shown in Table 4) reveal significant increases both in patients’ perceptions of the quality of telemedicine services and in patients’ preferences for telemedicine services (versus face-to-face services) after the patients gained firsthand experience with telemedicine. In other words, patients’ perceptions of using telemedicine for diabetic retinopathy screenings significantly improved between the “pre” and “post” periods.

Therefore, the results show that introduction of diabetic retinopathy screening using telemedicine was preferred by patients attending the rural family practice office. The post hoc analysis reveals that telemedicine also improved the perceived quality of the dilated eye exam for these patients. Both perceptions of satisfaction with and preference for telemedicine were stronger after the patients had gained firsthand experience using the service.

5. Discussion

The purpose of this study is to examine patient satisfaction with using telemedicine for diabetic retinopathy screenings leveraging reputed theories of consumer satisfaction from the marketing discipline. Reviews of the telemedicine literature have cited many challenges with patient satisfaction studies, highlighting the limited application of cohesive theories underlying satisfaction [35, 50, 51]. To address this gap, we applied the EDT model using a longitudinal study design to assess patient satisfaction with telemedicine.

Findings from our study indicate that the EDT framework can be leveraged to evaluate patient satisfaction with telemedicine. All hypotheses from the research model were supported. Further analyses of the data also reveal that patient perceptions of telemedicine significantly improved between the preusage and postusage stages. Overall, patients were satisfied with the telemedicine screenings and preferred the telemedicine service over a face-to-face visit. However, patients with prior experience with face-to-face ophthalmology exams were less likely to prefer telemedicine services, even after using telemedicine.

5.1. Contributions to the Literature

By applying the EDT framework, we contribute to the telemedicine literature by offering a new theoretical lens to study patient satisfaction of telemedicine services used to diagnose diabetic retinopathy. Furthermore, expectations, by definition, are forward-looking beliefs concerning the service encounter. Thus, an accurate account of patient expectations requires measurement of patient expectation perceptions prior to the telemedicine service encounter. To assess the other constructs of EDT and test the model’s relationships, patient perceptions should also be measured after the telemedicine service encounter. Hence, this requires a longitudinal design that incorporates a “pre” and “post” assessment of perceptions [37, 43]. A few telemedicine patient satisfaction studies have measured perceptions at two points in time [71], and this study addresses this limitation as well. Furthermore, our study addresses recent calls to study patient satisfaction as a focal outcome within the context of medical informatics and specifically within the subcategory of telemedicine [32].

5.2. Contributions to Practice

The study informs practice in many ways. First, the study focuses on both the antecedents and consequences of patient satisfaction, and these factors may influence the manner in which healthcare providers and administrators deliver healthcare services to improve patient satisfaction. The success of these efforts is important because research has shown that patients who are satisfied with their healthcare services are more likely to adhere to medication and treatment advice [26, 72, 73] and return to their source of care [74].

The findings from our study suggest that both the patients’ expectations of telemedicine services and the disconfirmation of these expectations (i.e., better or worse than expected) influence their perceived satisfaction with telemedicine. Thus, while it may seem counter-intuitive, one practical recommendation is that healthcare providers and administrators who wish to implement a successful telemedicine program should take into account patient expectations prior to the patients’ actual service encounter and exercise caution so as not to “overhype” the service in order to avoid extreme expectations that would be difficult to positively disconfirm. This recommendation is in line with existing research in information systems that have shown the importance of accounting for preusage expectations, suggesting that those involved in system implementations should ensure they do not deliberately or inadvertently set unrealistically high expectations when trying to “sell” the benefits of the system to management and users [75].

Recent health informatics studies support this notion as well. A study investigating medical residents’ use of iPads in hospital settings found that many residents, prior to the iPad implementation, reported extremely high expectations of the benefits they would reap from using the iPads. However, four months after the deployment, a significant number of residents reported that benefits of the iPad use fell short of their initial expectations, and more residents indicated a preference for pen and paper usage to complete tasks than they did prior to the iPad deployment [76]. Another study evaluated health professionals’ expectations versus actual experiences of telemonitoring and found that, although the health professionals expressed high expectations of telemonitoring benefits, they reported actual experiences that were significantly lower than their initial expectations, possibly leading to disappointment [77]. In both of these studies, a characteristic of the respondents in the preusage stage was that they had exceptionally high expectations of the health information technology. Because these extremely high expectations were difficult to positively disconfirm, the actual experiences of the health professionals in the postusage stage substantially fell short of their initial expectations, leading to negative perceptions. Had their baseline expectations been tempered, there would have been a greater likelihood of satisfaction.

Furthermore, while telemedicine has its critics, the fact that 88 out of 220 subjects (40%) with diabetes reported not seeing any eye care provider in the previous five years underscores the need for increased accessibility of the dilated eye exam for these populations, including, but not necessarily limited to, telemedicine. This study builds on existing telemedicine studies and supports the notion that telemedicine solutions for diabetic retinopathy screenings are feasible in the primary care setting [12, 17, 18]. We extend prior telemedicine research by employing the EDT framework. This framework gives researchers a way to understand the factors that drive patient satisfaction. Patient satisfaction with telemedicine has been shown to result in improved adherence to preventive screenings [26] and better clinical outcomes [30]. Hence, positive patient perceptions may enhance compliance with dilated eye exam guidelines, which has been shown to be essential for timely intervention to prevent blindness and vision loss in diabetic patients [13].

5.3. Limitations and Future Research

As with all research, our study is not without limitations. One potential limitation is that we measured variables using single items, an approach that is sometimes criticized [78, 79]. However, recent literature has revealed that single item measures have been shown statistically to be equally as reliable and valid as multiple-item measures of the same constructs [80, 81]. In the job satisfaction literature, for example, there has been growing support for the use of single item measures of satisfaction [82–85], and single items are commonly used to measure patient satisfaction with telemedicine [86, 87]. Single item measures are primarily supported when measuring concrete constructs, that is, concepts that respondents would clearly understand and have a similar agreement about the meaning of the concepts [81, 88, 89]. Examples of concrete concepts that are most appropriately measured with single items are likability, quality, satisfaction, and price perception [90], whereas examples of abstract concepts (requiring multiple-item measures) include creativity, power, and culture, as these latter concepts are highly complex in meaning [89]. The concepts measured in our study are all examples of concrete concepts because they are simple, well-formed ideas that are easy for respondents to understand, making them appropriate constructs for single item measures. Furthermore, unidimensional constructs, as modeled in our study, are most suitable for single item measurement [89].

The main advantages to using single item measures are that these measures are less time-intensive and taxing on the respondents and considered more flexible than multiple-item scales [81, 82]. These factors reduce respondents’ refusal to participate in studies, which is of particular concern in healthcare contexts, where patients in busy clinical practices are already pressed for time [90]. In our study, the respondents were mostly elderly, which further warranted the use of a short questionnaire to reduce the participation burden. Thus, there are many valid reasons to use short scales with single items [84]. However, that being said, future research can incorporate multiple-item measures of EDT constructs within telemedicine studies, whenever it is feasible. Use of single item measures did not allow patients to differentiate between the precise components of the telemedicine service. However, that is not the goal of the study; the study measures overall patient satisfaction as a first step and the factors that lead to it. Recent research suggests that patient satisfaction can be measured as a multidimensional construct [6]. Future research can look at patient satisfaction with respect to various dimensions of the telemedicine service.

Another possible limitation of the study is that we employ the use of a difference score for the measure of disconfirmation. Difference scores have been a topic of considerable debate in the previous literature [91, 92]. However, difference scores can, in fact, represent an individual change in an unbiased manner and are well suited to measure change [92, 93], as they reduce true score variance and increase the power of the significance tests [92]. Further, difference scores may be used validly in multiple regressions on which the PLS analysis used in this study is based, and there is no reason to avoid their use when they suit the context [94]. However, as there are alternative measures of disconfirmation, future research should also investigate other disconfirmation measures within the scope of telemedicine patient satisfaction.

Furthermore, because this study uses a single cross-section of patients attending a rural family practice office in the Midwest of the US, future studies should address larger samples of rural patients and other populations, including urban underserved patients because it is possible that perceptions may differ across these populations. Additionally, though rural or underserved populations are typically the targeted groups to receive telemedicine services, as telemedicine applications diffuse and become more widespread, it will be important to explore patient perceptions across a wider cross-section of patient populations. Nevertheless, rural populations continue to need innovative solutions to improve their access to healthcare, so future research should explore the extent to which rural patients would take advantage of telemedicine services.

Another limitation is that the study does not use a control group of patients who underwent diagnosis and treatment in a face-to-face context. The goal of this pilot study was to develop a model to understand factors that lead to telemedicine preference in and of itself based on EDT. Future research can compare two groups of patients, one using telemedicine while the other visits the ophthalmologist in person. In this study, given the sample limitations, we focus on developing a theoretical model explaining patient satisfaction and preferences once they consume/use telemedicine.

Additionally, our sample only includes patients who utilize store-and-forward (asynchronous) telemedicine for diabetic retinopathy screenings and remote diagnosis. Thus, it is not clear whether our findings will generalize to use of telemedicine in other medical specialties or for other types of telemedicine applications (e.g., interactive video telemedicine or telemonitoring). While preliminary research suggests that patients report high levels of satisfaction using both asynchronous and synchronous telemedicine for diabetes care and that the asynchronous mode is widely used for management of chronic disease such as diabetes [27, 95], future research concerning patient satisfaction with telemedicine should test the EDT framework in these different telemedicine contexts.

It is also important to note that the questionnaire asked patients about their visit specifically to an ophthalmologist in the past five years. However, because both optometrists and ophthalmologists provide routine eye care, it may be possible that patients visited an optometrist instead of an ophthalmologist and reported their past experience based on visits to either specialist. Future studies should consider recording experience with both ophthalmologists as well as optometrists.

Further, it should be noted that our study focuses on perceptions, as it is important to understand how patients perceive a new development, such as telemedicine. However, the link between a user’s perception and actual behavior and outcomes is contested and largely termed the “intention-behavior” gap in various domains, such as technology use, consumer purchasing behavior, and physical activity [96–100]. Patients may form favorable perceptions of telemedicine but may not actually interact with or use the target technology. However, this concern is mitigated to a certain extent in our study, as the patients were not actively trying to manage or use the equipment but were recipients of the diagnosis. Thus, studying perceptions would be a relevant measure of whether participants will voluntarily be recipients of such asynchronous telemedicine services in the future. Additional longitudinal studies that measure patients’ actual future behavior and objective clinical outcomes, to include correlations between these outcomes and patient perceptions, are needed.

Moreover, there are several caveats that researchers should be aware of when focusing on patient-reported expectations (PREM) and/or outcomes (PROM). Although there is research suggesting that patient-reported expectations and perceived outcomes are correlated with objective clinical outcomes [28, 29], this link is still contested in the literature, and some studies have presented counter evidence [101]. It may be possible that patients’ perceived satisfaction would bias them towards the service regardless of the actual clinical outcomes. Furthermore, a recent metareview of telemedicine use for chronic disease management found that the majority of studies on telemedicine interventions have reported positive effects with very few studies reporting negative effects, which suggests a publication bias [102]. Future research on telemedicine interventions should consider and account for potential negative consequences of telemedicine.

Another avenue of fruitful research would be to explore additional dimensions of patient perceptions that could influence disconfirmation and patient satisfaction. While our study assessed patients’ expectations and perceived preference of the quality of care provided, other dimensions, such as patient perceptions of the teleproviders’ competence or the quality of information exchange via telemedicine, may also be relevant to study. Recent work on telemedicine indicates that it can detect not only diabetic retinopathy but also other visually significant eye diseases [103]. Thus, future work can consider studying telemedicine for screening a wider group of ocular diseases. Lastly, because our study is the first to test the EDT framework in a telemedicine context, we only included the key variables relevant to EDT. Future work may build on this model by investigating additional factors (such as social influence and trust in the teleprovider) that may impact patient satisfaction and telemedicine preference.

6. Conclusion

In summary, the results show that patients were very satisfied with their use of telemedicine for diabetic retinal screenings and preferred telemedicine services. Our study found that patients’ satisfaction with the telemedicine service leads to a preference to use the service. The study was not aimed at making a comparison between telemedicine and face-to-face services using a randomized controlled trial—i.e., we did not have a control group (face-to-face condition). Our goal was to develop a theoretical model of telemedicine satisfaction and preferences using EDT. Previous studies of telemedicine satisfaction and preferences have been largely descriptive and atheoretical [77, 87, 104–106]. Some studies have described telemedicine implementations in detail [107], while others report a positive preference for telemedicine [108–110]. However, the theoretical mechanism that may guide patients’ perceived satisfaction and preference of telemedicine has not been widely studied. This specific pilot study fills this gap in the telemedicine literature by building on the theoretical foundations of EDT.

This pilot study focused on a preliminary examination of patient perceptions. We found that the implementation approach used in this telemedicine study was perceived favorably based on patients’ satisfaction with it. The results of the study suggest that telemedicine initiatives aimed at achieving this end, according to the EDT framework, should consider implementation approaches that will provide the patient with a “better than expected” telemedicine experience, which will lead to improved patient satisfaction and greater patient preference for the use of telemedicine. Offering telemedicine services for diabetic retinal screenings in primary care settings has the potential to increase compliance with routine dilated eye exams for diabetic patients. Future research can investigate this link in greater detail.

Data Availability

Please find the survey files here https://www.dropbox.com/sh/ad3s9xaq9ldlrwh/AADXfVkuc5gRjiSLYSFQgSc9a?dl=0 or from the corresponding author upon request

Conflicts of Interest

None of the authors have conflicts of interest that may impact the manuscript. One of the authors has been funded by the National Institutes of Health (NIH 01 EY018853, R01 EY019112, R01 EY017451, and R01 EB004640) and the Department of Veterans Affairs (I01 CX000119); is inventor on patents assigned to the University of Iowa, not the subject of this study; and is Founder, President and Director for IDx LLC, a company that has developed an autonomous diagnostic AI for diabetic retinopathy. None of these conflicts of interest are related to the subject of this study.

Acknowledgments

This study was supported by the Wellmark Foundation; National Eye Institute R01 EY017066; Research to Prevent Blindness, NY, NY; US Department of Agriculture; University of Iowa; Veteran’s Administration.

Supplementary Materials

The survey questions were referenced in Table . The survey had two sections, “Before” and “After”. A patient completed the “Before” survey prior to the diagnosis using the telemedicine and completed “After” survey in at the follow-up meeting when receiving the telediagnosis. (Supplementary Materials)

References

T. N. Crawford, D. V. Alfaro III, J. B. Kerrison, and E. P. Jablon, “Diabetic retinopathy and angiogenesis,” Current Diabetes Reviews, vol. 5, no. 1, pp. 8–13, 2009.
View at: Publisher Site | Google Scholar
D. S. Fong, L. Aiello, T. W. Gardner et al., “Retinopathy in diabetes,” Diabetes Care, vol. 27, no. 1, pp. S84–S87, 2004.
View at: Publisher Site | Google Scholar
X. Zhang, J. B. Saaddine, C.-F. Chou et al., “Prevalence of diabetic retinopathy in the United States, 2005–2008,” Journal of the American Medical Association, vol. 304, no. 6, pp. 649–656, 2010.
View at: Publisher Site | Google Scholar
R. Hazin, M. Colyer, F. Lum, and M. K. Barazi, “Revisiting diabetes 2000: challenges in establishing nationwide diabetic retinopathy prevention programs,” American Journal of Ophthalmology, vol. 152, no. 5, pp. 723–729, 2011.
View at: Publisher Site | Google Scholar
E. R. Schoenfeld, J. M. Greene, S. Y. Wu, and M. C. Leske, “Patterns of adherence to diabetes vision care guidelines: baseline findings from the Diabetic Retinopathy Awareness Program,” Ophthalmology, vol. 108, no. 3, pp. 563–571, 2001.
View at: Publisher Site | Google Scholar
E. Batbaatar, J. Dorjdagva, A. Luvsannyam, M. M. Savino, and P. Amenta, “Determinants of patient satisfaction: A systematic review,” Perspectives in Public Health, vol. 137, no. 2, pp. 89–101, 2017.
View at: Publisher Site | Google Scholar
N. G. Valikodath, T. K. Leveque, S. Y. Wang et al., “Patient attitudes toward telemedicine for diabetic retinopathy,” Telemedicine and e-Health, vol. 23, no. 3, pp. 205–212, 2017.
View at: Publisher Site | Google Scholar
D.-W. Park and S. L. Mansberger, “Eye disease in patients with diabetes screened with telemedicine,” Telemedicine and e-Health, vol. 23, no. 2, pp. 113–118, 2017.
View at: Publisher Site | Google Scholar
C. Dario, R. Toffanin, F. Calcaterra et al., “Telemonitoring of type 2 diabetes mellitus in Italy,” Telemedicine and e-Health, vol. 23, no. 2, pp. 143–152, 2017.
View at: Publisher Site | Google Scholar
R. L. Bashshur, G. W. Shannon, E. A. Krupinski et al., “National telemedicine initiatives: essential to healthcare reform,” Telemedicine and e-Health, vol. 15, no. 6, pp. 600–610, 2009.
View at: Publisher Site | Google Scholar
N. M. Hjelm, “Benefits and drawbacks of telemedicine,” Journal of Telemedicine and Telecare, vol. 11, no. 2, pp. 60–70, 2005.
View at: Publisher Site | Google Scholar
J. Cuadros and G. Bresnick, “EyePACS: an adaptable telemedicine system for diabetic retinopathy screening,” Journal of Diabetes Science and Technology, vol. 3, no. 3, pp. 509–516, 2009.
View at: Publisher Site | Google Scholar
C. R. Taylor, L. M. Merin, A. M. Salunga et al., “Improving diabetic retinopathy screening ratios using telemedicine-based digital retinal imaging technology: The vine hill study,” Diabetes Care, vol. 30, no. 3, pp. 574–578, 2007.
View at: Publisher Site | Google Scholar
J. K. Rao, M. Weinberger, and K. Kroenke, “Visit-specific expectations and patient-centered outcomes: A literature review,” Archives of Family Medicine, vol. 9, no. 10, pp. 1148–1155, 2000.
View at: Publisher Site | Google Scholar
Y. Zhai, W. Zhu, Y. Cai, D. Sun, and J. Zhao, “Clinical- and cost-effectiveness of telemedicine in type 2 diabetes mellitus: a systematic review and meta-analysis,” Medicine, vol. 93, no. 28, article e312, 2014.
View at: Publisher Site | Google Scholar
J. C. Wei, D. J. Valentino, D. S. Bell, and R. S. Baker, “A web-based telemedicine system for diabetic retinopathy screening using digital fundus photography,” Telemedicine and e-Health, vol. 12, no. 1, pp. 50–57, 2006.
View at: Publisher Site | Google Scholar
M. D. Abramoff and M. S. A. Suttorp-Schulten, “Web-based screening for diabetic retinopathy in a primary care population: The EyeCheck Project,” Telemedicine and e-Health, vol. 11, no. 6, pp. 668–674, 2005.
View at: Publisher Site | Google Scholar
F. Gómez-Ulla, M. I. Fernandez, F. Gonzalez et al., “Digital retinal images and teleophthalmology for detecting and grading diabetic retinopathy,” Diabetes Care, vol. 25, no. 8, pp. 1384–1389, 2002.
View at: Publisher Site | Google Scholar
G. Zahlmann and G. Mann, “TME6/365: Teleconsultation and telescreening for eye diseases,” Journal of Medical Internet Research, vol. 1, p. e113, 1999.
View at: Publisher Site | Google Scholar
S. Luzio, S. Hatcher, G. Zahlmann et al., “Feasibility of using the TOSCA telescreening procedures for diabetic retinopathy,” Diabetic Medicine, vol. 21, no. 10, pp. 1121–1128, 2004.
View at: Publisher Site | Google Scholar
P. G. Paul, R. Raman, P. K. Rani, H. Deshmukh, and T. Sharma, “Patient satisfaction levels during teleophthalmology consultation in rural south India,” Telemedicine and e-Health, vol. 12, no. 5, pp. 571–576, 2006.
View at: Publisher Site | Google Scholar
B. Mash, D. Powell, F. du Plessis, U. van Vuuren, M. Michalowska, and N. Levitt, “Screening for diabetic retinopathy in primary care with a mobile fundal camera - Evaluation of a South African pilot project,” South African Medical Journal, vol. 97, no. 12 I, pp. 1284–1288, 2007.
View at: Google Scholar
J. Peng, H. Zou, W. Wang et al., “Implementation and first-year screening results of an ocular telehealth system for diabetic retinopathy in China,” BMC Health Services Research, vol. 11, no. 1, 2011.
View at: Publisher Site | Google Scholar
P. S. Silva, J. D. Cavallerano, L. M. Aiello, and L. P. Aiello, “Telemedicine and diabetic retinopathy moving beyond retinal screening,” JAMA Ophtalmology, vol. 129, no. 2, pp. 236–242, 2011.
View at: Publisher Site | Google Scholar
K. Kurji, D. Kiage, C. J. Rudnisky, and K. F. Damji, “Improving diabetic retinopathy screening in Africa: patient satisfaction with teleophthalmology versus ophthalmologist-based screening,” Middle East African Journal of Ophthalmology, vol. 20, no. 1, pp. 56–60, 2013.
View at: Publisher Site | Google Scholar
P. R. Conlin, B. M. Fisch, A. A. Cavallerano, J. D. Cavallerano, S.-E. Bursell, and L. M. Aiello, “Nonmydriatic teleretinal imaging improves adherence to annual eye examinations in patients with diabetes,” Journal of Rehabilitation Research and Development, vol. 43, no. 6, pp. 733–739, 2006.
View at: Publisher Site | Google Scholar
G.-H. Rotvold, U. Knarvik, M. A. Johansen, and K. Fossen, “Telemedicine screening for diabetic retinopathy: Staff and patient satisfaction,” Journal of Telemedicine and Telecare, vol. 9, no. 2, pp. 109–113, 2003.
View at: Publisher Site | Google Scholar
P. Cleary and B. McNeil, “Patient satisfaction as an indicator of quality of care,” Inquiry, vol. 25, no. 1, pp. 25–36, 1988.
View at: Google Scholar
C. van Campen, H. Sixma, R. D. Friele, J. J. Kerssens, and L. Peters, “Quality of care and patient satisfaction: a review of measuring instruments,” Medical Care Research and Review, vol. 52, no. 1, pp. 109–133, 1995.
View at: Publisher Site | Google Scholar
M. J. U. Rho, S. R. A. Kim, H.-S. Kim et al., “Exploring the relationship among user satisfaction, compliance, and clinical outcomes of telemedicine services for glucose control,” Telemedicine journal and e-health: the official journal of the American Telemedicine Association, vol. 20, no. 8, pp. 712–720, 2014.
View at: Publisher Site | Google Scholar
P. S. Whitten and J. D. Richardson, “A scientific approach to the assessment of telemedicine acceptance,” Journal of Telemedicine and Telecare, vol. 8, no. 4, pp. 246–248, 2002.
View at: Publisher Site | Google Scholar
L. Gill and L. White, “A critical review of patient satisfaction,” Leadership in Health Services, vol. 22, no. 1, pp. 8–19, 2009.
View at: Publisher Site | Google Scholar
R. Rozenblum, J. Donzé, P. M. Hockey et al., “The impact of medical informatics on patient satisfaction: A USA-based literature review,” International Journal of Medical Informatics, vol. 82, no. 3, pp. 141–158, 2013.
View at: Publisher Site | Google Scholar
I. H. Kraai, M. L. A. Luttik, R. M. De Jong, T. Jaarsma, and H. L. Hillege, “Heart failure patients monitored with telemedicine: Patient satisfaction, a review of the literature,” Journal of Cardiac Failure, vol. 17, no. 8, pp. 684–690, 2011.
View at: Publisher Site | Google Scholar
P. Whitten and B. Love, “Patient and provider satisfaction with the use of telemedicine: overview and rationale for cautious enthusiasm,” Journal of Postgraduate Medicine, vol. 51, no. 4, Article ID 16388172, pp. 294–300, 2005.
View at: Google Scholar
P. L. Hudak, P. McKeever, and J. G. Wright, “The metaphor of patients as customers: Implications for measuring satisfaction,” Journal of Clinical Epidemiology, vol. 56, no. 2, pp. 103–108, 2003.
View at: Publisher Site | Google Scholar
R. L. Oliver, “A cognitive model of the antecedents and consequences of satisfaction decisions,” Journal of Marketing Research, vol. 17, no. 4, p. 460, 1980.
View at: Publisher Site | Google Scholar
R. Oliver, Satisfaction, A Behavioral Perspective on the Consumer, M.E. Sharpe, Inc, Armonk, NY, USA, 2nd edition, 2010.
K. Diehl and C. Poynor, “Great expectations?! Assortment size, expectations, and satisfaction,” Journal of Marketing Research, vol. 47, no. 2, pp. 312–322, 2010.
View at: Publisher Site | Google Scholar
H. Ha, “An integrative model of consumer satisfaction in the context of e-services,” International Journal of Consumer Studies, vol. 30, no. 2, pp. 137–149, 2006.
View at: Publisher Site | Google Scholar
V. Mittal, W. T. Ross Jr., and P. M. Baldasare, “The asymmetric impact of negative and positive attribute-level performance on overall satisfaction and repurchase intentions,” Journal of Marketing, vol. 62, no. 1, pp. 33–47, 1998.
View at: Publisher Site | Google Scholar
S.-J. Yoon and J.-H. Kim, “An empirical validation of a loyalty model based on expectation disconfirmation,” Journal of Consumer Marketing, vol. 17, no. 2, pp. 120–136, 2000.
View at: Publisher Site | Google Scholar
A. Bhattacherjee and G. Premkumar, “Understanding changes in belief and attitude toward information technology usage: a theoretical model and longitudinal test,” MIS Quarterly: Management Information Systems, vol. 28, no. 2, pp. 229–254, 2004.
View at: Publisher Site | Google Scholar
A. Bhattacherjee, “Understanding information systems continuance: an expectation-confirmation model,” MIS Quarterly, vol. 25, no. 3, pp. 351–370, 2001.
View at: Publisher Site | Google Scholar
S. N. Kucukarslan and A. Nadkarni, “Evaluating medication-related services in a hospital setting using the disconfirmation of expectations model of satisfaction,” Research in Social & Administrative Pharmacy, vol. 4, no. 1, pp. 12–22, 2008.
View at: Publisher Site | Google Scholar
P. L. Hudak, S. Hogg-Johnson, C. Bombardier, P. D. McKeever, and J. G. Wright, “Testing a new theory of patient satisfaction with treatment outcome,” Medical Care, vol. 42, no. 8, pp. 726–739, 2004.
View at: Publisher Site | Google Scholar
B. L. Conner-Spady, C. Sanmartin, G. H. Johnston, J. J. McGurran, M. Kehler, and T. W. Noseworthy, “The importance of patient expectations as a determinant of satisfaction with waiting times for hip and knee replacement surgery,” Health Policy, vol. 101, no. 3, pp. 245–252, 2011.
View at: Publisher Site | Google Scholar
T. N. Cassidy-Smith, B. M. Baumann, and E. D. Boudreaux, “The disconfirmation paradigm: Throughput times and emergency department patient satisfaction,” The Journal of Emergency Medicine, vol. 32, no. 1, pp. 7–13, 2007.
View at: Publisher Site | Google Scholar
C. Koo, Y. Wati, K. Park, and M. K. Lim, “Website quality, expectation, confirmation, and end user satisfaction: the knowledge-intensive website of the korean national cancer information center,” Journal of Medical Internet Research, vol. 13, no. 4, p. e81, 2011.
View at: Publisher Site | Google Scholar
F. Mair and P. Whitten, “Systematic review of studies of patient satisfaction with telemedicine,” British Medical Journal, vol. 320, no. 7248, pp. 1517–1520, 2000.
View at: Publisher Site | Google Scholar
T. L. Williams, C. R. May, and A. Esmail, “Limitations of patient satisfaction studies in telehealthcare: A systematic review of the literature,” Telemedicine and e-Health, vol. 7, no. 4, pp. 293–316, 2001.
View at: Publisher Site | Google Scholar
J. J. Clarkson, E. R. Hirt, L. Jia, and M. B. Alexander, “When perception is more than reality: the effects of perceived versus actual resource depletion on self-regulatory behavior,” Journal of Personality and Social Psychology, vol. 98, no. 1, pp. 29–46, 2010.
View at: Publisher Site | Google Scholar
S. Jayaratne, D. Himle, and W. A. Chess, “Dealing with work stress and strain: is the perception of support more important than its use?” The Journal of Applied Behavioral Science, vol. 24, no. 2, pp. 191–202, 1988.
View at: Publisher Site | Google Scholar
M. S. Gaynor, S. A. Kleiner, and W. B. Vogt, “A structural approach to market definition with an application to the hospital industry,” The Journal of Industrial Economics, vol. 61, no. 2, pp. 243–289, 2013.
View at: Publisher Site | Google Scholar
A. Liberman and T. Rotarius, “Healthcare as a commodity – a financing mechanism to control costs and ensure access,” International Journal of Public Policy, vol. 1, no. 4, pp. 407–420, 2006.
View at: Publisher Site | Google Scholar
M. Grossman, Demand for Health: A Theoretical and Empirical Investigation, Columbia University Press, 2017.
View at: Publisher Site
M. Al-Amin, S. C. Makarem, and R. Pradhan, “Hospital ability to attract international patients: A conceptual framework,” International Journal of Pharmaceutical and Healthcare Marketing, vol. 5, no. 3, pp. 205–221, 2011.
View at: Publisher Site | Google Scholar
G. Mery, S. Majumder, A. Brown, and M. J. Dobrow, “What do we mean when we talk about the Triple Aim? A systematic review of evolving definitions and adaptations of the framework at the health system level,” Health Policy, vol. 121, no. 6, pp. 629–636, 2017.
View at: Publisher Site | Google Scholar
N. Lankton, D. H. McKnight, and J. B. Thatcher, “Incorporating trust-in-technology into Expectation Disconfirmation Theory,” The Journal of Strategic Information Systems, vol. 23, no. 2, pp. 128–145, 2014.
View at: Publisher Site | Google Scholar
R. Oliver and G. Linda, “Effect of satisfaction and its antecedents on consumer preference and intention,” Advances in Consumer Research, vol. 8, pp. 88–93, 1981.
View at: Google Scholar
R. M. Andersen, “Revisiting the behavioral model and access to medical care: does it matter?” Journal of Health and Social Behavior, vol. 36, no. 1, pp. 1–10, 1995.
View at: Publisher Site | Google Scholar
C. P. Wilkinson, F. L. Ferris III, R. E. Klein et al., “Proposed international clinical diabetic retinopathy and diabetic macular edema disease severity scales,” Ophthalmology, vol. 110, no. 9, pp. 1677–1682, 2003.
View at: Publisher Site | Google Scholar
V. Prakash and J. Lounsbury, “A reliability problem in the measurement of disconfirmation of expectations,” in Advances in Consumer Research, Association for Consumer Research, R. P. Bagozzi and A. M. Tybout, Eds., pp. 244–249, 10th edition, 1983.
View at: Google Scholar
J. S. Armstrong and T. S. Overton, “Estimating non-response bias in mail surveys,” Journal of Marketing Research, vol. 14, no. 3, pp. 396–402, 1977.
View at: Publisher Site | Google Scholar
C. Ringle, S. Wende, and A. Will, “Germany,” http://www.smartpls.de [access date October 1, 2013]. Archived by WebCite® at http://www.webcitation.org/6TZXW1Ejp, 2005.
View at: Google Scholar
V. E. Vinzi, W. W. Chin, J. Henseler, and H. Wang, Handbook of Partial Least Squares, Springer Handbooks of Computational Statistics, Springer, Berlin, Germany, 2010.
View at: Publisher Site | MathSciNet
W. W. Chin, “The partial least squares approach to structural equation modeling,” Modern Methods for Business Research, vol. 295, no. 2, pp. 295–336, 1998.
View at: Google Scholar
J. Henseler and G. Fassott, “Testing moderating effects in PLS path models: An illustration of available procedures,” in Handbook of Partial Least Squares, pp. 713–735, Springer, Berlin Heidelberg, 2010.
View at: Google Scholar
J. Y. Hwang, K. Y. Kim, and K. H. Lee, “Factors that influence the acceptance of telemetry by emergency medical technicians in ambulances: An application of the extended technology acceptance model,” Telemedicine and e-Health, vol. 20, no. 12, pp. 1127–1134, 2014.
View at: Publisher Site | Google Scholar
I. Corp, IBM SPSS Statistics for Windows, IBM Corp, Armonk, NY, USA, 2011.
P. S. Whitten and F. Mair, “Telemedicine and patient satisfaction: current status and future directions,” Telemedicine and e-Health, vol. 6, no. 4, pp. 417–423, 2000.
View at: Publisher Site | Google Scholar
T. H. Wroth and D. E. Pathman, “Primary medication adherence in a rural population: The role of the patient-physician relationship and satisfaction with care,” Journal of the American Board of Family Medicine, vol. 19, no. 5, pp. 478–486, 2006.
View at: Publisher Site | Google Scholar
D. E. Morisky, A. Ang, M. Krousel-Wood, and H. J. Ward, “Predictive validity of a medication adherence measure in an outpatient setting,” The Journal of Clinical Hypertension, vol. 10, no. 5, pp. 348–354, 2008.
View at: Publisher Site | Google Scholar
B. C. Sun, J. Adams, E. J. Orav, D. W. Rucker, T. A. Brennan, and H. R. Burstin, “Determinants of patient satisfaction and willingness to return with emergency care,” Annals of Emergency Medicine, vol. 35, no. 5, pp. 426–434, 2000.
View at: Publisher Site | Google Scholar
D. Staples, I. Wong, and P. B. Seddon, “Having expectations of information systems benefits that match received benefits: does it really matter?” Information & Management, vol. 40, no. 2, pp. 115–131, 2002.
View at: Publisher Site | Google Scholar
N. Luo, C. G. Chapman, B. K. Patel, J. N. Woodruff, and V. M. Arora, “Expectations of ipad use in an internal medicine residency program: Is it worth the hype?” Journal of Medical Internet Research, vol. 15, no. 5, article no. e88, 2013.
View at: Publisher Site | Google Scholar
A. E. de Vries, M. H. van der Wal, M. M. Nieuwenhuis et al., “Health professionals' expectations versus experiences of internet-based telemonitoring: survey among heart failure clinics,” Journal of Medical Internet Research, vol. 15, no. 1, p. e4, 2013.
View at: Publisher Site | Google Scholar
T. Oshagbemi, “Overall job satisfaction: How good are single versus multiple-item measures?” Journal of Managerial Psychology, vol. 14, no. 5, pp. 388–403, 1999.
View at: Publisher Site | Google Scholar
V. Scarpello and J. P. Campbell, “Job satisfaction: are all the parts there?” Personnel Psychology, vol. 36, no. 3, pp. 577–600, 1983.
View at: Publisher Site | Google Scholar
R. E. Lucas and M. B. Donnellan, “Estimating the reliability of single-item life satisfaction measures: results from four national panel studies,” Social Indicators Research, vol. 105, no. 3, pp. 323–331, 2012.
View at: Publisher Site | Google Scholar
L. Bergkvist and J. R. Rossiter, “The predictive validity of multiple-item versus single-item measures of the same constructs,” Journal of Marketing Research, vol. 44, no. 2, pp. 175–184, 2007.
View at: Publisher Site | Google Scholar
M. S. Nagy, “Using a single-item approach to measure facet job satisfaction,” Journal of Occupational and Organizational Psychology, vol. 75, no. 1, pp. 77–86, 2002.
View at: Publisher Site | Google Scholar
C. L. Dolbier, J. A. Webster, K. T. McCalister, M. W. Mallon, and M. A. Steinhardt, “Reliability and validity of a single-item measure of job satisfaction,” American Journal of Health Promotion, vol. 19, no. 3, pp. 194–198, 2005.
View at: Publisher Site | Google Scholar
J. P. Wanous, A. E. Reichers, and M. J. Hudy, “Overall job satisfaction: how good are single-item measures?” Journal of Applied Psychology, vol. 82, no. 2, pp. 247–251, 1997.
View at: Publisher Site | Google Scholar
S. Emani, M. Healey, D. Y. Ting et al., “Awareness and use of the after-visit summary through a patient portal: evaluation of patient characteristics and an application of the theory of planned behavior,” Journal of Medical Internet Research, vol. 18, no. 4, p. e77, 2016.
View at: Publisher Site | Google Scholar
Y. M. Chae, J. H. Lee, S. H. Ho, H. J. Kim, K. H. Jun, and J. U. Won, “Patient satisfaction with telemedicine in home health services for the elderly,” International Journal of Medical Informatics, vol. 61, no. 2-3, pp. 167–173, 2001.
View at: Publisher Site | Google Scholar
L. Edwards, C. Thomas, A. Gregory et al., “Are people with chronic diseases interested in using telehealth? A cross-sectional postal survey,” Journal of Medical Internet Research, vol. 16, no. 5, p. e123, 2014.
View at: Publisher Site | Google Scholar
J. R. Rossiter, “The C-OAR-SE procedure for scale development in marketing,” International Journal of Research in Marketing, vol. 19, no. 4, pp. 305–335, 2002.
View at: Publisher Site | Google Scholar
C. Fuchs and A. Diamantopoulos, “Using single-item measures for construct measurement in management research,” Die Betriebswirtschaft, vol. 69, no. 2, pp. 195–210, 2009.
View at: Google Scholar
M. Zimmerman, C. J. Ruggero, I. Chelminski et al., “Developing brief scales for use in clinical practice: the reliability and validity of single-item self-report measures of depression symptom severity, psychosocial impairment due to depression, and quality of life,” Journal of Clinical Psychiatry, vol. 67, no. 10, pp. 1536–1541, 2006.
View at: Publisher Site | Google Scholar
D. Griffin, S. Murray, and R. Gonzalez, “Difference score correlations in relationship research: A conceptual primer,” Personal Relationships, vol. 6, no. 4, pp. 505–518, 1999.
View at: Publisher Site | Google Scholar
D. Chan, “Data analysis and modeling longitudinal processes,” Group & Organization Management, vol. 28, no. 3, pp. 341–365, 2016.
View at: Publisher Site | Google Scholar
D. Rogosa, D. Brandt, and M. Zimowski, “A growth curve approach to the measurement of change,” Psychological Bulletin, vol. 92, no. 3, pp. 726–748, 1982.
View at: Publisher Site | Google Scholar
D. R. Thomas and B. D. Zumbo, “Difference scores from the point of view of reliability and repeated-measures ANOVA: In defense of difference scores for data analysis,” Educational and Psychological Measurement, vol. 72, no. 1, pp. 37–43, 2012.
View at: Publisher Site | Google Scholar
F. Verhoeven, K. Tanja-Dijkstra, N. Nijland, G. Eysenbach, and L. van Gemert-Pijnen, “Asynchronous and synchronous teleconsultation for diabetes care: a systematic literature review,” Journal of Diabetes Science and Technology, vol. 4, no. 3, pp. 666–684, 2010.
View at: Publisher Site | Google Scholar
A. Bhattacherjee and C. Sanford, “The intention-behaviour gap in technology usage: The moderating role of attitude strength,” Behaviour & Information Technology, vol. 28, no. 4, pp. 389–401, 2009.
View at: Publisher Site | Google Scholar
M. J. Carrington, B. A. Neville, and G. J. Whitwell, “Why ethical consumers don't walk their talk: Towards a framework for understanding the gap between the ethical purchase intentions and actual buying behaviour of ethically minded consumers,” Journal of Business Ethics, vol. 97, no. 1, pp. 139–158, 2010.
View at: Publisher Site | Google Scholar
E. Boulstridge and M. Carrigan, “Do consumers really care about corporate responsibility? Highlighting the attitude—behaviour gap,” Journal of Communication Management, vol. 4, no. 4, pp. 355–368, 2000.
View at: Publisher Site | Google Scholar
B. Lane and S. Potter, “The adoption of cleaner vehicles in the UK: exploring the consumer attitude-action gap,” Journal of Cleaner Production, vol. 15, no. 11-12, pp. 1085–1092, 2007.
View at: Publisher Site | Google Scholar
R. E. Rhodes and G.-J. De Bruijn, “How big is the physical activity intention-behaviour gap? A meta-analysis using the action control framework,” British Journal of Health Psychology, vol. 18, no. 2, pp. 296–309, 2013.
View at: Publisher Site | Google Scholar
Y. J. Choi and H. J. Ra, “Patient satisfaction after total knee arthroplasty,” Surgery & Related Research, vol. 28, no. 1, 2016.
View at: Google Scholar
R. Wootton, “Twenty years of telemedicine in chronic disease management—an evidence synthesis,” Journal of Telemedicine and Telecare, vol. 18, no. 4, pp. 211–220, 2012.
View at: Publisher Site | Google Scholar
G. T. Petito, “The evolution of telemedicine in eye care,” Advances in Ophthalmology and Optometry, vol. 2, no. 1, pp. 1–14, 2017.
View at: Publisher Site | Google Scholar
J. W. Mcgillicuddy, A. K. Weiland, R. M. Frenzel et al., “Patient attitudes toward mobile phone-based health monitoring: Questionnaire study among kidney transplant recipients,” Journal of Medical Internet Research, vol. 15, no. 1, article no. e6, 2013.
View at: Publisher Site | Google Scholar
M. Price, D. Williamson, R. McCandless et al., “Hispanic migrant farm workers' attitudes toward mobile phone-based telehealth for management of chronic health conditions,” Journal of Medical Internet Research, vol. 15, no. 4, p. e76, 2013.
View at: Publisher Site | Google Scholar
E. Seto, K. J. Leonard, C. Masino, J. A. Cafazzo, J. Barnsley, and H. J. Ross, “Attitudes of heart failure patients and health care providers towards mobile phone-based remote monitoring,” Journal of Medical Internet Research, vol. 12, no. 4, p. e55p.10, 2010.
View at: Publisher Site | Google Scholar
V. Mohan, M. Deepa, R. Pradeepa et al., “Prevention of diabetes in rural India with a telemedicine intervention,” Journal of Diabetes Science and Technology, vol. 6, no. 6, pp. 1355–1364, 2012.
View at: Publisher Site | Google Scholar
C. L. Lowery, J. M. Bronstein, T. L. Benton, and D. A. Fletcher, “Distributing medical expertise: The evolution and impact of telemedicine in Arkansas,” Health Affairs, vol. 33, no. 2, pp. 235–243, 2014.
View at: Publisher Site | Google Scholar
T. M. Petitte, G. L. Narsavage, Y.-J. Chen, C. Coole, T. Forth, and K. D. Frick, “Feasibility study: Home telemonitoring for patients with lung cancer in a mountainous rural area,” Oncology Nursing Forum, vol. 41, no. 2, pp. 153–161, 2014.
View at: Publisher Site | Google Scholar
L. Siminerio, K. Ruppert, K. Huber, and F. G. Toledo, “Telemedicine for reach, education, access, and treatment (TREAT): Linking telemedicine with Diabetes self-management education to improve care in rural communities,” The Diabetes Educator, vol. 40, no. 6, pp. 797–805, 2014.
View at: Google Scholar

Copyright

Copyright © 2018 Christina I. Serrano et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

10710

Downloads

2091

Citations