Antecedents of Intention to Adopt Mobile Health (mHealth) Application and Its Impact on Intention to Recommend: An Evidence from Indonesian Customers

Octavius, Gilbert Sterling; Antonio, Ferdi

doi:https://doi.org/10.1155/2021/6698627

International Journal of Telemedicine and Applications

On this page

Abstract Introduction Methods Results Discussion Limitations Conclusions Appendix Data Availability Conflicts of Interest References Copyright Related Articles

Research Article | Open Access

Volume 2021 | Article ID 6698627 | https://doi.org/10.1155/2021/6698627

Antecedents of Intention to Adopt Mobile Health (mHealth) Application and Its Impact on Intention to Recommend: An Evidence from Indonesian Customers

Gilbert Sterling Octavius¹and Ferdi Antonio²

Academic Editor: Joel Colloc

Received06 Dec 2020

Revised29 Jan 2021

Accepted15 Apr 2021

Published30 Apr 2021

Abstract

Introduction. Mobile health (mHealth) applications gain popularity due to the increasing number of mobile phone usage and internet penetration, which might help some of Indonesia’s medical issues. However, the uptake of mHealth applications is still low in Indonesia. This study is aimed at understanding the factors that drive individuals to adopt mHealth applications and their impact on the intention to recommend. Methods. We applied a new model that combines three different theories with some other constructs: an extended unified theory of acceptance and use of technology, diffusion of innovation, and the internet customer trust model. The study used a cross-sectional study design with partial least squares causal modeling approach. Results. There are 787 respondents in our study, with the majority of them being female, young adults. Our model could explain 53.2% of the variance of intention to adopt while explaining 48.3% of the variance of intention to recommend. Initial trust in mHealth platform (, ), facilitating conditions (, ), and performance expectancy (, ) are the top three most important drivers of intention to adopt mHealth applications. Lastly, importance-performance map analysis (IPMA) showed that the mHealth application’s initial trust is the most important construct with a high-performance score. Discussion. Mobile health developers and managers need to improve initial trust in the mHealth platform, facilitating conditions, and performance expectancy when developing the applications. With a medium , these factors can be applied out of the research context with medium predictive power.

1. Introduction

As the biggest archipelago, Indonesia has more than 13,000 islands, resulting in the unequal distribution of medical professionals on each island. World Health Organization recommends one doctor per 1000 citizens, while Indonesia has a ratio of 1 doctor per 3333 citizens. This results in Indonesia having the lowest doctors’ ratio to Southeast Asia [1]. There is also a shift in Indonesia’s disease patterns, where noncommunicable diseases (NCDs) are more prominent than communicable diseases. Better hygiene and access to healthcare and a more sedentary lifestyle are responsible for increasing NCDs from 37% in 1990 to 57% in 2015. It is estimated that it will cost Indonesia about $4.47 trillion (or $17,863 per capita) due to NCDs from 2012 through 2030, with cardiovascular disease accounting for 39.6% of the total loss of gross domestic product (GDP) output [2].

There are other challenges in accessing healthcare for Indonesians, such as the medical cost. The Center of National Statistics stated that in March 2019, 9.41% of Indonesians are in poverty, and families who are in poverty have 4.68 people in each house on average. Looking at the average spending of a poverty-stricken family, they spend Rp 425.250 per capita per month or equals roughly $26 per capita per month [3]. The lowest tier of national insurance costs Rp 28.000 ($1.94) per person. Therefore, each household has to dole out Rp 112.000 ($7.75) each month, or roughly 26% of their income each month for a family with four people. This causes a low uptake in national insurance applications among the poor, who need the insurance the most [4].

Other costs that plague healthcare issues in Indonesia include unaffordable hospital charges and medicine. As of 2005, the estimated cost per day for a primary hospital is around $30.36, while the estimated cost per outpatient visit is $9.25 for a primary hospital. These costs do not include drugs and diagnostic testings [5]. Lastly, 216 drugs on the National Essential Medicines List (EML) are not subjected to price controls. The median price ratio for public-sector procurement of the lowest-priced generic medications was 1.74 (74% higher than the international reference price). For most-sold generics, the median price ratio was 1.44 higher [6]. The tremendous cost of healthcare in Indonesia means that the prevention of disease is much more critical.

The rapid growth of changing technologies, especially in the digital innovation sector, has brought massive medical practice changes. Information and communication technologies (ICTs) have been implemented to assist, deliver healthcare services, or serve as a make-shift alternative for consultations during the COVID-19 pandemic [7]. Advances in technology have allowed medical practitioners and patients to benefit from a broad range of new health-related features from their mobile phones. In Indonesia, some of the essential benefits are but are not limited to the following: emergency response and disaster management, disease surveillance, support for clinicians’ decisions in the place of care, and remote monitoring and patient care [8, 9]. In Indonesia, mHealth applications can promote health literacy, encouraging a more balanced lifestyle, prevention, control, and management of chronic diseases [10–12]. Besides the increasing prevalence of NCDs mentioned above, promoting health literacy is needed in Indonesia. As compared to other countries, Indonesia still has a low health literacy despite the advancement of technology [13, 14].

Mobile health applications are defined as tools that assist in medicine and public health via mobile devices. Mobile communication devices, such as cellphones, tablet computers, personal digital assistants (PDAs), and wearable devices, such as smart watches, are widely used for health care, information, and data collection [15]. One attributed reason for the rise of mobile health (mHealth) is the ubiquity of wireless technology. This is reflected by the increase in fiber optic backbone cable network length from 76,700 kilometers in 2014 to 164,769 kilometers in 2019 [16]. There are 175.4 million active internet users in Indonesia, which equals 64% internet penetration in January 2020, while mobile phone connectivity rises by 4.6% to 338.2 million users from January 2019 to January 2020. This mobile phone connectivity alone equals 124% of the total Indonesian population [17]. The “mobile leapfrogging” phenomenon is where new internet users use their mobile phones to access the internet and not personal computers. More than 78% of Indonesians use their mobile phones to access the internet, in contrast to 29% laptop or notebook users and 31% desktop computer users [18]. Increasing internet penetration and increasing mobile phone use allow more users to access mobile applications, especially mHealth applications. However, an initial survey in 2018 had shown that 67.6% out of 102 respondents had not tried any mHealth applications [19], while a more recent survey in 2020 showed that only 52% of Indonesians (out of 102 respondents) are using mHealth applications [20]. In Indonesia, there are only seven mHealth applications that are government-based, while there are 18 mHealth applications from the private sector. This number is increasing rapidly in the private sector, while this does not apply to the private sectors, indicating difficulties and challenges the governments face to expand mHealth application use [19].

Intention to use a specific technology influences technology’s actual use [21]. A better understanding of factors that influence the intention to adopt mHealth applications will help developers improve and promote their use. However, such studies are scarce in Indonesia [22]. Only a few studies are made relating to health and information technology and the subsequent individual adoption models. Among that literature, the majority are focused on the healthcare professionals’ use of mHealth technologies and not on the patients’ perspectives [23]. While these studies are not prevalent, some studies have attempted to elucidate factors influencing patients to adopt mHealth, and the summary of several studies can be seen in Table 1.

The reason for conducting this study is a mixture of all of the reasons above. Poor healthcare access, coupled with increasing NCDs, might be alleviated by the use of ICTs. In the COVID-19 era, the utilization of ICTs is increasing, and an ever-increasing number of smartphone users helps this. However, despite all of these, the adoption of mHealth applications is still shallow. Although the government and Indonesian healthcare organizations are revamping their telemedicine policies, including mHealth applications due to the COVID-19 pandemic, this effort is still in the very early phase, with minimal progress desired. Therefore, this study is aimed at finding out why the adoption of mHealth is still low and gives suggestions to managers and mHealth developers on how to increase the use of mHealth.

A specific theoretical model needs to be developed and tested for different mHealth technologies in different user groups and settings to provide a better context-related understanding of technology adoption [21]. Analyzing the adoption of mHealth in the Indonesian population is necessary due to the low adoption number of mHealth applications despite the ubiquitous mobile phone users. This study is aimed at understanding the factors that influence the intention to adopt and its impact on the intention to recommend mHealth applications. We apply the extended unified theory of acceptance use and technology (UTAUT2), diffusion of innovation (DOI), and internet customer trust model with some modifications. Other constructs are included to propose a model to explain individuals’ intention to adopt and intention to recommend mHealth applications, from the patient’s point of view as well as the IT developers.

2. Theoretical Background

2.1. Unified Theory of Acceptance and Use of Technology (UTAUT2)

Venkatesh et al. [21] constructed UTAUT as a comprehensive synthesis from multiple studies about technology acceptance amongst users. Eight theories were combined to form UTAUT, which include the theory of reasoned action (TRA), technology acceptance model (TAM), motivational model (MM), the theory of planned behaviour (TPB), combined TAM and TPB (C-TAM-TPB), the model of PC utilization (MPCU), innovation diffusion theory (IDT), and social cognitive theory (SCT). This theory incorporates four primary constructs, which are performance expectancy (also known as perceived usefulness (PU) in the previous model), effort expectancy (also known as perceived ease of use (PEOU) in the previous model), social influence, and facilitating conditions. With this modified model, the obtained value outperformed any individual models previously studied [21].

However, UTAUT focuses more on employee technology acceptance at the individual level and might not be suitable for mHealth applications. The model is then extended to study acceptance and use of technology in a consumer-based context [24]. Three constructs were added to the original model: hedonic motivation, price value, and habit. The constructs were moderated by age, gender, and experience only while dropping voluntariness of use as this construct does not fit into the target population studied for this model. Widely known as UTAUT2, this model performed better in explaining behavioural intention (from 56% to 74%) and technology use (from 40% to 52%) [24]. Some modifications are needed in order to incorporate UTAUT2 into this study. Consumers do not use mHealth applications for the intention of enjoyment but for particular purposes such as searching for trusted medical information, finding the best hospitals, and over the counter medicine delivery to their own houses. Tavares et al. [25] did not find an association between motivation and behavioural intention, while Bossen et al. [26] found that intrinsic motivation to use self-management tools is superior to extrinsic motivation, such as the perception of others. Therefore, in this study, we did not incorporate hedonic motivation and social influence from the constructs of UTAUT2. We decided to incorporate effort expectancy, performance expectancy, price value, facilitating condition, and intention to adopt from this construct.

2.2. Diffusion of Innovation (DOI)

Rogers developed this theory in 1995. It became one of the popular theories to explain the adoption of information technology (IT) and better understand how IT innovation spreads with indicators that are more accurate in indicating consumer behavior within and between communities [27]. Diffusion is defined as a process in which information about innovation flows within a community from one person to another. On the other hand, innovation is an idea, process, or technology that is considered novel to people within a particular community [28]. Although innovativeness was initially thought of as a moderator, this variable became a direct determinant of PU and PEOU [21]. Chew et al. [29] used the DOI theory to examine the use of the internet of healthcare services by family doctors, while Lee [30] conducted a qualitative study using Rogers and Singhal’s theory to investigate the adoption of the computerized nursing care plan (CNCP) by nurses in Taiwan. Both studies reported that DOI is a significant predictor of mHealth technologies’ adoption [29, 30]. Therefore, Rogers’ innovation theory helps conceptualize technology adoption in a mHealth context. This study uses DOI as a theoretical framework to examine and explain the influence of innovation on patients’ adoption of mHealth applications.

2.3. Social Media Brand Communication Theory

Beuker and Abbing [31] first developed this theory, which included firm-generated content (FGC) as one of the variables. In this study, the firm-generated content is understood as a form of content creations that the company fully controlled in their official webpages or social media [32]. Following the growth of the internet and mobile phone users, social media and the internet have become popular platforms for both users and customers to find helpful information about products, services, and other related information [33]. To our best knowledge, this study will be the first to incorporate FGC as a variable in assessing customers’ intention to adopt mHealth applications.

2.4. Internet Customer Trust Model

Jarvenpaa et al. [34] pioneered the trust theory concerning behavioural intention. In the context of medical services, a patient’s trust is defined as a set of beliefs regarding a doctor’s behaviour based on the expectations set by former doctor’s expertise, compassion, privacy, confidentiality, and reliability [35]. Trust is required between a patient and a doctor in order to achieve a mutual goal. Although some authors argue that trust is built regarding time, other researchers found a strong correlation between initial trust and behavioural intention. Customers mostly base their first intention on initial trust, especially on their first interaction [36].

In the mHealth context, initial trust consists of two main components: initial trust in the doctor and initial trust in mHealth platform. Doctors are the primary care provider, while mHealth platform is the media where online healthcare services are implemented. Initial trust in doctor is associated with the doctor’s information quality and interaction quality, while initial trust in mHealth platform is associated with its services. Cao et al. [37] found that both initial trust in the doctor and initial trust in mHealth platform are significant predictors of intention to adopt mHealth. Hence, both initial trust in the doctor and initial trust in mHealth platforms are incorporated in this study.

2.5. Information Seeking Motive

Increased penetration of the internet has changed the way people search for their information, especially health-related issues. One survey done in Indonesia shows that mHealth users utilize their application to search for health-related information (51.06%), while only 14.05% use it to consult with health professionals [19]. Another survey also shows that 59% of patients expect mHealth to change how they seek health issues [38]. The mobile phone is a convenient measure for consumers to seek health information. Given the personal nature of ownership, mobile phones provide a safe and confidential way of seeking health information. Niederdeppe et al. [39] define information-seeking motive as consumers’ active efforts to obtain specific information in response to a relevant event through the internet via website or applications. Deng et al. [40] found that health information usage is closely related to seeking behaviour intention in the mobile context. Therefore, this study includes information-seeking motive as another proposed factor that might affect the intention to adopt mHealth.

2.6. Perceived Technology Security

As transactions occur digitally through mHealth, information security concerns the consumers’ perceptions about the platform’s inability to safeguard financial or other important data about the consumers [41]. Therefore, this construct analyzes the potential feelings of uncertainty in adopting a particular technology [42]. Previous studies have shown that security concerns are barriers to adopting technologies where transaction and financial information is stored and managed [21, 42].

2.7. Perceived Privacy Risk

Raymond A. Bauer was the first to introduce the concept of privacy risk. He believed that every single action that one takes might cause unwanted consequences. The undesirable or unexpected aspect of this variable is that the individual cannot control this risk and harm the individual, which is called the risk due to an individual’s actions [43]. Therefore, perceived risk refers to one’s perception of uncertainty in the use of mHealth services and its consequences [44]. Although the perceived risk is mainly studied in business research, it is increasingly applied in healthcare sectors such as implementing electronic health records [45] and wearable medical devices [46]. In this study, only perceived privacy risk will be included as Deng et al. [40] found that perceived privacy risks and performance risk negatively correlated with the patients’ trust and adoption intention towards mHealth services. As performance risk’s definition is somewhat similar to performance expectancy, we decided not to include performance risk in this study (Deng et al. [40].

2.8. Intention to Adopt and Intention to Recommend

Intention may be described as how hard people are willing to try and how much determination they want to behave. As a result, intention to adopt refers to a person’s subjective likelihood of engaging in a particular action [47], while the intention to recommend can be interpreted as a metric to measure how powerful a person desires to suggest mHealth applications to others [48]. Intention to adopt new technologies is an accurate predictor of consumer adoption rates in various contexts. They can be used to evaluate behavioral outcomes [49–51]. Measuring willingness to consider new technology can thus be viewed as a valuable way to assess the system’s future performance. It is thus fundamental to our research and a key dependent variable in our conceptual framework.

Meanwhile, in the literature on mHealth applications, the intention to recommend variables has never been studied [52]. This variable has only been used to justify the adoption of mobile payments [53], electronic medical record portals [25], and fitness wearable [54]. Providers of this form of technology begin to rely on existing or future customers to spread the word about it [53]. However, because of the disproportionate focus on technology use, the intention to recommend has been overlooked by researchers [54]. We understand that word of mouth is an essential medium for disseminating information about technology. Acceptance of technology is no longer strictly a personal option. Social media sites and other online platforms have opened up new channels for the influential transmission of attitudes and even behaviors. Therefore, this research studies intend to recommend the second key dependent variable together with the intention to adopt.

We chose DOI, UTAUT2, and internet customer trust model as the main framework as DOI and UTAUT2 have been extensively studied in the adoption and recommendation of information technology, including mHealth applications [25, 48]. Internet customer trust model is chosen as the last main framework because initial trust is still a relatively new concept to be studied. Previous studies also indicate that initial trusts play a substantial and significant role in affecting mHealth applications’ adoption [37]. These three models provide a robust explanatory power to adopt in their respective research [25, 37, 48]. Therefore, these three hypotheses focus on this study as the authors expect these three theories to be the major drivers of adoption and recommendation of mHealth.

2.9. Research Hypotheses

Innovativeness is defined as one’s willingness to try every new technology [55]. Rogers and Shoemaker [56] conceptualized an individual as an innovator if they are an early adopter. Innovativeness had been proven as a significant predictor of behavioural intention to adopt new technology [57] and also as an antecedent for compatibility, performance expectancy, and effort expectancy [53]. Thus, we pose the following hypotheses: (H1)Innovativeness positively influences the intention to adopt mHealth applications(H2)Users with a higher level of innovativeness have a higher level of compatibility(H3)Users with a higher level of innovativeness have a higher level of performance expectancy(H4)Users with a higher level of innovativeness have a higher level of effort expectancy.

Compatibility measures the extent to which an innovation is deemed in line with the value of the current consumer lifestyle and current and past experiences [28]. Users will regard that technology is compatible if it is beneficial for them. It has been shown that compatibility is a direct predictor of behavioural intention to adopt new technology and reinforce performance expectancy and effort expectancy. Thus, we propose the following hypotheses: (H5)Compatibility positively influences the intention to adopt mHealth applications(H6)Users with a higher level of compatibility have a higher level of performance expectancy(H7)Users with a higher level of compatibility have a higher level of effort expectancy.

Performance expectancy refers to the degree of benefits obtained by the user in adopting new technology [24]. Several studies found that performance expectancy consistently has a significant effect on behavioural intention [21, 58]. Patients tend to use mHealth because it is useful for them [59]. Thus, we pose the following hypothesis: (H8)Performance expectancy positively influences the intention to adopt mHealth applications.

Effort expectancy refers to the degree of convenience associated with users’ technology [24]. Studies have shown that effort expectancy is a predictor of intention to adopt a new technology [60, 61]. If users find mHealth technology easy to operate, they will have a higher intention to use it [24, 25, 48]. Increased operability also heightens users’ expectations towards acquiring the desired performance for that technology [21]. This finding is also strengthened by other studies which elucidated that performance expectancy was predicted by effort expectancy [62, 63]. Thus, we propose the following hypothesis: (H9)Effort expectancy positively influences performance expectancy(H10)Effort expectancy positively influences the intention to adopt mHealth applications.

Dodds et al. [64] define price value as the trade-off perceived cognitively by consumers that consider the perceived benefits of applications and the monetary costs of using them. Empirical evidence confirms that consumers are more likely to adopt services with reasonable price values at a relatively low cost [53, 65]. Also, there is a significant relationship between price and new technology adoption [24]. Therefore, we pose the following hypothesis: (H11)Price value positively influences the intention to adopt mHealth applications.

In this study, facilitating condition is defined as the extent to which patients or users perceive that there is an adequate technical infrastructure to support the use of network-based healthcare application services and resources that offer the necessary knowledge using network-based healthcare application services [21, 66]. Patients are more likely to consider telemedicine services to be the best way for their disease management if the system has a robust infrastructure. Several studies related to mHealth applications suggest that facilitating condition impacts intention to adopt directly [63, 67]. Thus, we propose the following hypothesis: (H12)Facilitating conditions positively influence the intention to adopt mHealth applications.

Information-seeking motive is defined as the purposive search for information due to the need to fulfill specific goals [68]. With the fast-paced improvement in connectivity and mobile phones, they offer an alternative to getting prompt laboratory test results, medical knowledge, information about diseases, and the latest treatments. mHealth users who wish to know about their conditions or treatments are more likely to accept the technology and use it [40, 45, 69]. Thus, we propose the following hypothesis: (H13)Information-seeking motive positively influences the intention to adopt mHealth applications.

Firm-generated content is any form of content (written, audio, visual, and combined) created by marketers on social media channels [70]. Once a consumer is aware of several markets’ choices, they will choose to include that brand into the list of their choices [71]. At this stage, the marketing communication tries to positively differentiate the brand from its competitors by highlighting its attractive features and getting positive feedback from customers. As firm-generated contents have a higher perceived and more trusted source expertise, customers tend to trust their contents [72]. For users who emphasize the source of expertise, the firm-generated content will have a strong and positive impact on intention to use a particular technology. In this case, the firms studied have similar marketing and firm-generated contents, and thus, comparisons can still be made reliably (see data collection). Therefore, we propose the following hypothesis: (H14)Firm-generated content positively influences the intention to adopt mHealth applications.

In the mHealth context, privacy risk refers to the possibility of information abuse due to mHealth services, such as information theft and leakage [73]. Personal health information, such as sex-transmitted infections, mental health issues, drug abuse, genetic information, and sexual preference, is a much more sensitive subject than other information such as age and address [74]. A potential mHealth user might not want to adopt the application if they feel that their privacy is being threatened. Thus, we propose the following hypothesis: (H15)Perceived privacy risk negatively influences the intention to adopt mHealth applications.

Perceived security is defined as the level of trust in the internet to transmit sensitive information [41]. Security breaches are thought to prevent consumers from accessing sensitive information online significantly. Security breaches also apply to cellular lines and significantly affect cellular adoption rates [75]. Security remains the most significant concern facing internet banking adoption due to the possibility of data leakage or theft by hackers, for example. This phenomenon has been reflected in many studies where security is one of the most critical barriers faced in cellular acceptance and growth [76, 77]. If a potential mHealth user feels secure in assessing the application, there will be an increased possibility of adopting mHealth application. Therefore, we propose the following hypothesis: (H16)Perceived security positively influences the intention to adopt mHealth applications.

Initial trust is a vital acceptance influence factor. Previous researches have examined initial trust mechanisms to reduce uncertainty in technology acceptance and the context of use [78, 79]. Research shows that users usually determine whether to adopt this service based on trust evaluation if a new service carries uncertainties or potential risk. Since much of the technology is unknown, initial trust plays an essential role in eliminating the risks and uncertainties in interactions [78]. A significant positive relationship between initial trust and use intention has been verified in previous researches [37, 78, 80]. Compared to traditional health services, health services delivered on the mobile internet involve more uncertainties and risks. So, initial trust in mHealth providers, including doctors and platforms, is essential for users to adopt a decision. Thus, we propose the following hypotheses: (H17)Initial trust in doctor positively influences the intention to adopt mHealth applications(H18)Initial trust in mHealth platform positively influences the intention to adopt mHealth applications.

Consumers with a greater intention to adopt new technology are more likely to become users and recommend the technology to others [53]. With sensitive topics and topics related to health, there is often a mismatch between intention and effective action [81]. Thus, it is very relevant to measure how behavioural intention to use and user behaviour can influence the intention to recommend using health-based applications. Intention to recommend is important to be included in this study because it gives an insight into the application developers on what should be improved or maintained to enhance the applications’ performance. Hence, we pose the following hypothesis: (H19)Intention to adopt positively influences the intention to recommend mHealth applications.

The 19 research hypotheses are summarized in the research model (Figure 1).

3. Methods

3.1. Survey Instrument Design

All survey items were adopted from studies regarding health information technology except for firm-generated content with some minor changes. Perceived security in this study refers to the transaction process in the mHealth application. The questionnaire items (Table 2) were first forward-translated from English to Indonesian by a certified, expert translator who is an expert in English and Indonesian languages. A panel of experts then reviewed the translated questionnaire, and some modifications took place to adjust and smoothen the translation. Another certified expert translator did the backward translation from the revised Indonesian questionnaire to English to ensure that the content did not lose its original meaning [82]. The items were measured with a 5-point Likert scale ranging from “strongly disagree” (1) to “strongly agree” (5). A preliminary test was done on ten respondents (five males and five females) who used mHealth applications before. Context-specific adjustments were then made to suit the adoption criteria of mHealth application. We performed a pilot test on 30 respondents to identify other issues and further improve the study. The data from those 40 respondents were not included in this study.

3.2. Data Collection

This study uses a cross-sectional study design. Our inclusion criteria include adult users’ target population (above 18 years old) who had used mHealth applications at least once in the past year. This study’s exclusion criteria are users who access the application via other gadgets (laptops or tablets). Due to the COVID-19 pandemic, data were collected using Google Forms from September 31 to October 15, 2020. We sent the survey link to healthcare providers, friends, and colleagues, who then shared the survey link through their contacts network (snowballing technique). At the beginning of the survey, we described the purpose of the questionnaire and explained mHealth applications’ definition, and informed consents were then obtained. After that, the respondents will fill up three questionnaires that serve as the determinant for them to be included or excluded in our studies. The questions concern their age, gadgets used to access the application, and previous use of mHealth applications. If respondents are below 18 years old, access the applications via any other gadgets except mobile phones, or had never used mHealth applications before, they are excluded from the study. The questionnaires are self-filled, and one email address could only complete the form once.

There are only two Indonesian mHealth applications used in this study, and those are Halodoc© and Alodokter©. These two applications are used for the following reasons: (1) They are the two most prominent mHealth applications in Indonesia currently, and hence, comparisons can be made [83, 84]; and (2) they have similar social media activities, website performance, and several application downloads; hence, the variable user-generated content can be assessed in an apple-to-apple comparison [85]. If the respondents have used both of the applications before, they have to choose the application they access more often. We limited our sample population to residents currently staying in Jakarta, Tangerang, Bogor, Depok, and Bekasi (Jabodetabek). The reason for this demographic limitation is because these areas are well-developed in terms of infrastructure. Therefore, the results will represent the adoption of mHealth well as expanding the demographic to rural areas might bias the results towards nonadopters. Lastly, this study was not carried out in partnership with doctors or any medical professionals. We want to focus our study on the users and the application developers.

The ethics committee approved the study of the Faculty of Medicine of the University of Pelita Harapan with an ethical clearance number of 154/K-LKJ/ETIK/VIII/2020.

4. Results

4.1. Sample Characteristics

Figure 2 shows the sampling procedure and the results. The total number of included respondents in this study is 787 participants, and the demographic data is represented in Table 3. The majority of the participants’ main characteristic is female within 18-25 years old, with monthly spending of less than Rp 3,000,000 (~$214). The mean score for intention to adopt mHealth application is high at 4.166 (). Most of the respondents (63%) use Halodoc© for their mHealth application of choice. The median score of each questionnaire, services used by the customers, and chief medical complaints about using mHealth applications are shown in Table 4 and Figures 3 and 4, respectively.

.

4.2. Structural Model Testing

Our model consisted of compatibility and innovativeness (DOI), performance expectancy, effort expectancy, price value, facilitating conditions (UTAUT2), information-seeking motive, firm-generated content, perceived privacy risk, perceived security, initial trust in doctor, initial trust in mHealth platform, and their effects towards intention to adopt and ultimately intention to recommend. A more detailed method of data analysis is provided in Appendices A and B.

A bootstrap with 5000 iterations of resampling was done to obtain the maximum consistency possible in the results for structural model path significance [86]. Collinearity issues were examined using the variance inflation factor (VIF), and all values are below five. Hence, collinearity is not a critical issue in this structural model [87]. The following steps will be calculating , path coefficients significance, and effect size, which can be seen in Tables 5 and 6 [86, 87]. The blindfolding-based cross-validated redundancy measure of is assessed, predicting the data points removed for all variables [87]. With values mentioned before (see data analysis), all dependent constructs have medium relevance with the intention to adopt having the highest value (0.417).

In contrast, effort expectancy has little relevance, with a value of 0.186. Next, effect size (Table 7) is assessed, and it is found that compatibility has a medium effect on effort expectancy and performance expectancy. Effort expectancy also has a medium effect on performance expectancy. Initial trust in mHealth platform has a small effect on the intention to adopt, but it is statistically significant. Innovativeness has a large effect on compatibility, and intention to adopt has a large effect on the intention to recommend.

Overall, compatibility, performance expectancy, facilitating conditions, information-seeking motive, initial trust in the doctor, and initial trust in mHealth platform explain 53.2% of intention to adopt mHealth. In comparison, the intention to adopt explains 48.3% of the intention to recommend mHealth applications. Initial trust in mHealth platform (, ) had the strongest total effects on intention to adopt followed by facilitating conditions (, ) and performance expectancy (, ) (Figure 5). The firm generated content () and price value () had total negative effects on intention to adopt, which were not according to the predicted hypotheses, albeit they are not significant.

Shmueli et al. [88] emphasized that value did not assess out-of-sample predictive power in the sense of an ability to predict the values of new cases not included in the estimation process. Therefore, Shmueli et al. [88] proposed calculating using PLSpredict with interpretation mentioned in data analysis. The results of are shown in Table 8. There are two items whose PLS-SEM RMSE values are lower than the linear regression model (LM) values; hence, this model has a medium predictive power [88].

Lastly, importance-performance map analysis (IPMA) was done to compare the structural model’s total effects on a specific target construct with its predecessors’ average latent variable scores [89]. The target chosen for the IPMA is the intention to adopt, and the most important construct is initial trust in mHealth platform with an importance score of 0.373 and a performance score of 75.21 (Figure 6). This means that a one-unit increase in the performance of initial trust in the mHealth platform increases the intention to adopt the total effect’s value, which is 0.373, assuming ceteris paribus. Importance-performance map analysis was also done on the indicators (Figure 7). The results showed that the initial indicator trust in mHealth platform 3 (ITM3) was the most important, with an importance score of 0.139 and a performance score of 75.03. The initial indicator trust in mHealth platform 1 (ITM1) had the best performance with a score of 75.51 and an importance score of 0.138. The second best indicator is initial trust in mHealth platform 2 (ITM2), with an importance score of 0.135 and a performance score of 75.10.

5. Discussion

5.1. Principal Findings

Compatibility, performance expectancy, facilitating conditions, information-seeking motive, initial trust in the doctor, and initial trust in the mHealth platform explained 53.2% of the variance of intention to adopt with a medium predictive power . Intention to adopt explains 48.3% of the variance of intention to recommend. Our model is comparable to other studies on studying mHealth usage or adoption [37, 63]. In conclusion, the use of three major theories of UTAUT2, DOI, and internet customer trust models was successful because at least one construct had a statistically significant impact on explaining mHealth application’s adoption. However, the other hypothesized theories do not impact the intention to adopt significantly. According to IPMA analysis, initial trust in mHealth platform was the most important construct and had the highest performance. Standardized coefficient-wise, our study found that initial trust in mHealth platform was the most important determinant of patients’ intention to use mHealth applications, followed by facilitating conditions and performance expectancy. Other studies on mHealth applications also found that these three indicators were the primary determinant of intention to adopt [37, 63, 90].

5.2. Theoretical Implications

The first hypothesis (H1) is not supported as innovativeness does not significantly affect the intention to adopt. Harst et al. [91] stated in a systematic review that acceptance or rejection of innovation is a dynamic process, especially when changes in health behaviour or the adoption of mHealth applications on smartphones are involved. Thus, studies using a cross-sectional design like ours cannot capture the innovation process’s role in using health care applications. This finding is also supported by Jacob et al. [92] in their systematic review, and they found that innovation does not affect mobile health tools’ adoption. Regarding innovativeness on compatibility, it has a statistically significant effect and supports the second hypothesis (H2). This suggests that regular users will find it easier to incorporate mHealth applications into their own lives, which will benefit their health.

Another rejected hypothesis is the third hypothesis (H3), where innovativeness does not significantly affect performance expectancy. This finding is similar to results from earlier studies [53]. One plausible explanation was that innovativeness does not have a statistically significant effect on the intention to adopt. Hence, the indirect effect of innovativeness on adopting via performance expectancy was not statistically significant. Another hypothesis involving innovativeness is that innovativeness has a statistically significant effect on effort expectancy (H4). This finding implies that early adopters find it relatively easy to operate mHealth applications and utilize them.

All hypotheses regarding compatibility are statistically significant, from compatibility to intention to adopt (H5), compatibility to performance expectancy (H6), and compatibility to effort expectancy (H7). This finding’s implication is that performance expectancy, effort expectancy, and intention to adopt are higher when the customer regards mHealth as compatible with their lives, especially in the health sector. These results are also found in previous studies [48, 53]. Effort expectancy is also found to have a statistically significant effect on performance expectancy (H8). According to Oliveira et al. [53], this means that users with lower effort in operating mHealth applications may have higher expectations of achieving gains in using mHealth-related tasks.

In our model, performance expectancy has a statistically significant effect on the intention to adopt, which suggests that users care about the advantages of using mHealth applications in their lives, supporting the ninth hypothesis (H9). Effort expectancy does not have a statistically significant effect on the intention to adopt (H10). Other studies also found this finding which evaluated medical technology adoptions [48, 63]. Tamilmani et al. [93], in a meta-analysis of UTAUT2, also cautioned about the pathway of effort expectancy to behavioural intention as the most nonsignificant path values in predicting the acceptance and use of information technology. One possible explanation for this is that most of the respondents in our study are relatively young adults (less than 35 years old), and they may be more familiar with technologies. Hence, the degree of ease of use in operating mHealth comes as more of an expectation. This was proven in one study that found effort expectancy had positive and significant effects on behavioural intention, especially among the elderly [94].

Price value does not have a statistically significant effect on the intention to adopt has a statistically significant effect on the intention to adopt, and H11 was rejected. Similar results were also found by Tavares and Oliveira [48] and Oliveira et al. [53]. The consultation fee or any other charges can be covered by using national health insurance (mandatory for all Indonesian citizens) or private insurance (54% of respondents had private insurance), which means it costs users almost nothing. Unfortunately, this fact seems to be unfamiliar to users, and hence, H11 was rejected.

In our study, facilitating conditions had a statistically significant effect on the intention to adopt, and H12 was supported. Despite the increasingly prevalent use of smartphones in Indonesia, the internet and broadband reach can still be limited in rural areas. Therefore, mHealth manufacturers should still provide customer care and assistance services to support mHealth use for users’ benefit. Hypothesis 13 (H13) was supported as information-seeking motive had a statistically significant effect on the intention to adopt. This finding is supported by Alwi and Murad [69], where they provided a review on how online information seeking has affected behavioural intention. However, it is also necessary to curb inaccurate or misleading information as it might negatively affect the users’ intention to adopt mHealth applications [74].

Hypothesis 14 (H14) was rejected as firm-generated content does not significantly affect the intention to adopt. One possible explanation was that consumers could assume that firm-generated content that tries to give a positive image to the company can provide an image that is too ambitious, subjective, and overwhelming for consumers. This supports previous researches that the positive tone in firm-generated content is ineffective following these findings, although these studies are not done on health technologies [95]. Perceived privacy risk did not have a statistically significant effect on the intention to adopt, and hence, H15 was rejected. The negative impact of perceived privacy risk on health information on technology acceptance intentions was inconsistent across studies. Zhang et al. [63] found that perceived privacy risk negatively affects diabetes management applications. This finding is in line with studies on mHealth services that assess acceptance behaviour [96]. A survey in America found a moderate negative effect of perceived privacy risk on patient intentions to use home health care robots [97]. However, a study in Bangladesh found that privacy did not affect the intention to adopt mHealth [62]. This finding may be attributed to the different levels of awareness of respondents’ privacy protection in different regions. With the development of health information technology, patients are increasingly aware of privacy protection. Although this study found that perceived privacy risk did not significantly affect, substantial privacy protection measures were still needed [98].

In our model, perceived security does not have a statistically significant effect on the intention to adopt, and therefore, H16 was rejected. In contrast with previous research findings from Johnson et al. [99] and Oliveira et al. [53], a significant effect of perceived security on the intention to adopt was found. Some studies suggest that mobile payments are safer than traditional payment methods [100], but many consumers still consider them less secure. The gap between actual security and perceived security by users may explain the mismatch of correlation in this study [101].

Initial trust in doctor (H17) and initial trust in mHealth platform (H18) had a statistically significant effect on the intention to adopt, and they are both supported. A study shows that new service that is not commonly known and involves a large group can cause uncertainty or potential risk. Users usually decide whether to adopt this service based on trust evaluation. So, the initial trust in a health service application, including doctors and platforms, is an essential factor for users to decide whether to use such a platform [78]. Cao et al. [37] also found that their previously received medical services were primarily offline for first-time healthcare application users. The healthcare application platform has changed the medical service delivery channel, and thus, users will be paying more attention to the providers of this new underlying technology. In other words, for users who are not experienced with the platform, the risk perception comes mainly from the platform rather than the doctor. Therefore, the initial trust in the platform will have a more significant impact on adoption intentions.

Furthermore, Cao et al. [37] found that initial trust in mHealth applications had a more significant impact than initial trust in doctors, which were also found in this study. The last hypothesis (H19) was also supported as the intention to adopt had a statistically significant effect on the intention to recommend. This finding is also supported by other studies [48, 53].

5.3. Managerial Implications

This study considers broader and more practical antecedents that may influence mHealth application adoption and its intention to recommend mHealth application. Trust in mHealth platform is a significant adoption driver of mHealth application and the most prominent contribution amongst other constructs. This construct was also the most critical construct with a high-performance score in our IPMA analysis. One of the main reasons for not adopting mHealth in Indonesia is that consumers give low trust to mHealth applications [19]. This specific finding can provide a reference for mHealth application managers and other countries with similar problems in developing mHealth applications. From a practical perspective, these findings suggest that mHealth application managers need to show their credibility as a trusted brand. One example will be providing relevant and trusted content during the COVID-19 pandemic and articles about COVID-19 testings, signs and symptoms, and treatments. As there is much information circulating on the internet, the mHealth platform should have trustworthy information to win the customers’ initial trust. This is coupled with our findings that information-seeking motive is a significant predictor of intention to adopt. Users who actively seek out information about health-related issues will be influenced by information credibility [40].

Facilitating conditions is found to be the second most crucial factor in affecting the intention to adopt mHealth. Even though there is an increasing number of smartphone users in Indonesia, internet penetration can still be shallow in rural areas [17]. Thus, application developers need to keep this in mind while trying to improve the application so that consumers with minimal bandwidth can still access the application smoothly. Managers can also set up offline or telephone-based customer centers so that users can reach out to seek help easier. Performance expectancy is also another essential factor in influencing intention to adopt mHealth applications. Application managers need to conceive this in mind when developing and promoting mHealth applications. It is relevant to emphasize the advantages the application has in helping users manage their health-related activities more efficiently. As compatibility is also a significant driver in affecting the intention to adopt, managers need to ensure that mHealth applications will fit well with the customers’ lifestyles—especially in the health-related sectors.

Another essential factor to note is initial trust in doctor as it has a significant effect on the intention to adopt. Application managers need to ensure the strict criteria for doctors who can work in their company by doing a more thorough profile check, competency testing, and completeness of national-based medical doctor certifications. Another route that can be taken to increase the initial trust in doctor is to recruit senior doctors or respectable doctors in their respective fields so that patients, especially those with chronic diseases, are familiar with them. Thus, initial trust in doctors will increase.

6. Limitations and Future Research

First, our study was based on a web-based survey using Google Forms. We could not administer the questions directly or clarify some points when filling up the questionnaire. Our respondents were also young adults and highly educated with low to middle monthly spending; thus, prevention of diseases and healthcare awareness will be priorities. Previous studies have also shown that mHealth users are relatively young and with higher education backgrounds [19, 37, 102]. These demographic backgrounds might have influenced some of the results. Firm-generated content might not be relevant for knowledgeable or proficient users in searching for reliable sources of information. Effort expectancy might be insignificant due to the younger population being proficient in operating mHealth applications, and thus, responsiveness of mHealth applications comes as a prerequisite for them. Those with higher education might also educate themselves on privacy risks and security in mHealth applications. Second, cross-sectional studies are also not suitable for assessing or drawing a conclusion about the effect of innovativeness on the intention to adopt as innovativeness is a dynamic process [91]. Third, our model explained only 53.2% of the variance of intention to adopt and 48.3% of the variance in intention to recommend, which indicates that some other factors affecting intention to adopt and intention to recommend may have been overlooked. Future studies could include other constructs such as habit [48] and social influence [63], which positively and significantly affect behavioural intention in the respective study. Fourth, our study only looks at mHealth applications in general. It should be applied to specific mHealth applications, such as chronic disease management applications or pediatric-specific applications, with caution. Lastly, the price value impact needs to be reevaluated as some applications do not accept national and private insurance, causing the customers to pay for telemedicine services.

7. Conclusions

Initial trust in mHealth applications is the most critical determinant of the patient’s intention to adopt mHealth applications, followed by facilitating conditions and performance expectancy. Therefore, managers and developers need to pay special attention to maintaining and increasing users’ perceptions of how credible mHealth applications are. Building supporting facilities such as customer centers and increasing the application’s effectiveness should also be done to promote the applications. Our study supports the use of UTAUT2, DOI, and the internet customer trust model in explaining patients’ intention to adopt mHealth applications. Besides, other context-related determinants such as habit and social influence should be examined to understand better patients’ intention to adopt.

Appendix

A. Data Analysis

Descriptive statistics analyzed the demographic characteristics of respondents. Testing of the research model will be carried out by SmartPLS 3.3 [103] by using partial least squares structural equation modelling (PLS-SEM). One of the main reasons for using PLS-SEM instead of covariance-based SEM (CB-SEM) is that PLS-SEM achieves greater statistical power in all sample sizes, which means that a relationship or a hypothesis is more likely to be statistically significant when it is present in the population. PLS-SEM is also used when the research is aimed at explaining and predicting a model, while CB-SEM can only be used for prediction. The analytical steps and interpretations between these two methods are similar, except that goodness-of-fit testing needs to be done in CB-SEM while not in PLS-SEM, and PLS-SEM can utilize nonnormally distributed data. In contrast, CB-SEM needs to use customarily distributed data. Lastly, CB-SEM is based on the standard factor model. In contrast, PLS-SEM is based on the composite model, is a significant difference between the two approaches, and overall is a better analytical fit for this study [86]. Before evaluating the structural model, we assessed the measurement model to evaluate construct reliability, indicator reliability, convergent validity, and discriminant validity. Acceptable reflective measurement models are defined as loadings above 0.708 [87]. Reliability was measured using composite reliability and Cronbach’s alpha. Cronbach’s alpha sets the lower bound by a value of 0.7, while the upper bound for internal consistency reliability is set by composite reliability with a maximum value of 0.95 [87]. Convergent validity was based on the average variance extracted (AVE) with a threshold of ≥0.50 [87]. Discriminant validity is assessed by the Fornell-Larcker criterion, where each construct’s AVE should be greater than its highest correlation with any other constructs [104]. However, Henseler et al. [105] pointed out that the Fornell-Larcker criterion does not perform well and hence proposed the heterotrait-monotrait (HTMT) ratio of the correlations [105]. For conceptually similar constructs, HTMT below 0.90 is acceptable, while HTMT below 0.85 is expected for conceptually different constructs [105]. A collinearity test is done using the variance inflation factor (VIF) to assure that independent variables do not significantly correlate. Ideally, VIF values should be below 3. Variance inflation factor of ≥3-5 indicates possible collinearity issues, while indicates critical collinearity issues. The model’s explanatory power is measured using , where values of 0.75, 0.5, and 0.25 are considered substantial, moderate, and weak, respectively [106]. Guidelines for measuring are that values of 0.02, 0.15, and 0.35, which depict small, medium, and large effect sizes, respectively [107]. Another way to assess the PLS path model’s predictive accuracy is by calculating the value. As a rule of thumb, values higher than 0, 0.25, and 0.5 depict small, medium, and large predictive relevance of the PLS-path model [108]. It is recently recommended that Q²_predict is calculated because the R² statistic is not represented as a measure of the model’s predictive power [88]. The interpretation of is as follows: check if PLS-SEM analysis (compared to the linear regression model (LM)) yields higher prediction errors in terms of root mean squared error (RMSE) or mean absolute error (MAE) for all (no predictive power), the majority (low predictive power), the minority or the same number (medium predictive power), or none of the indicators (high predictive power) [88]. Lastly, an importance-performance map analysis (IPMA) is interpreted to compare the structural model’s total effects on a specific target construct with its predecessors’ average latent variable scores [89].

B. Measurement Model Testing

The results of the measurement model can be seen in Table 9. One indicator (I3) with a factor loading below 0.708 was removed. This item was also excluded in earlier researches [57, 60]. After dropping I3, the remaining loadings are greater than 0.708, and all the items are statistically significant at <0.001. Hence, the instruments have good indicator reliability [87]. The average variance extracted (AVE) was used to assess convergent validity, and all constructs have an AVE higher than 0.50. This means the latent variable explains more than half of its indicator variance [109]. Table 10 shows the Fornell-Larcker criterion, and the results show that all indicators have good discriminant validity. Henseler et al. [105] suggest calculating the HTMT ratio of the correlations, and a threshold value of less than 0.90 was suggested for ideal HTMT. However, to avoid any ambiguity, a procedure called bootstrapping is used to arrive at a distribution of HTMT statistics and determine if it is significantly less than one [86]. If there is a value of one in the confidence interval, it indicates a lack of discriminant validity. In contrast, if the value one falls outside the interval’s range, this advocates that the two constructs are empirically different [86]. Table 11 shows that our model meets this HTMT criterion.

The measurement model results indicate that the construct reliability, indicator reliability, convergent validity, and discriminant validity of the constructs are satisfactory. A structural model can be applied to this model in the next steps of evaluation.

Data Availability

The original data used to support the findings of this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

References

J. Gunawan and Y. Aungsuroch, “Indonesia health care system and ASEAN economic community,” International Journal of Research in Medical Sciences, vol. 3, no. 7, pp. 1571–1577, 2015.
View at: Publisher Site | Google Scholar
D. Bloom, S. Chen, M. McGovern et al., Economics of Non-Communicable Diseases in Indonesia, 2015, Www3.weforum.org. November 2020, http://www3.weforum.org/docs/WEF_The_Economics_of_non_Disease_Indonesia_2015.pdf.
Badan Pusat Statistik, Persentase Penduduk Miskin Maret 2019 Sebesar 9.41 Persen, 2019, March 2021, https://www.bps.go.id/pressrelease/2019/07/15/1629/persentase-penduduk-miskin-maret-2019-sebesar-9-41-persen.html.
Badan Penyelenggara Jaminan Sosial Kesehatan, Tentang Kami, Sejarah, 2021, March 2021, https://www.bpjsketenagakerjaan.go.id/sejarah.html.
World Health Organization, Estimates of unit costs for patient services for Indonesia, 2005, March 2020, https://www.who.int/choice/country/idn/cost/en/.
S. Boslaugh, Health Care Systems around the World. A Comparative Guide, SAGE Publications United States of America, Thousands Oaks, CA, USA, 2013.
View at: Publisher Site
P. Echeverría, M. Mas Bergas, J. Puig et al., “COVIDApp as an innovative strategy for the management and follow-up of COVID-19 cases in long-term care facilities in Catalonia: implementation study,” JMIR Public Health and Surveillance, vol. 6, no. 3, article e21163, 2020.
View at: Publisher Site | Google Scholar
S. Davey, A. Davey, and J. Singh, “Mobile-health approach: a critical look on its capacity to augment health system of developing countries,” Indian Journal of Community Medicine, vol. 39, no. 3, pp. 178–182, 2014.
View at: Publisher Site | Google Scholar
C. Déglise, L. Suggs, and P. Odermatt, “SMS for disease control in developing countries: a systematic review of mobile health applications,” Journal of Telemedicine and Telecare, vol. 18, no. 5, pp. 273–281, 2012.
View at: Publisher Site | Google Scholar
G. Kreps, “The relevance of health literacy to mHealth,” Information Services & Use, vol. 37, no. 2, pp. 123–130, 2017.
View at: Publisher Site | Google Scholar
D. Kumar and M. Arya, “mHealth is an innovative approach to address health literacy and improve patient-physician communication – an HIV testing exemplar,” Journal of Mobile Technology in Medicine, vol. 4, no. 1, pp. 25–30, 2015.
View at: Publisher Site | Google Scholar
N. Vaz, “Mobile health literacy to improve health outcomes in low-middle income countries,” International Journal of Reliable and Quality E-Healthcare, vol. 6, no. 4, pp. 4–16, 2017.
View at: Publisher Site | Google Scholar
Nurjanah and K. Mubarokah, “Health literacy and health behavior in the rural areas,” Knee Life Sciences, vol. 4, no. 10, p. 8, 2019.
View at: Publisher Site | Google Scholar
Roundtable on Health Literacy, Board on Population Health and Public Health Practice, and Institute of Medicine. Health Literacy: Improving Health, Health Systems, and Health Policy Around the World: Workshop Summary. Washington (DC): National Academies Press (US), Appendix A, Health Literacy Around the World: Part 1 Health Literacy Efforts Outside of the United States, 2013, https://www.ncbi.nlm.nih.gov/books/NBK202445/.
P. Cipresso, S. Serino, D. Villani et al., “Is your phone so smart to affect your state? An exploratory study based on psychophysiological measures,” Neurocomputing, vol. 84, pp. 23–30, 2012.
View at: Publisher Site | Google Scholar
Statista Research Department, Total length of fiber-optic backbone network of Telkom Indonesia 2014-2019, 2020, https://www.statista.com/statistics/1058211/telkom-indonesia-total-length-of-fiber-optic-backbone-network/.
Global Digital Insights, DataReportal – Global Digital Insights, 2020, November 2020, https://datareportal.com/reports/digital-2020-indonesia.
L. Puspitasari and K. Ishii, “Digital divides and mobile internet in Indonesia: impact of smartphones,” Telematics and Informatics, vol. 33, no. 2, pp. 472–483, 2016.
View at: Publisher Site | Google Scholar
Deloitte, 21^st Century Health Care Challenges: A Connected Health Approach, 2019, November 2020, https://www2.deloitte.com/content/dam/Deloitte/id/Documents/public-sector/id-gps-ehealth-publication-Indonesia.pdf.
Y. Pusparisa, Indonesia Peringkat ke-3 Global Memanfaatkan Aplikasi Kesehatan. Databoks.katadata.co.id, 2020, November 2020, https://databoks.katadata.co.id/datapublish/2020/10/13/indonesia-peringkat-ke-3-global-memanfaatkan-aplikasi-kesehatan.
V. Venkatesh, M. G. Morris, G. B. Davis, and F. D. Davis, “User acceptance of information technology: toward a unified view,” MIS Quarterly, vol. 27, no. 3, pp. 425–478, 2003.
View at: Publisher Site | Google Scholar
P. Handayani, D. Meigasari, A. Pinem, A. Hidayanto, and D. Ayuningtyas, “Critical success factors for mobile health implementation in Indonesia,” Heliyon, vol. 4, no. 11, article e00981, 2018.
View at: Publisher Site | Google Scholar
C. Angst and R. Agarwal, “Adoption of electronic health records in the presence of privacy concerns: the elaboration likelihood model and individual persuasion,” MIS Quarterly, vol. 33, no. 2, p. 339, 2009.
View at: Publisher Site | Google Scholar
V. Venkatesh, J. Y. Thong, and X. Xu, “Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology,” MIS Quartely, vol. 36, no. 1, pp. 157–178, 2012.
View at: Publisher Site | Google Scholar
J. Tavares, A. Goulão, and T. Oliveira, “Electronic health record portals adoption: empirical model based on UTAUT2,” Informatics for Health and Social Care, vol. 43, no. 2, pp. 109–125, 2016.
View at: Publisher Site | Google Scholar
A. Boessen, J. Vermeulen, and L. de Witte, “Acceptance and usability of a home-based monitoring tool of health indicators in children of people with dementia: a Proof of Principle (POP) study,” Patient Preference and Adherence, vol. 11, pp. 1317–1324, 2017.
View at: Publisher Site | Google Scholar
E. M. Rogers, Diffusion of Innovations, The Free Press, New York, NY, USA, 4th edition, 1995.
E. M. Rogers and A. Singhal, “Diffusion of Innovations,” in An Integrated Approach to Communication Theory dan Research, M. Salwen and D. Stacks, Eds., pp. 409–419, LEA, Mahwah, NJ, USA, 5th edition, 2003.
View at: Google Scholar
F. Chew, W. Grant, and R. Tote, “Doctors online: using diffusion of innovations theory to understand internet use,” Family Medicine, vol. 36, no. 9, pp. 645–650, 2004.
View at: Google Scholar
T. T. Lee, “Nurses’ adoption of technology: application of Rogers’ innovation diffusion model,” Applied Nursing Research, vol. 17, no. 4, pp. 231–238, 2004.
View at: Google Scholar
R. Beuker and E. R. Abbing, “Two faces of social media: brand communication and brand research,” Design Management Review, vol. 21, no. 1, pp. 54–60, 2010.
View at: Publisher Site | Google Scholar
A. Kumar, R. Bezawada, R. Rishika, R. Janakiraman, and P. K. Kannan, “From social to sale: the effects of firm-generated content in social media on customer behavior,” Journal of Marketing, vol. 80, no. 1, pp. 7–25, 2016.
View at: Publisher Site | Google Scholar
C. Li and J. Bernoff, Groundswell: Einning in a World Transformed by Social Technologies, Harvard Abausiness Review Press, Boston, MA, USA, 2011.
S. L. Jarvenpaa, N. Tractinsky, and L. Saarinen, “Consumer trust in an Internet store: a cross-cultural validation,” Journal of Computers Communications & Control, vol. 5, no. 2, p. 26, 1999.
View at: Publisher Site | Google Scholar
S. Pearson and L. Raeke, “Patients' trust in physicians: many theories, few measures, and little data,” Journal of General Internal Medicine, vol. 15, no. 7, pp. 509–513, 2000.
View at: Publisher Site | Google Scholar
H. McKnight, V. Choudhury, and C. Kacmar, “The impact of initial consumer trust on intentions to transact with a web site: a trust building model,” Journal of Strategic Information Systems, vol. 11, no. 3/4, pp. 297–323, 1998.
View at: Publisher Site | Google Scholar
Y. Cao, J. Zhang, L. Ma, X. Qin, and J. Li, “Examining user’s initial trust building in Mobile online health community adopting,” International Journal of Environmental Research and Public Health, vol. 17, no. 11, p. 3945, 2020.
View at: Publisher Site | Google Scholar
D. Levy, Emerging mHealth: paths for growth. Pwc.com, 2014, November 2020, https://www.pwc.com/gx/en/healthcare/mhealth/assets/pwc-emerging-mhealth-full.pdf.
J. Niederdeppe, R. Hornik, B. Kelly et al., “Examining the dimensions of cancer-related information seeking and scanning behavior,” Health Communication, vol. 22, no. 2, pp. 153–167, 2007.
View at: Publisher Site | Google Scholar
Z. Deng, S. Liu, and O. Hinz, “The health information seeking and usage behavior intention of Chinese consumers through mobile phones,” Information Technology & People, vol. 28, no. 2, pp. 405–423, 2015.
View at: Publisher Site | Google Scholar
W. D. Salisbury, R. A. Pearson, A. W. Pearson, and D. W. Miller, “Perceived security and world wide web purchase intention,” Industrial Management & Data Systems, vol. 101, no. 4, pp. 165–177, 2001.
View at: Publisher Site | Google Scholar
T. C. E. Cheng, D. Y. C. Lam, and A. C. L. Yeung, “Adoption of internet banking: an empirical study in Hong Kong,” Decision Support Systems, vol. 42, no. 3, pp. 1558–1572, 2006.
View at: Publisher Site | Google Scholar
Association A.R. and R. S. Hancock, Dynamic Marketing for a Changing World, 1960, American Marketing Association.
X. Luo, H. Li, J. Zhang, and J. Shim, “Examining multi-dimensional trust and multi-faceted risk in initial acceptance of emerging technologies: an empirical study of mobile banking services,” Decision Support Systems, vol. 49, no. 2, pp. 222–234, 2010.
View at: Publisher Site | Google Scholar
J. Ortega Egea and M. Román González, “Explaining physicians' acceptance of EHCR systems: an extension of TAM with trust and risk factors,” Computers in Human Behavior, vol. 27, no. 1, pp. 319–332, 2011.
View at: Publisher Site | Google Scholar
H. Yang, J. Yu, H. Zo, and M. Choi, “User acceptance of wearable devices: an extended perspective of perceived value,” Telematics and Informatics, vol. 33, no. 2, pp. 256–269, 2016.
View at: Publisher Site | Google Scholar
Fishbein and I. Ajzen, Belief, Attitude, Intention and Behaviour; an Introduction to Theory and Research, Addison Wesley, Reading, 1975.
J. Tavares and T. Oliveira, “New integrated model approach to understand the factors that drive electronic health record portal adoption: cross-sectional national survey,” Journal of Medical Internet Research, vol. 20, no. 11, article e11032, 2018.
View at: Publisher Site | Google Scholar
A. de Veer, J. Peeters, A. Brabers, F. Schellevis, J. Rademakers, and A. Francke, “Determinants of the intention to use e-Health by community dwelling older people,” BMC Health Services Research, vol. 15, no. 1, 2015.
View at: Publisher Site | Google Scholar
A. Karahoca, D. Karahoca, and M. Aksöz, “Examining intention to adopt to internet of things in healthcare technology products,” Kybernetes, vol. 47, no. 4, pp. 742–770, 2017.
View at: Publisher Site | Google Scholar
S. Sun, H. Hwang, B. Dutta, and M. Peng, “Exploring critical factors influencing nurses’ intention to use tablet PC in patients’ care using an integrated theoretical model,” Libyan Journal of Medicine, vol. 14, no. 1, article 1648963, 2019.
View at: Publisher Site | Google Scholar
C. K. Or and B. T. Karsh, “A systematic review of patient acceptance of consumer health information technology,” Journal of the American Medical Informatics Association, vol. 16, no. 4, pp. 550–560, 2009.
View at: Publisher Site | Google Scholar
T. Oliveira, M. Thomas, G. Baptista, and F. Campos, “Mobile payment: understanding the determinants of customer adoption and intention to recommend the technology,” Computers in Human Behavior, vol. 61, pp. 404–414, 2016.
View at: Publisher Site | Google Scholar
M. Talukder, R. Chiong, Y. Bao, and B. Hayat Malik, “Acceptance and use predictors of fitness wearable technology and intention to recommend,” Industrial Management & Data Systems, vol. 119, no. 1, pp. 170–188, 2019.
View at: Publisher Site | Google Scholar
L. R. Flynn and R. E. Goldsmith, “A validation of the Goldsmith and Hofacker innovativeness scale,” Educational and Psychological Measurement, vol. 53, no. 4, pp. 1105–1116, 1993.
View at: Publisher Site | Google Scholar
E. Rogers and F. Shoemaker, Communication of Innovations, The Free Press, New York, NY, USA, 1971.
M. Y. Yi, J. D. Jackson, J. S. Park, and J. C. Probst, “Understanding information technology acceptance by individual professionals: toward an integrative view,” Information dan Management, vol. 43, no. 3, pp. 350–363, 2006.
View at: Publisher Site | Google Scholar
S. A. Raza, A. Umer, and N. Shah, “New determinants of ease of use and perceived usefulness for mobile banking adoption,” International Journal of Electronic Customer Relationship Management, vol. 11, no. 1, pp. 44–65, 2017.
View at: Publisher Site | Google Scholar
J. Portz, E. Bayliss, S. Bull et al., “Using the technology acceptance model to explore user experience, intent to use, and use behavior of a patient portal among older adults with multiple chronic conditions: descriptive qualitative study,” Journal of Medical Internet Research, vol. 21, no. 4, article e11604, 2019.
View at: Publisher Site | Google Scholar
C. L. Miltgen, A. Popovič, and T. Oliveira, “Determinants of end-user acceptance of biometrics: integrating the "Big 3" of technology acceptance with privacy context,” Decision Support Systems, vol. 56, pp. 103–114, 2013.
View at: Publisher Site | Google Scholar
A. Tarhini, M. El-Masri, M. Ali, and A. Serrano, “Extending the UTAUT model to understand the customers’ acceptance and use of internet banking in Lebanon,” People, vol. 29, no. 4, pp. 830–849, 2016.
View at: Publisher Site | Google Scholar
M. Hoque, Y. Bao, and G. Sorwar, “Investigating factors influencing the adoption of e-Health in developing countries: a patient’s perspective,” Informatics for Health and Social Care, vol. 42, no. 1, pp. 1–17, 2017.
View at: Publisher Site | Google Scholar
Y. Zhang, C. Liu, S. Luo et al., “Factors influencing patients’ intentions to use diabetes management apps based on an extended unified theory of acceptance and use of technology model: web-based survey,” Journal of Medical Internet Research, vol. 21, no. 8, article e15023, 2019.
View at: Publisher Site | Google Scholar
W. Dodds, K. Monroe, and D. Grewal, “Effects of price, brand, and store information on buyers’ product evaluations,” Journal of Marketing Research, vol. 28, no. 3, pp. 307–319, 1991.
View at: Publisher Site | Google Scholar
É. Maillet, L. Mathieu, and C. Sicotte, “Modeling factors explaining the acceptance, actual use and satisfaction of nurses using an electronic patient record in acute care settings: an extension of the UTAUT,” International Journal of Medical Informatics, vol. 84, no. 1, pp. 36–47, 2015.
View at: Publisher Site | Google Scholar
N. Basoglu, T. U. Daim, and U. Topacan, “Determining patient preferences for remote monitoring,” Journal of Medical Systems, vol. 36, pp. 1389–1401, 2010.
View at: Publisher Site | Google Scholar
C. L. Hsu, K. C. Tseng, and Y. H. Chuang, “Predictors of future use of telehomecare health services by middle-aged people in Taiwan,” Journal of Social Behavior and Personality, vol. 39, no. 9, pp. 1251–1261, 2011.
View at: Publisher Site | Google Scholar
E. Wilson and N. Lankton, “Modeling patients’ acceptance of provider-delivered e-health,” Journal of the American Medical Informatics Association, vol. 11, no. 4, pp. 241–248, 2004.
View at: Publisher Site | Google Scholar
S. Alwi and M. Murad, “Online information seeking: a review of the literature in the health domain,” International Journal of Computer and Information Engineering, vol. 12, no. 12, pp. 1025–1031, 2018.
View at: Google Scholar
A. T. Stephen and J. Galak, “The effects of traditional and social earned media on sales: a study of a microlending marketplace,” Journal of Marketing Research, vol. 49, no. 5, pp. 624–639, 2012.
View at: Publisher Site | Google Scholar
A. De Bruyn and G. L. Lilien, “A multi-stage model of word-of-mouth influence through viral marketing,” International Journal of Research in Marketing, vol. 25, no. 3, pp. 151–163, 2008.
View at: Publisher Site | Google Scholar
J. Huang, T. Hsiao, and Y. Chen, “The effects of electronic word of mouth on product judgment and choice: the moderating role of the sense of virtual community,” Journal of Applied Social Psychology, vol. 42, no. 9, pp. 2326–2347, 2012.
View at: Publisher Site | Google Scholar
N. Lim, “Consumers' perceived risk: sources versus consequences,” Electronic Commerce Research and Applications, vol. 2, no. 3, pp. 216–228, 2003.
View at: Publisher Site | Google Scholar
G. Bansal, F. M. Zahedi, and D. Gefen, “The impact of personal dispositions on information sensitivity, privacy concern and trust in disclosing health information online,” Decision Support Systems, vol. 49, no. 2, pp. 138–150, 2010.
View at: Publisher Site | Google Scholar
A. K. Ghosh and T. M. Swaminatha, “Software security and privacy risks in mobile e-commerce,” ACM, vol. 44, no. 2, pp. 51–57, 2001.
View at: Publisher Site | Google Scholar
D. K. Maduku, “The effect of institutional trust on internet banking acceptance: perspectives of South African banking retail customers,” South African Journal of Economic and Management Sciences, vol. 19, no. 4, pp. 533–548, 2016.
View at: Publisher Site | Google Scholar
B. Sun, C. Sun, C. Liu, and C. Gui, “Research on initial trust model of mobile banking users,” Journal of Risk Analysis and Crisis Response, vol. 7, no. 1, p. 13, 2017.
View at: Publisher Site | Google Scholar
L. Gao and K. A. Waechter, “Examining the role of initial trust in user adoption of mobile payment services: an empirical investigation,” Information Systems Frontiers, vol. 19, pp. 525–548, 2015.
View at: Publisher Site | Google Scholar
T. Zhou, Y. Lu, and B. Wang, “Examining online consumers’ initial trust building from an elaboration likelihood model perspective,” Information Systems Frontiers, vol. 18, no. 2, pp. 265–275, 2016.
View at: Publisher Site | Google Scholar
S. Kaabachi, B. S. Mrad, and B. dan O’Leary, “Consumer’s initial trust formation in IOB’s acceptance,” The International Journal of Bank Marketing, vol. 37, no. 2, pp. 507–530, 2019.
View at: Publisher Site | Google Scholar
J. Tavares and T. Oliveira, “Electronic Health Record Portal Adoption: a cross country analysis,” BMC Medical Informatics and Decision Making, vol. 17, no. 1, 2017.
View at: Google Scholar
World Health Organization, Process of translation and adaptation of instruments, 2020, December 2020, https://www.who.int/substance_abuse/research_tools/translation/en/.
Alodokter, Tentang Kami, Alodokter, 2018, October 2020, https://www.alodokter.com/about.
JurnalApps, Halodoc - Jurnalapps.Co.Id, jurnalapps, 2020, October 2020, https://jurnalapps.co.id/halodoc-2318.
Sensor Tower, Sensor Tower - Mobile App Store Marketing Intelligence, Sensor Tower, 2020, October 2020, https://sensortower.com/.
J. Hair, G. T. Hult, C. Ringle, and M. Sarstedt, A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM), Second edition, SAGE Publications, Inc., Thousand Oaks, CA, USA, 2017.
J. Hair, J. Risher, M. Sarstedt, and C. Ringle, “When to use and how to report the results of PLS-SEM,” European Business Review, vol. 31, no. 1, pp. 2–24, 2019.
View at: Publisher Site | Google Scholar
G. Shmueli, M. Sarstedt, J. F. Hair et al., “Predictive model assessment in PLS-SEM: guidelines for using PLSpredict,” European Journal of Marketing, vol. 53, no. 11, pp. 2322–2347, 2019.
View at: Publisher Site | Google Scholar
C. M. Ringle and M. Sarstedt, “Gain more insight from your PLS-SEM results: the importance-performance map analysis,” Industrial Management and Data Systems, vol. 116, no. 9, pp. 1865–1886, 2016.
View at: Publisher Site | Google Scholar
R. Hoque and G. Sorwar, “Understanding factors influencing the adoption of mHealth by the elderly: an extension of the UTAUT model,” International Journal of Medical Informatics, vol. 101, pp. 75–84, 2017.
View at: Publisher Site | Google Scholar
L. Harst, H. Lantzsch, and M. Scheibe, “Theories predicting end-user acceptance of telemedicine use: systematic review,” Journal of Medical Internet Research, vol. 21, no. 5, article e13117, 2019.
View at: Publisher Site | Google Scholar
C. Jacob, A. Sanchez-Vazquez, and C. Ivory, “Social, organizational, and technological factors impacting clinicians’ adoption of mobile health tools: systematic literature review,” JMIR mHealth and uHealth, vol. 8, no. 2, article e15935, 2020.
View at: Publisher Site | Google Scholar
K. Tamilmani, N. P. Rana, and Y. K. Dwivedi, “Consumer acceptance and use of information technology: a meta-analytic evaluation of UTAUT2,” Information Systems Frontiers, 2020.
View at: Publisher Site | Google Scholar
M. Cimperman, M. Makovec Brenčič, and P. Trkman, “Analyzing older users’ home telehealth services acceptance behavior—applying an extended UTAUT model,” International Journal of Medical Informatics, vol. 90, pp. 22–31, 2016.
View at: Publisher Site | Google Scholar
A. T. Stephen, M. R. Sciandra, and J. J. Inman, The effects of content characteritstics on consumer engagement with branded social media content on Facebook, Marketing Science Institute Working Paper Series, 15-110, 2015.
X. Guo, X. Zhang, and Y. Sun, “The privacy–personalization paradox in mHealth services acceptance of different age groups,” Electronic Commerce Research and Application, vol. 16, pp. 55–65, 2016.
View at: Publisher Site | Google Scholar
A. Alaiad and L. Zhou, “The determinants of home healthcare robots adoption: an empirical investigation,” International Journal of Medical Informatics, vol. 83, no. 11, pp. 825–840, 2014.
View at: Publisher Site | Google Scholar
S. Veazie, K. Winchell, J. Gilbert et al., “Rapid evidence review of mobile applications for self-management of diabetes,” Journal of General Internal Medicine, vol. 33, no. 7, pp. 1167–1176, 2018.
View at: Publisher Site | Google Scholar
V. Johnson, R. Woolridge, W. Wang, and J. Bell, “The impact of perceived privacy, accuracy and security on the adoption of mobile self-checkout systems,” Journal of Innovation Economics & Management, vol. 1, no. 31, pp. 221–247, 2020.
View at: Publisher Site | Google Scholar
V. L. Johnson, A. Kiser, R. Washington, and R. Torres, “Limitations to the rapid adoption of M-payment services: understanding the impact of privacy risk on M-payment services,” Computers in Human Behavior, vol. 79, pp. 111–122, 2018.
View at: Publisher Site | Google Scholar
E. Hartono, C. W. Holsapple, K. Y. Kim, K. S. Na, and J. T. Simpson, “Measuring perceived security in B2C electronic commerce website usage: a respecification and validation,” Decision Support Systems, vol. 62, pp. 11–21, 2014.
View at: Publisher Site | Google Scholar
C. Lu, Y. Hu, J. Xie et al., “The use of mobile health applications to improve patient experience: cross-sectional study in Chinese public hospitals,” JMIR mHealth and uHealth, vol. 6, no. 5, article e126, 2018.
View at: Publisher Site | Google Scholar
C. M. Ringle, S. Wende, and J. M. Becker, SmartPLS 3, SmartPLS, Bönningstedt, 2015, http://www.smartpls.com.
C. G. Fornell and D. F. Larcker, “Evaluating structural equation models with unobservable variables and measurement error,” Journal of Marketing Research, vol. 18, no. 1, pp. 39–50, 1981.
View at: Publisher Site | Google Scholar
J. Henseler, C. M. Ringle, and M. dan Sarstedt, “A new criterion for assessing discriminant validity in variance-based structural equation modeling,” Journal of the Academy of Marketing Science, vol. 43, no. 1, pp. 115–135, 2015.
View at: Publisher Site | Google Scholar
P. N. Sharma, M. Sarstedt, G. Shmueli, K. H. Kim, and K. O. Thiele, “PLS-Based model selection: The role of alternative explanations in information systems research,” Journal of the Association for Information Systems, vol. 20, no. 4, pp. 346–397, 2019.
View at: Publisher Site | Google Scholar
J. Cohen, Statistical Power Analysis for the Behavioral Sciences, Lawrence Erlbaum Associates, 1988.
G. Shmueli, S. Ray, J. M. Velasquez Estrada, and S. B. Shatla, “The elephant in the room: predictive performance of PLS models,” Journal of Business Research, vol. 69, no. 10, pp. 4552–4564, 2016.
View at: Publisher Site | Google Scholar
J. Henseler, C. M. Ringle, and R. R. Sinkovics, “The use of partial least squares path modeling in international marketing,” Advances in International Marketing, vol. 20, pp. 277–319, 2009.
View at: Publisher Site | Google Scholar
M. Diño and A. de Guzman, “Using partial least squares (PLS) in predicting behavioral intention for telehealth use among Filipino elderly,” Educational Gerontology, vol. 41, no. 1, pp. 53–68, 2014.
View at: Publisher Site | Google Scholar
Z. Deng, Z. Hong, C. Ren, W. Zhang, and F. Xiang, “What predicts patients’ adoption intention toward mHealth services in China: empirical study,” JMIR mHealth and uHealth, vol. 6, no. 8, article e172, 2018.
View at: Publisher Site | Google Scholar
F. Meng, X. Guo, Z. Peng, K. Lai, and X. Zhao, “Investigating the adoption of mobile health services by elderly users: trust transfer model and survey study,” JMIR mHealth and uHealth, vol. 7, no. 1, article e12269, 2019.
View at: Publisher Site | Google Scholar
Z. Gong, Z. Han, X. Li, C. Yu, and J. D. Reinhardt, “Factors influencing the adoption of online health consultation services: the role of subjective norm, trust, perceived benefit, and offline habit,” Frontiers in Public Health, vol. 7, p. 286, 2019.
View at: Publisher Site | Google Scholar
P. Ramírez-Correa, C. Ramírez-Rivas, J. Alfaro-Pérez, and A. Melo-Mariano, “Telemedicine acceptance during the COVID-19 pandemic: an empirical example of robust consistent partial least squares path modeling,” Symmetry, vol. 12, no. 10, article 1593, 2020.
View at: Publisher Site | Google Scholar
G. C. Moore and I. Benbasat, “Development of an instrument to measure the perceptions of adopting an information technology innovation,” Information Systems Research, vol. 2, no. 3, pp. 192–222, 1991.
View at: Publisher Site | Google Scholar
B. Schivinski and D. Dabrowski, “The effect of social media communication on consumer perceptions of brands,” Journal of Marketing Communications, vol. 22, no. 2, pp. 189–214, 2014.
View at: Google Scholar
X. Zhang, P. Yu, J. Yan, A. M. Ton, and I. T. A. M. Spil, “Using diffusion of innovation theory to understand the factors impacting patient acceptance and use of consumer e-health innovations: a case study in a primary care clinic,” BMC Health Services Research, vol. 15, no. 1, 2015.
View at: Publisher Site | Google Scholar
Y. Kuo and S. Yen, “Towards an understanding of the behavioral intention to use 3G mobile value-added services,” Computers in Human Behavior, vol. 25, no. 1, pp. 103–110, 2009.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2021 Gilbert Sterling Octavius and Ferdi Antonio. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

3488

Downloads

2183

Citations