Integrated Care Programs for People with Multimorbidity in European Countries: eHealth Adoption in Health Systems
Introduction. eHealth applications have the potential to provide new integrated care services to patients with multimorbidity (MM), also supporting multidisciplinary care. The aim of this paper is to explore how widely eHealth tools have been currently adopted in integrated care programs for (older) people with MM in European countries, including benefits and barriers concerning their adoption, according to some basic health system characteristics. Materials and Methods. In 2014, in the framework of the ICARE4EU project, expert organizations in 24 European countries identified 101 integrated care programs. Managers of the selected programs completed an online questionnaire on several dimensions, including the use of eHealth. We analyzed data from this questionnaire, in addition to qualitative information from six innovative programs which were studied in depth through case study methodology, according to characteristics of national health systems: a national health model (financing system), overall strength of primary care (PC) (structure/service delivery process), and level of (de)centralization of health system (executive powers in a country). Results. 85 programs (out of 101) adopted at least one eHealth tool, and 42 of these targeted explicitly older people. In most cases, Electronic Health Records (EHRs) were used and some benefits emerged like improved care management and integration, although inadequate funding mechanisms represented a major barrier. The analysis by health system characteristics showed a greater adoption of eHealth applications in decentralized countries, in countries with a National Health Service (NHS) model, and in countries with a strong/medium level of PC development. Conclusions. Although in the light of some limitations, findings indicate a relation between implementation of care programs using eHealth tools and basic characteristics of health systems, with decentralization of a health system, NHS model, and strong/medium PC having a key role. However adaptations of European health systems seem necessary, in order to provide a more innovative and integrated care.
Chronic diseases—like cardiovascular diseases, diabetes, cancer, and chronic respiratory diseases—represent the main cause of functional impairment and mortality in many countries , with 85% of related deaths in Europe . Moreover, in the European region, about 70-80% of healthcare budgets are spent on chronic diseases , of which 97% on treatment and only 3% in prevention . A great number of people (about 50 million) are also suffering from multimorbidity (MM) that is defined as any cooccurrence of multiple chronic conditions (MCCs) within one person . MM prevalence is high especially among older people, with around 60% of patients aged 65+ [1, 6] and 82% aged 85+ years  living with MCCs. Furthermore, MM estimates vary across countries. Nielsen and colleagues  found the lowest MM prevalence of about 26% in Northern Europe and, the highest one, about 35%, in Central and Eastern Europe. A previous study also found a higher prevalence of MCCs in Eastern European countries compared with those in the Western area . MM estimates in older adults also vary according to the different data sources .
National health systems in Europe still approach the complex health and social care needs of patients with MM focusing on traditional single-disease-oriented care programs, running mostly at a local level and without wider coordination [1, 11]. A new organization of care seems needed for addressing appropriately the challenge of MM, which requires proactive integrated initiatives, especially for older people . In this respect, eHealth solutions—i.e., the application of innovative Information and Communication Technologies (ICTs) in the healthcare sector —have the potential to provide new tailored integrated care services to patients with MM, also supporting patient centeredness, self-management, and multidisciplinary care [14, 15]. In fact, eHealth tools can offer to patients with MM relevant improvements for accessing personalized healthcare services and can enable new opportunities for treatment, rehabilitation, and maintaining healthy lifestyles and well-being . The “promise” of eHealth is thus almost comprehensive, with better quality services and more efficient and effective care . eHealth and information systems also can improve quality of available health data, in order to better assess efficiency of care itself .
In particular, the adoption of ICTs in health services and processes can innovate the provision of care at distance [19, 20], especially useful for older people living in the community [21, 22]. ICT has also been identified as a crucial enabler for supporting information sharing across health professionals [23, 24]. Some authors [25, 26] highlighted indeed that MM is associated with a more intense use of eHealth for information and communication purposes regarding health-related services.
The European Commission has supported member states in developing their eHealth strategies for more than a decade. This process started with the first Action Plan eEurope 2002 that contributed to promote awareness and implementation strategies of eHealth across Europe  and continued with the eHealth Action Plan 2012-2020 . The latter put issues of chronic care and MM as policy priorities at a European level, aimed at utilizing eHealth for improving chronic diseases and MM management and prevention, with a crucial role in structural reforms which are necessary to ensure the sustainability of health systems. Previous European policies focused mainly on stimulating the general implementation of electronic health records (EHRs) and health information networks, in order to improve health data exchange between different care providers and nations . The recent Communication from the European Commission , on enabling the digital transformation of health and care in the European Union’s Digital Single Market, in particular highlights personalized medicine, citizen empowerment, and secure/safe access to electronic data as priorities of eHealth.
Nevertheless, eHealth tool implementation in Europe is not yet widespread. In most European countries, they have been somehow adopted by health systems but are not yet included in integrated care programs for patients with MM. In particular, we have a greater use of patient’s EHRs . A survey carried out in 31 European countries  showed that 93% of general practitioners (GPs) reported having an EHR system, although doubts on privacy and confidentiality of electronic health information prevent some GPs from utilizing such a tool. Literature also highlights that EHRs have a peculiar relevance to MM given that they allow healthcare providers to access electronic clinical information of patients with MM, which are characterized by multiple care providers, various health conditions and medical diagnoses, and potential drugs interactions [1, 25]. Currently, many countries have provided patient access to their EHRs, but legislations and policies regulating this right are greatly variable within nations . Besides EHRs, across Europe, we find also the use of remote monitoring and consultation by means of telehealth services [34, 35], independent living solutions (e.g., assistive and ambient intelligence technologies) , and support for the family carers, especially of older people [37, 38]. A more recent survey on the global status of eHealth in the WHO European Region  reported that 70% of covered countries have a national eHealth policy, 59% have a national EHR system, and 80% have a national legislation protecting the privacy of EHRs.
The use of eHealth tools seems to show several potential benefits to patients with MM [31, 38], at the organizational level (e.g., better coordination/integration between professionals) and at the individual level (e.g., better monitoring of care, patient empowerment, and adherence to treatments). Some evidences  in particular indicated that inclusion of eHealth tools in integrated approaches has the potential to increase safety and quality of care for patients, by providing continuity across health and social services. However, there are various potential barriers hampering the implementation of eHealth technologies targeting people with MM [36, 40], such as lack of legislative regimes, lack of dedicated/adequate funding, limited privacy/ethics policies, and low adequate ICT infrastructures; also, cultural resistance to adopt technology both by patients and professionals , and lack of interoperability between eHealth applications  represent further barriers.
Although access to and use of digital technologies by patients are improving across Europe, national contexts are still rather different in terms of availability of ICT infrastructures, services, and skills among populations [29, 42]. Regarding geographical differences in adopting eHealth technologies, on the whole, we find the greatest use in Nordic countries (e.g., Denmark, Norway, Finland, and Sweden), whereas Southern and Eastern Europe include the lesser performing countries, with some exceptions, e.g., Spain [43, 44]. In particular, Denmark is the most advanced country in terms of eHealth adoption, with almost all doctors using electronic transfer of data and online exchange of patients’ health data (91% of doctors exchanging EHRs, against 34% on average in other countries). Regarding on line appointments with health care practitioners, in 2016, this regarded 13% of EU residents, with 49% in Denmark, 35% in Finland, and 30% in Spain . The Digital Economy and Society Index (DESI)  also indicates Finland and Denmark as high performing European countries with regard to eHealth in public service dimension.
The implementation of eHealth in European countries seems particularly depending on characteristics of health systems, which are defined by WHO (, p. 96) as “the ensemble of all public and private organizations, institutions and resources mandated to improve, maintain or restore health”. In this respect, Codagnone and Lupiañez-Villanueva  suggested that the context of the national health models represents a crucial aspect. Specifically, these authors identified three models of health system financing in Europe: the National Health Service (NHS), funded primarily by taxation; the Social Insurance System (SIS), funded through social insurance schemes; and the Transition Country (TC) system, usual in those Centre-Eastern European countries with postsocialist welfare system that joined the European Union in 2004-2007, which have still health systems in transition. A significant positive relation between high adoption rates of eHealth and the NHS model was found previously . This result was further confirmed by Brennan and colleagues  with regard to the adoption of ePrescriptions (i.e., electronic drug prescription) in primary care (PC). They also found that the highest adoption rates occur in countries mainly belonging to the Nordic area and with the NHS model, whereas most of SIS and TC countries were in the middle/lower ranks. These results are also consistent with those regarding the wider implementation of eHealth in Europe, i.e., the NHS countries scored higher on the overall index [32, 47].
Moreover, a strong PC development (e.g., with strong service delivery process and structure)  seems linked to the growing possibilities of technology . PC is indeed the first “entry-point” to the health system in many European countries, with a crucial role in coordinating patients throughout the different health settings , and a condition for its efficient work is the use of ICT. Living in countries with a strong PC system is in turn beneficial to people with MM , as the principles of PC—e.g., continuous, comprehensive, and coordinated care—may fit their needs in a better way [52, 53].
Furthermore, the level of (de)centralization of health systems, at a national or regional/local level of decision making and executive powers in a country, might impact the adoption of eHealth initiatives in different countries [54, 55]. In this respect, Saltman and colleagues  reported some positive outcomes regarding decentralized health systems, including increased capacity to innovate service delivery, with increased autonomy of local governments/institutions. Moreover, in countries where the responsibility for the provision of healthcare is decentralized, positive strategy documents regarding eHealth have been published by regional authorities . Furthermore, different types of MM care practices may also be found in centralized and decentralized health systems . Some authors also report that inequalities in ICT use are related not only to inequalities in individual social structures (e.g., sociodemographic, economic, and health variables) but also to macrosocial variables and welfare systems, e.g., economic, political, and social characteristics and public policies of the respective countries [58, 59].
The organization of a country’s health care system can thus significantly impact eHealth diffusion . Health systems represent the outcomes of health policy decisions, which in turn indicate the interrelationship between healthcare systems and health policy actors . Regarding the selection of appropriate indicators to analyze health systems, Gauld  and Reibling  suggested, among others, the dimensions of “information technology” and “medical technology”, respectively.
On the basis of these considerations, the aim of this paper is to explore how widely eHealth tools have been currently adopted in integrated care programs for people with MM in Europe, according to three characteristics of health systems: the type of national health model (NHS, SIS, and TC), strength of PC development (strong, medium, and weak), and level of (de)centralization of a health system. We use this approach in order to explore whether eHealth is more adopted in countries with particular health system characteristics. Torrent-Sellens and colleagues (, p. 14) also put in evidence the need for “more in-depth research to be conducted into the link between eHealth usage and predictors, and the different health care systems in Europe”. We expect to find a greater implementation of programs with eHealth solutions in decentralized countries than centralized, with a strong PC than low, and with a NHS model than SIS and TC. Our research questions are thus the following: (i)What types of integrated care programs for MM adopting eHealth have been adopted in (groups of) European countries, according to basic characteristics of health systems (national health model, strength of PC, and centralized/decentralized health system)?(ii)What categories of eHealth tools have been adopted in the integrated care programs, according to basic characteristics of health systems?(iii)What benefits/barriers of eHealth tools emerged in the integrated care programs, according to basic characteristics of health systems?
The responses to these questions might also suggest options/implications which could be of help for policy makers in facilitating the use/development of eHealth technologies within integrated care across different European health systems.
2. Materials and Methods
The care programs which are analyzed in this paper come from the Project “Innovating Care for People with Multiple Chronic Conditions in Europe” (ICARE4EU). This project (2013-2016) mapped innovative and integrated care approaches for people with MCCs, which have been implemented in 31 European countries, with the aim to increase and disseminate knowledge of European integrated care programs addressing MM. Below, information on materials and methods is reported. A more detailed description of these aspects is provided elsewhere [52, 65, 66].
2.1. Inclusion Criteria of the Programs
Programs were considered for inclusion in the survey when meeting the following criteria: (i)Targeting adult people (aged 18 and older) with MM, defined as two or more medically diagnosed chronic or long-lasting (at least six months) diseases, of which at least one has a (primarily) somatic/physical nature(ii)Including formalized collaborations between at least two services(iii)Involving one or more medical services(iv)Being evaluable/evaluated(v)Being, at the time of the survey (i.e., 2014), running, or finished in the previous 24 months, or starting within the following 12 months
2.2. Data Collection
Information on programs was collected with the support of expert organizations/program managers in each of the 31 countries of the European region included in the study. A list of potential country experts—with expertise on MM care and who can provide reliable information on innovative, multidisciplinary care approaches/programs for people with MCCs—was constructed for each country. They were asked to identify existing integrated care initiatives at a national/regional/local level focusing on MM and to report the related information by filling in an online questionnaire for each eligible program, also with the collaboration of their expert network and program managers/leaders. The online questionnaire was available in eleven languages and contained general questions (e.g., information on the target group of patients, main objectives and diseases addressed by the program, and quality and evaluation of the program) and specific aspects of MM care: patient centeredness, management practices and professional competencies, financing mechanisms, and use of eHealth technologies eventually adopted within the programs. According to these inclusion criteria, the country experts identified 101 programs on the whole, of which 85 are using at least one eHealth tool, from 24 European countries (out of 31 countries surveyed).
Moreover, eight good practices (or High Potential Programs (HPPs)) were selected for a more in-depth analysis, including site visits for qualitative data collection. For this purpose, the project team scored the 101 programs against five dimensions (general score, e.g., aim of the program, its strengths and weaknesses; level of patient centeredness; level of integration of care; innovativeness in financing mechanisms; and use of eHealth technologies) and thus, they identified the “top” eight HPPs to be further explored as case studies. These programs were operational in Belgium, Bulgaria, Cyprus, Denmark, Germany, Finland, the Netherlands, and Spain. Site visits were organized to study more in depth organizations, integrated care programs, ordinary activities, and relationships. Information was gathered by interviewing program managers and key care professionals from various disciplines/services, by using a topic guide-questionnaire in addition to relevant program documents if available (e.g., interim or final reports, program evaluations). The results of these visits were edited following a common template and are described in eight case reports that were published on the ICARE4EU website (http://www.icare4eu.org). For this paper, we only analysed information from the six (out of eight) HPPs that include aspects of eHealth.
For this paper, we also gathered information on health system characteristics of (groups of) countries which were included in the survey, such as national health models, (overall) strength of PC, and level of (de)centralization of health system. These aspects are detailed better below (Measures).
2.3. Ethical Aspects of the Study
In order to carry out the ICARE4EU study, no ethical approval was requested, given that there were no issues concerning privacy and anonymity of respondents. We provided indeed a protected web survey (by setting individual access credentials) to collect secondary data already available to country experts/managers and staff of integrated care programs for people with MM, without approaching patients or/and their caregivers. We thus collected various data only on the programs and not regarding personal/clinical/sensitive issues on patients and family carers. We signed anyway a written agreement with these experts/managers regarding the aim of the project and the dissemination of the anonymous/confidential data collected. Regarding the site visits to selected initiatives, all interviews were conducted by members of the ICARE4EU project team and were administered to experts/managers/leaders of the care programs. Also in this respect, only general (nonconfidential and nonpersonal) data on the programs was collected. Patients and their family caregivers were not approached by the project team. We signed a further written agreement with all these interviewees regarding the aim of the site visit, the consent to tape recording the interviews, and to publish the related case reports once validated and approved (including the name of the eight selected programs).
Our study firstly identified some general characteristics of care programs such as main objectives (e.g., increasing multidisciplinary collaboration, improving patient involvement), organizations involved (e.g., PC, general hospital), care providers involved (e.g., GP, medical specialist), integration level (e.g., small scale program, well-established program), operational level (e.g., policy/management, daily patient care), adoption level (e.g., local, regional, and national), geographical coverage (e.g., rural, urban), and types of care and support provided by programs (e.g., medical care, nursing care).
Our study then identified four categories of eHealth applications according to their main functions and adopted a classification by adapting key elements of the conceptual framework from the Chronic Care Model (CCM) and the eHealth Enhanced Chronic Care Model (eCCM) [29, 65, 67]. The four types of eHealth we identified are ICT tools for (i)Remote Consultation, Monitoring, and Care: regarding remote/at distance interaction between patients and health professionals, e.g., consultations/visits by telehealth/telecare/telemedicine, online clinical appointments, and ePrescriptions(ii)Self-Management: regarding health advice and reminders used by patients to live more independently and with improved ability to self-care, e.g., computers, tablets, mHealth, and wearable devices/assistive technologies(iii)Healthcare Management: for improving the integration/communication, quality/efficiency of care processes within/between care providers, e.g., EHRs and health information systems on individuals shared between professionals; Personal Health Records (PHRs) managed by patients; and eReferral systems(iv)Health Data Analytics: systems for analysing clinical data/evidences regarding patients for prevention, monitoring, and treatment purposes, e.g., online decision supports used by health professionals for clinical decision making
Moreover, opinions (agreement vs. disagreement) on potential benefits (improving quality of care, quality of life of patients enrolled, integration/management of care, and cost efficiency) and barriers (inadequate legislative framework, funding, ICT infrastructures, and technical-ICT support; lack of skills and cultural resistance among care providers and patients; uncertainty about cost efficiency; compatibility/interoperability between different eHealth tools; and privacy/security issues) were addressed, as they were perceived by expert organizations/program managers.
In order to explore all the abovementioned aspects regarding programs adopting eHealth, according to basic information on health system characteristics of (groups of) 24 countries where integrated care programs were identified, the following dimensions were included (see Table S1 in the Supplementary Materials for more details on health system characteristics and countries/groups of countries): (i)National health model: this classification is based on Codagnone and Lupiañez-Villanueva , concerning a WHO study measuring progress in eHealth adoption by GPs between 2007 and 2013. It distinguished countries with regard to their financing system of health care, as follows (and as already anticipated in Introduction of this paper): NHS (funded primarily by taxation), SIS (funded through social insurance schemes), and TC (including former Eastern Bloc countries with health systems in transition). This classification was further used by Brennan and colleagues , with specific regard to eHealth adoption(ii)(Overall) strength of PC: this classification is based on Kringos and colleagues [49, 68] and Detollenaere and colleagues  who analyzed data from 2009 to 2010. These data were collected as part of the European Union-funded project “Primary Health Care Activity Monitor for Europe - PHAMEU study”. In particular, Detollenaere et al.  based his own study on the framework (selection of the indicators, data collection, and calculation of the scales) described by Kringos and colleagues [49, 68], who distinguished countries with regard to strength (strong, medium, and weak) of their PC. Data included information/subdimensions on both PC structure (governance, e.g., policy implementation; economic conditions, e.g., expenditure/incentives systems; and workforce development, e.g., profile of professionals providing PC) and PC service delivery processes (accessibility, e.g., geographical distribution of services; comprehensiveness, e.g., available medical equipment; continuity, e.g., patient-GP relationship; coordination, e.g., gatekeeping role for GPs; and teamwork). Different combinations/developments of these indicators/dimensions correspond to/measure different degrees in the strength of PC between countries. For this paper, we considered the overall strength of PC(iii)Level of (de)centralization of health system: this classification is based on WHO, Health System in Transition series (years from 2008 to 2013) , and it distinguished countries with centralized health systems (most of the responsibilities lie with the central government) vs. decentralized systems (management systems whose regulation, operation, and also cofunding are delegated to regional authorities or states), as level of decision making and executive powers in a country . This classification was derived from descriptive data in countries’ latest Health System Review (in 2013, i.e., year when the ICARE4EU project was initiated).
2.5. Data Analysis
We have firstly analyzed the 101 integrated care programs targeting people with MM, using descriptive/quantitative frequency distribution, with regard to both their adoption of eHealth tools (at least one) and related distribution in 24 European countries. Then, we analyzed the bivariate relations between some aspects of programs adopting at least one eHealth tool—general characteristics, type of eHealth tools used, and (reported) potential benefits and barriers—and health system characteristics of respective groups of countries. For this purpose, we grouped the 24 European countries (where integrated care programs were identified) according to the country dimensions mentioned above, i.e., national health model, strength of PC, and level of (de)centralization of health system. We further grouped SIS and TC countries, in order to analyze programs in countries (predominantly) tax based vs. insurance based/mixed . Moreover, we further grouped countries with strong/medium PC, in order to analyze them vs. countries with a weak PC system. The aim itself of the related PHAMEU study (cited above as basic framework for PC systems) was indeed to explore if “countries with relatively strong primary care have better overall health care system outcomes compared to countries with relatively weak primary care” (, p. 114). We thus decided to have only two groups of countries regarding the strength of PC, by integrating data on overall medium PC with data on overall strong PC, i.e., with the group of countries with the higher number of integrated care programs adopting eHealth in our study (Table 1).
It should be specified that in our analysis, the three health system characteristics are considered separately, without including a potential multidimensional relation between them. Anyway, additional analyses (data not shown in Tables) showed that out of 85 care programs with eHealth, 46 were implemented in decentralized countries with strong/medium PC too, and, among these, 37 were identified where NHS models were operating, whereas 22 programs were implemented in centralized countries with weak PC too, and, among these, 19 were however identified where NHS models were operating. Quantitative analyses were carried out with the statistical software SPSS 23.0. Bivariate analyses were performed by means of a test (chi-squared). The significance level for all analyses was set at (bold values within the Tables).
As a second step, we gathered/analyzed qualitative information from six site visits to HPPs adopting eHealth. For this purpose, we classified also the six good practices with regard to the abovementioned health system characteristics of the respective countries. Then, we provided additional insights with regard to benefits and barriers for using eHealth tools which were reported by program managers/other health professionals and referred to their ordinary/routinary care delivery to people with MM. The qualitative data analysis was performed by using a manual coding process , leading to conventional content analysis .
3.1. Integrated Care Practices/Programs Using eHealth Applications in European Countries
Among 101 programs identified in 24 countries by the ICARE4EU project, 85 included the use of at least one eHealth tool (Figure 1), and of these, 42 targeted specifically older people aged 65+. The highest numbers of programs with eHealth adoption were identified in Spain (15); Greece, Iceland, and Germany (7 in each country); Italy (6); and Finland (5). In seven countries (e.g., Portugal, Slovenia, and Latvia), only one program using at least one eHealth tool was found. A more detailed description of general findings is reported in other publications [29, 65].
3.2. Number of Programs Using at Least One eHeath Tool and Health System Characteristics
As reported in Table 1, adoption of at least one eHealth tool in the programs, by health system characteristics, such as the national health model, strength of PC, and (de)centralization level of health system, showed on the whole a greater implementation (of programs) in decentralized countries (60%), in countries with a NHS model (68%), and also in countries with a strong/medium PC (67%: 42% strong and 25% medium). In this respect, there are no significant differences between all programs for adult people aged 18+ and those with explicit focus on older people aged 65+ (Table 1). For this reason, the analyses which follow will target all 85 programs using technological care solutions. Anyway, we provide also some general insights on older people when relevant.
3.3. General Aspects of Programs Using at Least One eHeath Tool and Health System Characteristics
With regard to general aspects of programs (Table 2), the main significant objectives were increasing multidisciplinary collaboration (85% overall, 91% in countries with strong/medium PC, ) and improving care coordination (72% overall, 79% in countries with NHS, ; 82% in countries with strong/medium PC, ). Main organizations and care providers significantly involved were, respectively, PC (71%) and GPs (80%) and both in programs which were identified in decentralized and SIS/TC countries, with strong/medium PC.
Other less involved providers, e.g., districts/community nurses and home helps, showed greater significant rates in countries with strong/medium PC, whereas hospital/specialized nurses and physiotherapist/exercise therapist showed greater significant rates in countries with NHS. Among mapped programs, 62% operated both at policy/managerial and patient level, and this regarded 75% of those found in countries with strong/medium PC (). Initiatives were on the whole implemented mainly regionally/locally (78%), and few of them showed a national/international dimension (22%). In this respect, significant differences emerged with regard to the strength of PC and level of (de)centralization. On the whole, the mapped programs adopting eHealth were mainly local and/or regional, and these with greater intake in decentralized countries and with strong/medium PC. Conversely, programs adopting eHealth were mainly implemented nationally/internationally in centralized countries and with weak PC ().
Finally, the main types of care/support for MM patients addressed by the programs were medical care (79%) and prevention (68%), without significant differences regarding health system characteristics. Less addressed types of care and support provided by the programs were significantly mainly provided in countries with NHS (74% for nursing care, ), decentralized countries (73% for adherence to medication, ), and countries with strong/medium PC (71% for coordination of medical services, ).
3.4. Categories of eHealth Tools Adopted in the Programs and Health System Characteristics
3.4.1. Healthcare Management (Communications between Providers)
With regard to categories of eHealth tools adopted in the programs (Table 3), all programs used at least one eHealth tool of this group. Within this group, we also found the three most used eHealth applications, e.g., EHRs (71%), registration databases with patients’ health data that can support decision making (about 64%), and digital communication between care providers (47%), but with no significant differences concerning health system characteristics of countries. Anyway, data showed that in particular EHRs were mainly used in decentralized countries with NHS and strong/medium PC, whereas EHRs were mainly planned in centralized and SIS/TC countries, with weak PC. It has to be highlighted (data not shown in Tables) that the three most used eHealth applications mentioned above showed a slightly higher intake among programs focusing on the elderly (respectively, 76%, 67%, and 52%). Significant differences regarding the greater use of eHealth, according to health system characteristics of countries, were conversely found with regard to the eHealth tool less adopted in the group Healthcare Management as follows: eReferral systems and electronic reminders for providers (respectively, 41%, , and 35%, , in programs implemented in decentralized countries) and PHRs (25%, , in programs implemented in countries with strong/medium PC).
3.4.2. Remote Consultation, Monitoring, and Care (Interaction between Patients and Health Professionals, including ePrescription)
On the whole, 68% of programs used at least one tool of this group, and we found a greater significant use of this entire group of applications in decentralized than in centralized countries (respectively, about 77% and 56%, ). No further significant values emerged with regard to health system characteristics of countries.
3.4.3. Health Data Analytics (Systems for Analysing Clinical Data of Patients)
Among programs, 40% adopted one application of this group, in particular computerized decision supports (35%). We found significant differences for the entire group and for single eHealth applications included, with regard to health system characteristics of countries, i.e., greater adoption in decentralized countries and in countries with strong/medium PC.
3.4.4. Self-Management (of Patients to Live More Independently)
The eHealth solutions included in this group, i.e., supporting self-management of patients (e.g., electronic reminders and computerized tools), could be greatly beneficial to meet the very complex health needs of patients with MM. However, these tools are scarcely used by the programs and not yet widely adopted. The whole group of applications is indeed used by 39% of integrated care programs, and in particular online decision supports were the least frequently adopted tools (about 4%). Considering the characteristics of health system of countries, only a significant difference emerged with regard to the whole group of tools, with programs adopting such applications being mainly implemented in countries with NHS vs. SIS/TC (46% and 22%, ).
3.5. Potential Benefits and Barriers of/for Adoption of eHealth in the Programs and Health System Characteristics
Potential benefits of using eHealth in the programs, as reported/perceived by program managers, are reported in Table 4. On the whole, 95% reported improvements in management of care, 93% in care integration, and 86% in quality of care provided. No significant differences emerged with regard to health system characteristics of countries. Benefits were also reported, with slightly higher percentages, for programs targeting the elderly (data not shown in Tables). Concerning barriers hampering the use of eHealth tools in integrated care programs, various significant differences among groups of countries emerged, and in great part, they put in evidence a worse generalized perception (greater rate of agreeing by program mangers) in centralized countries and with weak PC, regarding mainly inadequate funding (respectively, 87%, , 83%, ) and inadequate technical ICT support (respectively, 78%, , 78%, ). Further (minor) significant barriers emerged again in centralized countries (inadequate ICT infrastructure and lacking technological skills among patients) and with weak PC (inadequate legislative framework). Regarding programs implemented in SIS/TC countries, the lack of skills and resistance among providers, resistance by patients, and obstacles linked to privacy issues emerged as significant barriers.
3.6. Insights from Case Studies of HPPs Adopting eHealth and Health System Characteristics
The general results reported above and regarding a greater implementation of integrated care programs adopting eHealth in decentralized countries, with NHS and strong/medium PC, and, conversely, a greater perception of barriers hampering this adoption in centralized and SIS/TC countries, with weak PC, are also confirmed by qualitative information/data gathered during the site visits of the HPPs we selected among the mapped programs. We found indeed that (Table 5), among the six (out of eight) HPPs using eHealth that we analysed for this paper, three initiatives were implemented in countries showing the three health system characteristics mentioned above, such as decentralized countries, with NHS, and with strong PC. These programs are the following: the Clinic for Multimorbidity and Polypharmacy in Denmark , the POTKU project (Putting the Patient in the Driver’s Seat in Finland , and the Strategy for Chronic Care in the Valencia region in Spain . Regarding the other HPPs using eHealth, we also noticed that when they are implemented in SIS countries, PC is anyway strong/medium, i.e., the INCA program in The Netherlands  and the Gesundes Kinzigtal program in Germany . Moreover, when the HPP is implemented in a centralized country and with weak PC, the national health model is anyway a NHS, i.e., the TeleRehabilitation program in Cyprus .
Regarding qualitative information from site visits on barriers for using eHealth in the programs (infos not shown and drawn from the sources indicated in Table 5), we found some issues confirming quantitative analyses. Inadequate funding, that is the main obstacle in centralized countries and with weak PC, emerged indeed in the TeleRehabilitation program (in Cyprus). We also found resistance by patients to adopt eHealth, i.e., a barrier indicated in particular with regard to SIS countries, in the Gesundes Kinzigtal program (in Germany), and lacking technological skills among patients, another barrier indicated in particular with regard to centralized countries, in the INCA program (in The Netherlands). Qualitative information from site visits on benefits of using eHealth in the programs (infos not shown and again drawn from the sources indicated in Table 5) also confirmed results found in quantitative data (exposed above), such as a generally diffused perception of them among program managers, independently from characteristics of health systems of countries. We found indeed benefits reported in decentralized countries, with NHS, with strong PC, as good coordination/integration of care due to the sharing of EHRs among physicians and patients in the Clinic for Multimorbidity and Polypharmacy, due to advanced decision support systems (DSSs) in the Strategy for Chronic Care and due to a computerized decision support e-tool for GPs in the POTKU project. We also found some perceived benefits regarding the other HPPs reported in Table 5, e.g., in countries where PC is weak (e.g., Cyprus), in SIS countries (e.g., Germany, Netherlands), and in centralized countries (e.g., Cyprus and the Netherlands). These benefits are again improvements of management processes in the Gesundes Kinzigtal program, where the physicians share EHRs; in the INCA program, with care profiles for patients that are accessible by professionals and patient; and with remote monitoring and therapies at a distance, thus reducing readmissions and being cost-effective, in th5e TeleRehabilitation program.
Further qualitative information (e.g., aim, main activities, and eHealth aspects) obtained from the site visits of HPPs in Denmark, Finland, and Spain, is reported in a separate publication  and also briefly in text boxes which are included in Text S1 in the Supplementary Materials.
The ICARE4EU study explored, among others aspects, the diffusion in Europe of integrated care programs for MM adopting eHealth applications. The overall findings presented in this paper suggest the presence of a link between health system characteristics of participating countries and general aspects of these programs, categories of eHealth adopted, and related benefits/barriers.
4.1. Overall Picture Emerged from the Study
As a first result of our study, among 85 programs which use of at least one eHealth tool in 24 countries, 15 were identified in Spain; 7 both in Greece, Iceland, and Germany; 6 in Italy; and 5 in Finland. This distribution is somewhat/partially different from the one reported by previous literature, i.e., greatest eHealth adoption in Nordic European countries [32, 44]. The reason for this difference could be twofold. On the one hand, it might partly depend on personal knowledge of country experts and program managers selected for the ICARE4EU study, who in some cases might not have been aware of all integrated care initiatives operating in their countries (as explained better in Limitations of the paper). On the other hand, the abovementioned discrepancy might depend on the fact that, in great part of European countries, eHealth tools have been generally adopted by health systems but rarely included in integrated care programs/practices for people with MM, as those mapped during our project . Conversely, both our study and previous research findings [43, 78] put in evidence the relatively large number of health programs using ICT tools and identified in Spain that is a Southern European country. This context is probably due to the circumstance that Spain has 17 regions/autonomous communities and governance of health care delivery is provided at a regional level , thus leading to a considerable number of health programs on the whole. Moreover, Spain in recent years has greatly participated in European programs funding activities on ICT and ageing , throughout the “National Plans Research, Development and Innovation”, running from 2007 to 2012 . In particular, in Spain, a great part of funding for remote monitoring projects is provided by the European Commission .
Moving specifically to health system characteristics of countries, we found on the whole a greater implementation of care programs adopting eHealth tools in decentralized countries, with a NHS model and with a strong/medium PC. These quantitative results were also confirmed/reinforced by the evaluation of the HPPs we selected among the mapped programs, which showed that three out of six good practices using eHealth were implemented in countries with such peculiarities.
The findings from our study are supported by previous authors. With regard to national health models, Codagnone and Lupiañez-Villanueva  found a positive link between eHealth adoption and NHS countries. Other authors  highlighted a greater implementation of eHealth, for instance ePrescribing, where the NHS model is provided, with a tax-based financing system, and with less barriers between different sectors of the health system, thus allowing a greater integration and coordination among professionals and services, also with the support of eHealth applications. Moreover, most NHS countries have carried out national ePrescribing projects for many years, whereas many SIS countries and TCs were at the beginning in this respect. The same authors  also showed that funding and incentives of healthcare operating in these nations seem more favorable to eHealth adoption than those available in SIS countries. In NHS countries, it is also effective the becoming “mandatory” obligation for GPs to adopt eHealth for administrative tasks, and the fact that a single authority or few institutions manage (in most cases) the national health information systems represents a key factor.
In accordance with our results, previous literature also highlighted that the adoption of eHealth seems more facilitated in decentralized health systems, where local governance supports intersectoral integration . On the whole, financial, organizational, and political decentralization implies local autonomy and decisions according to the local preferences, with expected improvements in welfare efficiency and equity, and increased responsiveness of local authorities [81, 82]. In particular, some studies put in evidence how the organisational level can influence development and adoption of healthcare innovation/technologies; that is, organisations are supposed to assimilate innovations better if they are (among other factors) managed through decentralised decision making [83, 84]. Thus, decentralization seems to improve public service delivery also by allowing innovation . It has anyway to be highlighted that, according to further studies, in countries with decentralized health systems, an official eHealth strategy with agreed common aims among different institutions is needed . In other words, although in many cases digital health innovations are adopted at lower and decentralized levels in the health care system, implementation of digital health services on lower levels needs to be aligned with overall/central system goals .
The strength of PC is a further crucial aspect of health systems that emerged in our study as influencing the implementation of programs with eHealth solutions. Also, other studies report similar findings by evidencing how a strong PC system seems linked to innovative care opportunities offered by technology  and how eHealth tools in turn can improve PC consultations . Recently, the European Commission  presented country-specific recommendations regarding more sustainable and innovative health systems by means of strong/well-performing PC. The strength of PC is indeed different across countries due to variation in political will, social-cultural values, policies, and healthcare system type; thus, country-specific strategies to develop PC are need [49, 89]. Consequently, specific country factors, such as organization and legislation of national eHealth services, play a role for eHealth adoption itself . Further literature indicated that a strong PC, i.e., accessible, comprehensive, continuous, and coordinated [49, 90], can support and strengthen, as backbone, well-performing health systems, where integration of care can be provided especially to patients with MM [91–93]. And in order to deliver integrated services, with provision of both health promotion and prevention within PC, health systems should adopt innovative eHealth solutions . In this respect, also, relevantly, some results [68, 94] show how healthcare expenditure (that could sustain technological innovation) in European countries is significantly linked to the strength of PC process. It is also to highlight that when countries decentralize important PC functions, this might lead to a not “clear governmental vision” regarding the future direction of PC (, p. 171).
4.2. Main General Aspects of Programs Adopting eHealth
We found that specific and main objectives of MM care programs using eHealth tools, such as increasing multidisciplinary collaboration and improving care coordination, were particularly operating on the whole in countries with NHS and countries with strong/medium PC. Batenburg (, p. 1541) analyzed in particular the link between a country’s health system and PC strength, and he found that a great part of countries with a NHS model also show a strong/medium PC, this allowing an access to health care providers “at the right time and right place”. Further authors highlighted that a strong PC implies a coordinated and collaborative care , i.e., a context beneficial to multimorbid patients, and how health outcomes in multimorbid patients are consequently better in countries with a strong PC structure [51, 52], also with the support of technology . Thus, objectives of MM care, such as a greater multidisciplinary and coordinated healthcare, can find a favorable substrate especially in countries with a NHS model and strong PC.
Main organization and care provider significantly more involved in our study were, respectively, PC services and GP, and in programs with eHealth which were identified in decentralized countries and in those with strong/medium PC. This context is not surprising, given that, in decentralized countries and with strong/medium PC, GPs are reported as main healthcare coordinators , the “core” providers of PC services, the key medical professional caring for (older) person with MM , and the most helpful service according to family carers opinion and also perceived as a real “support service” . Moreover, in countries with a greater proportion of GPs, who can convince patients to use technology, eHealth could be more diffused. According to some authors, a positive cultural attitude towards new health technologies among physicians could play indeed a crucial role in making, e.g., telemonitoring more acceptable for their patients, especially for the elderly [65, 99]. PC services and GPs in our study are also significantly more involved in programs with eHealth which were identified in SIS/TC countries. This result does not seem in contrast neither with the fact that our results evidenced a greater involvement of PC services and GPs in countries with strong/medium PC nor with the fact that previous studies  found a link between strong PC and the NHS model in a country. The strength of PC, as depending on various factors (e.g., governance, economic conditions, accessibility, comprehensiveness, continuity, and coordination), including workforce development, is something different from a greater involvement of PC in eHealth programs. This seems rather to indicate that in SIS/TC countries, PC and GP represent basic pillars, given that other services/professionals are less involved, differently from NHS countries, where conversely the related percentages are higher. In particular, in our study, hospital/specialized nurses and physiotherapists/exercise therapists showed greater significant rates in countries with NHS. In this respect, other studies highlight that a strong PC structure is supported by national health workforce (HWF) developments  and that countries with a NHS model and strong PC (e.g., Denmark, Finland, the UK, and Spain) have highest levels of HWF planning . A successful eHealth adoption requires in turn investment in both health and social care workforce .
By our findings, initiatives adopting eHealth were also on the whole significantly implemented mainly nationally/internationally in centralized countries and with weak PC and conversely mainly regionally/locally in decentralized countries and with strong/medium PC. This context could reflect the fact that in these latter countries, there are preconditions for supporting/allowing integrated care initiatives which are more adequate to local/specific needs, and which are more capillary and punctual. On the opposite, more general/national/international care programs, which are often related to temporary research projects and not based on local political/social policies, are more widespread in centralized countries and with weak PC, where the power for public health planning is not delegated to local/regional authorities but managed by the national/central government. Drawing on literature, we know that often adoption of eHealth applications ends when also related research projects are concluded, although successful , and that local health problems often require local solutions, with a crucial role of local research in providing adequate funds supporting local priorities . In such a context, a strong PC represents the first “local” entry point into the “national” health system for the large majority of health needs , and the “promise” of decentralization seems potential for enabling local governments to provide care programs/health services more tailored on local interests/preferences, with a greater involvement of local communities . Territorial approaches/perspectives also permit to reconnect decentralisation and development/innovation, with the support of “national decentralisation policies” (, p. 13).
The key roles of NHS model, decentralization of health system, and strength of PC are further confirmed by our results regarding some types of care and support which are provided by the programs adopting eHealth, e.g., nursing care, adherence to medication, and coordination of medical services. These were indeed significantly and, respectively, mainly provided in countries with NHS and in decentralized countries and with strong/medium PC. In this respect, we found partly support in previous literature with regard to the fact that a strong/integrated PC, in particular when continuous and coordinated , can provide some more specific types of care. Some studies of “exemplary”, high-performing, innovative PC practices [105–107] have put indeed in evidence a key role of nurses within the care team, including in particular management of chronic disease. Conversely, lack of coordination of care (e.g., in a weak PC system) can negatively impact for instance on medication adherence especially in case of patients with coexisting conditions and several medications prescribed by several physicians .
4.3. Categories of eHealth Applications
Our findings showed that all programs used at least one eHealth application of the group Healthcare Management, and mainly EHRs, registration databases with patients’ health data, and digital communication between care providers. We found in particular that EHRs were the most used tools especially in decentralized countries with NHS and strong/medium PC (and mainly planned in centralized and SIS/TC countries, with weak PC), but with no significant difference with regard to health system characteristics of countries. These results on one side seem to confirm a wider adoption (and intention of adoption) of EHRs in many European countries, independently from specific aspects of healthcare systems, as emerged also from previous literature [31, 32, 43]. On the other side, our results regarding EHRs, although not significantly, however highlight decentralized countries, with strong PC, and with NHS model as “more advanced” and favorable context for supporting and implementing care programs with eHealth for patients with MM. In this regard, some authors  suggest that nationwide applications, e.g., national EHR systems, cannot be managed centrally, especially in large countries, and thus, the interoperability of regional systems is more successful in decentralized healthcare systems. Moreover, a strong PC seems to support a wider adoption of EHRs. High-performing health care systems, based on strong PC providing healthcare to multimorbid patients, require indeed monitoring them with the help of EHRs . More recent findings  put in evidence that about 80% of PC practices were using an EHR across 15 EU countries, although there were wide variations. EHRs were especially used in all (or almost all) PC practices in Denmark, Estonia, Finland, Spain, and the United Kingdom, i.e., countries with strong PC (as they are in the classification by Kringos and colleagues .
Within the group Healthcare Management, and differently from the context of EHRs, our study found a significant and greater use of PHRs in programs which are implemented in countries with strong/medium PC. This characteristic of health systems seems thus crucial for promoting adoption of electronic/personal data of patients in integrated care programs for MM. According with Flaumenhaft and Ben-Assuli , governments try to balance the need to promote PHRs’ use and the need to provide adequate protection of individual’s medical information. In this respect, the recent European General Data Protection Regulation’ (GDPR 2016/679, Reform 2018, European Union) , operating since May 2018, is requiring more strict protection measures regarding the handling of personal data, including sensitive health data among others . For this aim, a strong PC system (e.g., with strong governance, accessibility, and coordination) seems however crucial.
With regard to other groups of tools, we found the following: a greater and significant use of the entire category Remote Consultation, Monitoring, and Care (tools for interaction between patients and health professionals) in decentralized countries; a significant use of the entire group and for single eHealth applications included in Health Data Analytics (systems for analysing clinical data of patients) in decentralized countries and with strong/medium PC; and a significant use of the whole group of tools for Self-Management (of patients to live more independently) in countries with NHS. To our knowledge, there is few literature supporting these specific findings, and conversely, we found much support from previous authors regarding on the whole how certain characteristics of health systems seem related to a more general adoption of eHealth applications, i.e., with decentralized health systems , with strong PC , and with a NHS model [32, 47]. However, some literature, regarding for instance online consultations, reported that in two decentralized countries such as Denmark and Finland, respectively, “the use of e-mail for consultations in general practice became mandatory in 2009”, and “e-mails between doctors and patients have been a routine part of care for over a decade” (, p 1). Other literature, regarding online decision supports used by health professionals, highlighted that these tools are specifically and increasingly important in PC for providing specific evidence on patients, e.g., for GPs , and thus, in this context, we could assume that a strong PC structure seems more favourable. Moreover, regarding tools for self-management, e.g., reminders by tablets, there are still few data on the structure/governance of the national healthcare systems and the related impact on frameworks of self-management support, and moreover, more research is needed for exploring “the optimal balance” for the delivery of self-management support through a national health system (, p. 8).
4.4. Benefits and Barriers of eHealth
Literature shows that both barriers/factors hindering and facilitators/factors enabling digital health implementation are crucial when planning healthcare [115, 116]. A large review on the implementation of eHealth in a wide range of healthcare systems (, p. 10) suggests that multiple factors were important and “no single factor was identified as a key barrier or facilitator” across different healthcare settings.
Our findings put in evidence some potential benefits of using eHealth in the integrated care programs for MCCs, as reported/perceived by program managers (e.g., improvements of care management/integration/quality). The fact that no eHealth benefit emerged as significant with regard to health system characteristics of countries clearly indicates that positive aspects of ICT use on healthcare are widely recognized in European countries. In this respect, almost all European member states of the WHO European Region participating in the eHealth survey 2015  seem indeed to recognize benefits attributed to eHealth solutions which are implemented in the context of improved care management, thus facilitating the transition to patient-centered care models. Regarding interventions related to eHealth in PC and for MM, patient-centered care is indeed reported by Mangin and colleagues  as crucial for improving health outcomes and for integrated management of MCCs. Regarding specifically benefits of eHealth for MM, some authors state that the priority in high-performing healthcare systems, that is, to assure care coordination/integration , could be met better by eHealth application adoption and also that eHealth has potential for enhancing care integration/coordination among professionals/different providers, management processes, and continuity of care in all European countries .
Concerning significant barriers hampering the use of eHealth applications, we found greater rates of agreeing by program managers regarding mainly inadequate funding and inadequate technical ICT support in centralized countries and with weak PC. The lack of technological skills among patients and inadequate ICT infrastructure also emerged in centralized countries, whereas inadequate legislative framework similarly emerged in countries with weak PC. Privacy question and the lack of skills among providers were perceived as barriers in SIS/TC countries. These findings are on the whole consistent with previous literature [39, 117, 120]. In particular, several authors put in evidence how the adoption of EHRs in industrialized countries was hampered by security/privacy issues and complex legislation [121–123]. Regarding barriers in relation to some characteristics of health systems, the fact that we found them significantly more perceived in centralized and SIS/TC countries and countries with weak PC is in line with opposite findings from our study concerning a greater implementation of care programs adopting eHealth applications in decentralized countries, with a NHS model, and a strong/medium PC. Previous literature also indicate on the whole a wider and facilitated/not hampered adoption of eHealth innovations in European countries, e.g., due to available funding mechanisms, as linked to characteristics of healthcare systems [54, 55, 124, 125] In this respect, some authors showed that funding and incentive mechanisms of healthcare seem less effective in SIS countries than those operating in NHS countries . Also, the degree of organization/centralization of health systems is reported as negatively impacting on interoperability of ICT applications in different countries [83, 84]. It is furthermore to highlight that government preferences for market legislation/forces may impact on the management of technology uptake in national healthcare systems, thus not leading to regulate eHealth infrastructure .
Also, qualitative information gathered during the site visits, to HPPs using eHealth, confirmed quantitative data on specific barriers hampering eHealth adoption, as perceived by program managers in centralized countries, in SIS/TC countries, and with weak PC. They further confirmed a generally diffused perception of benefits from eHealth adoption that is not linked to health system characteristics.
Our findings, also supported by previous literature, seem thus to confirm our hypothesis, such as that basic health system characteristics are relevant for the implementation of care programs for MM adopting eHealth in Europe.
This study presents some limitations, as well as the overall ICARE4EU project [52, 65, 66]. Our overview of relevant programs in European countries is based only on the impact of eHealth technologies as perceived by service/program managers/leaders, without including reports from patients, caregivers, and care providers. We were also dependent on the personal expertise/knowledge (in some cases probably incomplete regarding all care approaches operating in their countries) of country experts and program managers participating in the survey. This may have influenced the number of mapped programs and of related countries where programs with eHealth were implemented (). This circumstance, in turn, may have impacted our analysis by health system characteristics of (groups of) countries that was based on classifications we built from literature (including 31 countries). No eligible program, according to our inclusion criteria, was indeed identified in Czech Republic, Estonia, Hungary, Poland, Romania, and Slovakia. Information on French programs was incomplete and thus excluded from the analysis. For United Kingdom, our study covered only England. Another weakness of the ICARE4EU study is the need to develop original survey questions, with the contribution of each partner regarding a specific expertise/research theme (patient centeredness, management practices and professional competencies, financing mechanisms, and use of eHealth technologies), due to not available validated questionnaires in all European countries (in 2014, year of data collection) to assess the practice characteristics of our interest . Also, only eight selected programs could be visited in the scope of this project, and only six contained aspects of eHealth. Thus, we based our analyses mainly on data from the web survey and less on daily practice regarding eHealth adoption. The results of the qualitative data analysis provided however valuable insights in the current implementation of these good practices. Furthermore, we mapped eHealth aspects that were considered relevant for MM care, but comprehensiveness cannot be guaranteed. For the specific issue of eHealth, data collection instruments included indeed the most frequently used types of applications, without focusing on all available potential solutions, which would have required a more comprehensive data collection beyond the scope of the project . Moreover, the design of the study and the lack of detailed information about the eHealth tools hampered a more in-depth analysis, such as inclusion of indicators at a macro level (e.g., the size or the economic situation of the country) and the extent or level of eHealth adoption (e.g., experimental/fully adopted, small/large scale). We recognize the limited validity and reliability of the dependent variable (i.e., number of programs adopting eHealth tools identified in a country), which could have produced an overestimation of the real eHealth adoption, where “small” or experimental tools are counted equally as “larger” and long-running tools and the single use for instance of EHR in a country is put on the same level of another more complex and innovative technological application. This may have further impacted on the relation between integrated care programs for MM using eHealth tools and characteristics of health systems, thus potentially affecting the cross-country comparison and limiting the conclusions drawn from the study, also with regard to policy implications. Such a context should lead to some caution in the interpretation of results. It is however to highlight that the ICARE4EU project did not aim to carry out a systematic mapping of good practices of integrated care initiatives for people with MM across Europe, and moreover, it was an exploratory study on the adoption of eHealth tools in the area of MM in Europe, and thus, we were interested in the use of at least one single tool. Despite all limitations listed above, influencing the findings and hampering their generalizability in particular with regard to the potential benefits of eHealth and despite the additional fact that the scale of the initiatives remained mostly local and/or regional, a large number of eligible eHealth programs were identified. It was thus an attempt to provide some insight into related current practice. Moreover, given that there are currently very few studies and data available on the specific issue of eHealth for MM care and with limited sample sizes, the 85 eHealth programs analyzed in this paper could contribute to some extent to have a European picture of the issue. Their knowledge could in turn support further development and implementation of MM care programs adopting eHealth in European countries.
The ICARE4EU findings, although in the light of some methodological limitations which allow only general considerations on eHealth adoption in Europe, seem to suggest on the whole a relation between implementation of integrated care programs for MM using eHealth tools and characteristics of health systems, i.e., a greater diffusion of such programs in decentralized countries, with a NHS model, and a strong/medium PC. Also, WHO recently stated that digital technologies within a country can strengthen health system depending on health system characteristics themselves, such as governance, legislation, policy, workforce, standards, and interoperability .
In our study, all programs adopted at least one eHealth tool of the group Healthcare Management and mainly EHRs in decentralized countries with NHS and strong/medium PC, although no significant difference emerged in this respect. With regard to other groups of tools, Remote Consultation, Monitoring, and Care and Health Data Analytics, and tools for Self-Management, the characteristics of healthcare systems mentioned above seem on the whole significantly more favourable for the diffusion of integrated care approaches adopting new digital health technologies. Conversely, barriers to eHealth adoption emerged significantly more perceived in centralized countries and with weak PC (e.g., inadequate funding and inadequate technical ICT support) and in SIS/TC countries (e.g., privacy issues). The fact that no eHealth benefit emerged as significant with regard to health system characteristics of countries clearly indicates that positive aspects of ICT use on healthcare are widely recognized across European countries. These general quantitative results were also supported by some qualitative information gathered during site visits to HPPs using innovative/digital applications.
The potential useful adoption of eHealth seems thus more facilitated in decentralized health systems, where local governance can allow integrated care initiatives which are more tailored on local/specific needs, with the help of new technologies. In particular, when patients, professionals, entrepreneurs, and government collaborate together, starting in local communities with few initial eHealth tools, the potential of eHealth can be “enforced” . Furthermore, a greater adoption of eHealth seems to emerge where a NHS model are provided, that is with a tax-based financing system and with healthcare incentives which seem more favorable to eHealth implementation. Finally, also PC seems to have a key role, given that it can strengthen healthcare systems and can provide a more flexible access to services and integration across settings through technology [91, 128]. A strong PC system can facilitate for instance a comprehensive care coordination [129, 130], and this context influences the adoption of eHealth applications. Moreover, in order to support PC, available and accessible health technologies thus “offers an opportunity that cannot be missed” (, p. 1373), by expanding the range of addressed health conditions and available related treatments .
eHealth shows thus a general good potential, and in this regard, decentralized countries with NHS and strong/medium PC seem to represent the more adequate contexts. However, current population ageing, increasing prevalence of chronic diseases and MM, consequent raising healthcare costs, and “budgetary constraints” will require crucial adaptations of European health systems, in order to provide a more innovative, integrated, and patient-centered care . Health systems need in particular to become more strong/resilient and sustainable, and in this respect, the digital innovation might represent a key factor to promote healthy ageing . In particular, a “responsible innovation in health” (RIH) could reduce the cost of innovation itself and contribute to the sustainability of health systems (, p. 64). However, although the digital transformation of health services is a process influencing the performance of health systems themselves, it seems crucial to collect further robust evidence to evaluate cost-effectiveness of new eHealth solutions and “to strengthen the political choice” to implement them (, p.1). Moreover, it seems important to carry out further studies on complex needs of frail older people with MM and “digitally supported flexible and adaptive teamwork”, given the paucity of data in this respect (, p.1). More in-depth analyses are needed, keeping into consideration the differences among various eHealth aspects and categories. The development of scales or indexes able to assess more precisely the level of eHealth adoption could further support comparative studies, in order to achieve a more precise knowledge on the topic across Europe and to actually test the country-comparative expectations.
Complete database is owned by partners. The dataset used for the aim of this paper is available from the first author (excluding the names of programs, and also excluding the names of countries as potentially identifying information, when in combination with basic characteristics of the programs), upon reasonable request to be determined by the ICARE4EU Consortium. All relevant data underlying the findings, which are described in the text (N values behind the measures reported), are however available within the paper.
The authors partially adapted part of the text from their own previous publication concerning the same main ICARE4EU Study, with appropriate attribution (Melchiorre MG et al., eHealth in integrated care programs for people with multimorbidity in Europe: Insights from the ICARE4EU project. Health Policy, 2018;122(1):53-63). The adapted text refers to some brief parts of general sociodemographic information of the sample population, some/few general Results, Methods (as well established protocols), and Limitations. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The content of this paper is the sole responsibility of the authors; it cannot be considered to reflect the views of the European Commission or any other body of the European Union.
Conflicts of Interest
The authors declare that there are no competing interests regarding the publication of this paper.
Maria Gabriella Melchiorre conceived and designed the experiments. Maria Gabriella Melchiorre, Roberta Papa, and Francesco Barbabella performed the experiments. Roberta Papa developed statistical analyses. Maria Gabriella Melchiorre, Francesco Barbabella, and Roberta Papa analyzed/interpreted the data. Maria Gabriella Melchiorre and Francesco Barbabella wrote the paper. Giovanni Lamura and Sabrina Quattrini revised critically the paper for important intellectual content. All authors read and approved the final manuscript.
The authors wrote the manuscript on behalf of the following ICARE4EU Consortium: Mieke Rijken, Iris van der Heide, Sanne Snoeijs, François G. Schellevis (NIVEL, Netherlands Institute for Health Services Research, Utrecht, The Netherlands, coordinator centre); Ewout van Ginneken, Verena Struckmann, Reinhard Busse (TUB, Technische Universität Berlin, Berlin, Germany); Anneli Hujala, Sari Rissanen, Helena Taskinen (UEF, University of Eastern Finland, Kuopio, Finland); and Aileen Clarke, Mariana Dyakova (University of Warwick, Warwick, UK). The authors wish to thank Eurocarers (Ireland); AGE Platform Europe (Belgium), and the European Observatory on Health Systems and Policies (OBS, Belgium). The authors wish to thank also all the country experts and the program managers who contributed to the ICARE4EU project. This publication arises from the project Innovating care for people with multiple chronic conditions in Europe (ICARE4EU) Project, which has received funding from the European Union, in the framework of the Health Programme 2008-2013 (CHAFEA, The Consumers, Health, Agriculture and Food Executive Agency, http://ec.europa.eu/chafea/), Grant number 20121205. Duration of the project: 2013-2016. This study was partially supported by Ricerca Corrente funding from Italian Ministry of Health to IRCCS INRCA.
Supplementary Table S1: health system characteristics and countries/groups of countries. Supplementary Text S1: text boxes with aim, main activities, and eHealth aspects of HPPs which were selected in Denmark, Finland, and Spain. (Supplementary Materials)
K. Palmer, A. Marengoni, M. J. Forjaz et al., “Multimorbidity care model: recommendations from the consensus meeting of the Joint Action on Chronic Diseases and Promoting Healthy Ageing across the Life Cycle (JA-CHRODIS),” Health Policy, vol. 122, no. 1, pp. 4–11, 2018.View at: Publisher Site | Google Scholar
P. Brennan, M. Perola, G.-J. van Ommen, E. Riboli, and On behalf of the European Cohort Consortium, “Chronic disease research in Europe and the need for integrated population cohorts,” European Journal of Epidemiology, vol. 32, no. 9, pp. 741–749, 2017.View at: Publisher Site | Google Scholar
European Commission, Scoping study on communication to address and prevent chronic diseases, Directorate-General for Health and Food Safety, Luxembourg, 2015, http://ec.europa.eu/health/major_chronic_diseases/docs/2015_chronic_scopingstudy_en.pdf.
P. de Raeve, S. Gomez, P. Hughes et al., “Enhancing the provision of health and social care in Europe through eHealth,” International Nursing Review, vol. 64, no. 1, pp. 33–41, 2017.View at: Publisher Site | Google Scholar
S. R. de Bruin, N. Versnel, L. C. Lemmens et al., “Comprehensive care programs for patients with multiple chronic conditions: a systematic literature review,” Health Policy, vol. 107, no. 2-3, pp. 108–145, 2012.View at: Publisher Site | Google Scholar
G. Onder, K. Palmer, R. Navickas et al., “Time to face the challenge of multimorbidity. A European perspective from the joint action on chronic diseases and promoting healthy ageing across the life cycle (JA-CHRODIS),” European Journal of Internal Medicine, vol. 26, no. 3, pp. 157–159, 2015.View at: Publisher Site | Google Scholar
M. E. Salive, “Multimorbidity in older adults,” Epidemiologic Reviews, vol. 35, no. 1, pp. 75–83, 2013.View at: Publisher Site | Google Scholar
C. R. Nielsen, A. Halling, and K. Andersen-Ranberg, “Disparities in multimorbidity across Europe - findings from the SHARE Survey,” European Geriatric Medicine, vol. 8, no. 1, pp. 16–21, 2017.View at: Publisher Site | Google Scholar
S. Afshar, P. J. Roderick, P. Kowal, B. D. Dimitrov, and A. G. Hill, “Multimorbidity and the inequalities of global ageing: a cross-sectional study of 28 countries using the world health surveys,” BMC Public Health, vol. 15, no. 1, p. 776, 2015.View at: Publisher Site | Google Scholar
S. Gontijo Guerra, D. Berbiche, and H. M. Vasiliadis, “Measuring multimorbidity in older adults: comparing different data sources,” BMC Geriatrics, vol. 19, no. 1, p. 166, 2019.View at: Publisher Site | Google Scholar
A. Marengoni, R. J. F. Melis, A. Prados Torres, and G. Onder, “Multimorbidity: epidemiology and models of care,” BioMed Research International, vol. 2016, Article ID 7029027, 2 pages, 2016.View at: Publisher Site | Google Scholar
World Health Organization (WHO), Integrated care for older people: guidelines on community-level interventions to manage declines in intrinsic capacity, World Health Organization, Geneva, Switzerland, 2017.
R. E. Scott and M. Mars, “Here we go again - ‘digital health’,” Journal of the International Society for Telemedicine and eHealth, vol. 7, article e1, 2019.View at: Publisher Site | Google Scholar
E. Lettieri, L. P. Fumagalli, G. Radaelli et al., “Empowering patients through eHealth: a case report of a pan-European project,” BMC Health Services Research, vol. 15, no. 1, p. 309, 2015.View at: Publisher Site | Google Scholar
C. Steele Gray, J. Barnsley, D. Gagnon et al., “Using information communication technology in models of integrated community-based primary health care: learning from the iCOACH case studies,” Implementation Science, vol. 13, no. 1, p. 87, 2018.View at: Publisher Site | Google Scholar
G. Castelnuovo, G. Mauri, S. Simpson, A. Colantonio, and S. Goss, “New technologies for the management and rehabilitation of chronic diseases and conditions,” BioMed Research International, vol. 2015, Article ID 180436, 2 pages, 2015.View at: Publisher Site | Google Scholar
J. Stoffers, “The promise of eHealth for primary care: opportunities for service delivery, patient–doctor communication, self-management, shared decision making and research,” European Journal Of General Practice, vol. 24, no. 1, pp. 146–148, 2018.View at: Publisher Site | Google Scholar
European Commission, Tools and methodologies to assess the efficiency of health care ervices in Europe. An overview of current approaches and opportunities for improvement, Publications Office of the European Union, Luxembourg, 2019.
S. Wooding, G. Cochrane, J. Taylor, A. Kamenetzky, S. Sousa, and S. Parks, Insights on earlier adoption of medical innovations. An international review of emerging and effective practice in improving access to medicines and medical technologies, RAND Corporation, Santa Monica, CA, USA, 2015.
M. G. Melchiorre, G. Lamura, F. Barbabella, and on behalf of ICARE4EU Consortium, “eHealth for people with multimorbidity: results from the ICARE4EU project and insights from the “10 e’s” by Gunther Eysenbach,” PLoS One, vol. 13, no. 11, article e0207292, 2018.View at: Publisher Site | Google Scholar
Y. van Zaalen, M. McDonnell, B. Mikołajczyk, S. Buttigieg, M. del Carmen Requena, and F. Holtkamp, “Technology implementation in delivery of healthcare to older people: how can the least voiced in society be heard?” Journal of Enabling Technologies, vol. 12, no. 2, pp. 76–90, 2018.View at: Publisher Site | Google Scholar
S. T. M. Peek, K. G. Luijkx, M. D. Rijnaard et al., “Older adults’ reasons for using technology while aging in place,” Gerontology, vol. 62, no. 2, pp. 226–237, 2016.View at: Publisher Site | Google Scholar
D. Protti, “Integrated care needs integrated information management and technology,” Healthcare Quarterly, vol. 13, pp. 24–29, 2009.View at: Publisher Site | Google Scholar
B. R. Winthereik and J. P. Bansler, “Connecting practices: ICT infrastructures to support integrated care,” International Journal of Integrated Care, vol. 7, no. 2, article e16, 2007.View at: Publisher Site | Google Scholar
F. Lupiáñez-Villanueva, D. Anastasiadou, C. Codagnone, R. Nuño-Solinís, and M. B. Garcia-Zapirain Soto, “Electronic health use in the European Union and the effect of multimorbidity: cross-sectional survey,” Journal of Medical Internet Research, vol. 20, no. 5, article e165, 2018.View at: Publisher Site | Google Scholar
K. E. Flynn, M. A. Smith, and J. Freese, “When do older adults turn to the internet for health information? Findings from the Wisconsin Longitudinal Study,” Journal of General Internal Medicine, vol. 21, no. 12, pp. 1295–1301, 2006.View at: Publisher Site | Google Scholar
European Commission, eEurope2002: Impact and priorities. A communication to the Spring European Council in Stockholm, 23-24 March 2001, European Commission, COM 140, Brussels, 2001.
European Commission, eHealth Action Plan 2012-2020. Innovative healthcare for the 21st century, European Commission, COM 736, Brussels, 2012.
F. Barbabella, M. G. Melchiorre, S. Quattrini, R. Papa, G. Lamura, and on behalf of the ICARE4EU consortium, How Can eHealth Improve Care for People with Multimorbidity in Europe? Policy Brief 25, WHO, European Observatory on Health Systems and Policies, Health Systems and Policies Analysis, Brussels, 2017.
European Commission, Communication on enabling the digital transformation of health and care in the Digital Single Market; empowering citizens and building a healthier society, European Commission, COM 233, Brussels, 2018.
W. R. Hersh, P. N. Gorman, F. E. Biagioli, V. Mohan, J. A. Gold, and G. C. Mejicano, “Beyond information retrieval and electronic health record use: competencies in clinical informatics for medical education,” Advances in Medical Education and Practice, vol. 5, pp. 205–212, 2014.View at: Publisher Site | Google Scholar
C. Codagnone and F. Lupiañez-Villanueva, Benchmarking deployment of eHealth among general practitioners. Final report, Publications Office ofthe European Union, Luxembourg, 2013.
A. Essén, I. Scandurra, R. Gerrits et al., “Patient access to electronic health records: differences across ten countries,” Health Policy and Technology, vol. 7, no. 1, pp. 44–56, 2018.View at: Publisher Site | Google Scholar
J. Barlow, D. Singh, S. Bayer, and R. Curry, “A systematic review of the benefits of home telecare for frail elderly people and those with long-term conditions,” Journal of Telemedicine and Telecare, vol. 13, no. 4, pp. 172–179, 2007.View at: Publisher Site | Google Scholar
J. Cruz, D. Brooks, and A. Marques, “Home telemonitoring effectiveness in COPD: a systematic review,” International Journal of Clinical Practice, vol. 68, no. 3, pp. 369–378, 2014.View at: Publisher Site | Google Scholar
S. Carretero, Technology-enabled services for older people living at home independently: lessons for public long-term care authorities in the EU Member States, Publications Office of the European Union, Luxembourg, 2015.
S. Carretero, J. Stewart, C. Centeno et al., Can technology-based services support long-term care challenges in home care? Report EUR 25695 EN, Publications Office of the European Union, Luxembourg, 2012.
N. C. Chi and G. Demiris, “A systematic review of telehealth tools and interventions to support family caregivers,” Journal of Telemedicine and Telecare, vol. 21, no. 1, pp. 37–44, 2015.View at: Publisher Site | Google Scholar
World Health Organization (WHO), From Innovation to Implementation. eHealth in the WHO European Region, WHO Regional Office for Europe, Copenhagen, Denmark, 2016.
L. Kubitschke and K. Cullen, ICT & ageing. European study on users, market and technologies. Final report, European Commission, Brussels, 2010.
J. Venne, Large-scale sustainable deployment of digitally-enabled innovation for health and care delivery to the ageing population, European Commission, European Connected Health Alliance (ECHAlliance), Northern Ireland, UK, 2018.
D. M. Zulman, E. C. Jenchura, D. M. Cohen, E. T. Lewis, T. K. Houston, and S. M. Asch, “How can eHealth technology address challenges related to multimorbidity? Perspectives from patients with multiple chronic conditions,” Journal of General Internal Medicine, vol. 30, no. 8, pp. 1063–1070, 2015.View at: Publisher Site | Google Scholar
R. Sabes-Figuera, European hospital survey: benchmarking deployment of e-Health services (2012–2013), Country Reports. Publications Office of the European Union, Luxembourg, 2013.
P. Arak and A. Wójcik, Transforming eHealth into a political and economic advantage, Polityka Insight, Warsaw, Poland, 2017.
OECD/EU, Health at a glance: Europe 2018. State of health in the EU Cycle, OECD Publishing, Paris, 2018.
European Commission, Digital Economy and Society Index (DESI) 2018, European Commission Fact Sheet, Brussels, 2018.
J. Brennan, A. McElligott, and N. Power, “National health models and the adoption of E-health and E-prescribing in primary care. New evidence from Europe,” Journal of Innovation in Health Informatics, vol. 22, no. 4, pp. 399–408, 2015.View at: Publisher Site | Google Scholar
W. L. A. Schäfer, Primary care in 34 countries: perspectives of general practitioners and their patients, (Dissertation). NIVEL, Utrecht University Repository, The Netherlands, 2016.
D. S. Kringos, B. WGW, A. Hutchinson, and R. B. Saltman, Eds., Building primary care in a changing Europe. European Observatory on Health Policies and Systems, Observatory Studies Series 38, Copenhagen, 2015.
J. Detollenaere, L. Hanssens, V. Vyncke, J. De Maeseneer, and S. Willems, “Do we reap what we sow? Exploring the association between the strength of European primary healthcare systems and inequity in unmet need,” PLoS One, vol. 12, no. 1, article e0169274, 2017.View at: Publisher Site | Google Scholar
J. Hansen, P. P. Groenewegen, W. G. W. Boerma, and D. S. Kringos, “Living in a country with a strong primary care system is beneficial to people with chronic conditions,” Health Affairs, vol. 34, no. 9, pp. 1531–1537, 2015.View at: Publisher Site | Google Scholar
M. Rijken, A. Hujala, E. van Ginneken, M. G. Melchiorre, P. Groenewegen, and F. Schellevis, “Managing multimorbidity: profiles of integrated care approaches targeting people with multiple chronic conditions in Europe,” Health Policy, vol. 122, no. 1, pp. 44–52, 2018.View at: Publisher Site | Google Scholar
P. P. Valentijn, S. M. Schepman, W. Opheij, and M. A. Bruijnzeels, “Understanding integrated care: a comprehensive conceptual framework based on the integrative functions of primary care,” International Journal of Integrated Care, vol. 13, no. 1, article e010, 2013.View at: Publisher Site | Google Scholar
J. M. Ortega Egea, M. Recio Menéndez, and M. V. Román González, “Profiling European physicians' usage of eHealth services,” Information Research, vol. 16, no. 1, 2011.View at: Google Scholar
European Commission - Empirica, Benchmarking ICT use among general practitioners in Europe, Information Society and Media Directorate General, Bonn, Germany, 2008.
R. B. Saltman, V. Bankauskaite, and K. Vrangbaek, Eds., Decentralization in Health Care. Strategies and Outcomes, Open University Press, Maidenhead, 2007.
K. A. Stroetmann, J. Artmann, and V. Stroetmann, European countries on their journey towards national eHealth infrastructures. eHealth Strategies Report, European Commission, Brussels, 2011.
H. Ono and M. Zavodny, “Digital inequality: a five country comparison using microdata,” Social Science Research, vol. 36, no. 3, pp. 1135–1155, 2007.View at: Publisher Site | Google Scholar
P. Silva, A. D. Matos, and R. Martinez-Pecino, “E-inclusion: beyond individual socio-demographic characteristics,” PLoS One, vol. 12, no. 9, article e0184545, 2017.View at: Publisher Site | Google Scholar
D. Castro, Health IT. Explaining international IT application leadership. Health IT, The Information Technology And Innovation Foundation (ITIF), Washington, DC, USA, 2009.
T. Marmor and C. Wendt, “Conceptual frameworks for comparing healthcare politics and policy,” Health Policy, vol. 107, no. 1, pp. 11–20, 2012.View at: Publisher Site | Google Scholar
R. Gauld, The new health policy, Open University Press, Maidenhead, 2009.
N. Reibling, “Healthcare systems in Europe: towards an incorporation of patient access,” Journal of European Social Policy, vol. 20, no. 1, pp. 5–18, 2010.View at: Publisher Site | Google Scholar
J. Torrent-Sellens, Á. Díaz-Chao, I. Soler-Ramos, and F. Saigí-Rubió, “Modelling and predicting eHealth usage in Europe: a multidimensional approach from an online survey of 13,000 european union internet users,” Journal of Medical Internet Research, vol. 18, no. 7, article e188, 2016.View at: Publisher Site | Google Scholar
M. G. Melchiorre, R. Papa, M. Rijet, E. van Ginneken, A. Hujala, and F. Barbabella, “eHealth in integrated care programs for people with multimorbidity in Europe: insights from the ICARE4EU project,” Health Policy, vol. 122, no. 1, pp. 53–63, 2018.View at: Publisher Site | Google Scholar
I. van der Heide, S. Snoeijs, S. Quattrini et al., “Patient-centeredness of integrated care programs for people with multimorbidity. Results from the European ICARE4EU project,” Health Policy, vol. 122, no. 1, pp. 36–43, 2018.View at: Publisher Site | Google Scholar
P. M. Gee, D. A. Greenwood, D. A. Paterniti, D. Ward, and L. M. S. Miller, “The eHealth enhanced chronic care model: a theory derivation approach,” Journal of Medical Internet Research, vol. 17, no. 4, article e86, 2015.View at: Publisher Site | Google Scholar
D. Kringos, W. Boerma, Y. Bourgueil et al., “The strength of primary care in Europe: an international comparative study,” British Journal of General Practice, vol. 63, no. 616, pp. e742–e750, 2013.View at: Publisher Site | Google Scholar
World Health Organization (WHO), Health system in transition eries (years from 2008 to 2013). European Observatory on Health Systems and Policies, http://www.euro.who.int/en/about-us/partners/observatory/health-systems-in-transition-hit-series.
J. Saldana, The Coding Manual for Qualitative Researchers, Sage, London, 2009.
H.-F. Hsieh and S. E. Shannon, “Three approaches to qualitative content analysis,” Qualitative Health Research, vol. 15, no. 9, pp. 1277–1288, 2005.View at: Publisher Site | Google Scholar
A. Hujala, V. Struckmann, H. Taskinen, and E. van Ginneken, Clinic for multimorbidity and polypharmacy, Denmark. ICARE4EU Project: Case Report, NIVEL, Utrecht, The Netherlands, 2015.
A. Hujala, M. Rijken, E. Oksman, H. Taskinen, and S. Rissanen, POTKU programme, Finland. ICARE4EU project: case report, NIVEL, Utrecht, The Netherlands, 2015.
F. Barbabella, A. Hujala, S. Quattrini, R. Papa, G. Lamura, and M. G. Melchiorre, The strategy for chronic care in Valencia Region, Spain. ICARE4EU project: case report, NIVEL, Utrecht, The Netherlands, 2015.
S. Snoeijs, V. Struckmann, and E. van Ginneken, INCA programme, Netherlands. ICARE4EU project: case report, NIVEL, Utrecht, The Netherlands, 2015.
V. Struckmann, W. Boerma, and E. van Ginneken, Gesundes Kinzigtal programme, Germany. ICARE4EU project: case report, NIVEL, Utrecht, The Netherlands, 2015.
F. Barbabella, S. Snoeijs, S. Quattrini, R. Papa, G. Lamura, and M. G. Melchiorre, Telerehabilitation programme, Cyprus. ICARE4EU project: case report, NIVEL, Utrecht, The Netherlands, 2015.
J. Hilbert, R. G. Heinze, G. Naegele et al., Innovation Prospect Report. MOPACT Project, Mobilising the potential of active ageing in Europe, Gelsenkirchen, Germany, 2013.
I. van der Heide, S. Snoeijs, M. G. Melchiorre et al., Innovating care for people with multiple chronic conditions in Europe: an overview, NIVEL, Utrecht, The Netherlands, 2015.
K. Rojahn, S. Laplante, J. Sloand et al., “Remote monitoring of chronic diseases: a landscape assessment of policies in four European countries,” PLoS One, vol. 11, no. 5, article e0155738, 2016.View at: Publisher Site | Google Scholar
M. Robinson, “Does decentralisation improve equity and efficiency in public service delivery provision?” IDS Bulletin, vol. 38, no. 1, pp. 7–17, 2007.View at: Publisher Site | Google Scholar
H. Blair, “Participation and accountability at the periphery: democratic local governance in six countries,” World Development, vol. 28, no. 1, pp. 21–39, 2000.View at: Publisher Site | Google Scholar
T. C. Oliveira, E. Barrenho, A. Vernet, E. Autio, and J. Barlow, “Developing a global healthcare innovation index. The policy innovation research unit (PIRU), PIRU publication 2017-20,” Tech. Rep., Imperial College, London, 2017.View at: Google Scholar
T. Greenhalgh, G. Robert, P. Bate, O. Kyriakidou, F. Macfarlane, and R. Peacock, How to spread good ideas. A systematic review of the literature on diffusion, dissemination and sustainability of innovations in health service delivery and organisation, National Co-ordinating Centre for NHS Service Delivery and Organisation (NCCSDO), London, 2004.
World Health Organization (WHO), Decentralized health systems in transition. Technical Report Based on the Fourteenth Annual Conference of RHN, WHO Regional Office for Europe, Copenhagen, Denmark, 2008.
European Commission, Opinion on assessing the impact of digital transformation of health services. Expert panel on Effective Ways of Investing in Health (EXPH), DG Health & Food Safety, Brussels, 2018.
M. A. Johansen, G. Berntsen, N. Shrestha, J. G. Bellika, and J. A. K. Johnsen, “An exploratory study of patient attitudes towards symptom reporting in a primary care setting,” Methods of Information in Medicine, vol. 50, no. 5, pp. 479–486, 2011.View at: Publisher Site | Google Scholar
European Commission, Euroepan Semester: Commission proposes health recommendations to 12 EU countries, Health-EU Newsletter 2018e;216:Focus, https://ec.europa.eu/health/health-eu-newsletter-216-focus_en.
D. S. Kringos, W. G. W. Boerma, J. van der Zee, and P. P. Groenewegen, “Political, cultural and economic foundations of primary care in Europe,” Social Science & Medicine, vol. 99, pp. 9–17, 2013.View at: Publisher Site | Google Scholar
W. L. A. Schäfer, W. G. W. Boerma, A. M. Murante, H. J. M. Sixma, F. G. Schellevis, and P. P. Groenewegen, “Assessing the potential for improvement of primary care in 34 countries: a cross-sectional survey,” Bulletin of the World Health Organization, vol. 93, no. 3, pp. 161–168, 2015.View at: Publisher Site | Google Scholar
European Commission, State of health in the EU. Companion report, Directorate-General for Health and Food Safety, Luxembourg, 2017.
European Commission, A new drive for primary care in Europe: rethinking the assessment tools and methodologies. Report of the Expert Group on Health Systems Performance Assessment, Publications Office of the European Union, Luxembourg, 2018.
J. de Maeseneer, “European expert panel on effective ways of investing in health: opinion on primary care,” Primary Health Care Research & Development, vol. 16, no. 2, pp. 109-110, 2015.View at: Publisher Site | Google Scholar
D. R. Pavlič, M. Sever, Z. Klemenc-Ketiš et al., “Strength of primary care service delivery: a comparative study of European countries, Australia, New Zealand, and Canada,” Primary Health Care Research & Development, vol. 19, no. 3, pp. 277–287, 2018.View at: Publisher Site | Google Scholar
D. S. Kringos, “The importance of measuring and improving the strength of primary care in Europe: results of an international comparative study,” The Turkish Journal of Family Practice, vol. 17, no. 4, pp. 165–179, 2013.View at: Publisher Site | Google Scholar
R. Batenburg, “Health workforce planning in Europe: creating learning country clusters,” Health Policy, vol. 119, no. 12, pp. 1537–1544, 2015.View at: Publisher Site | Google Scholar
N. Goodwin, A. Dixon, G. Anderson, and W. Wodchis, Providing integrated care for older people with complex needs: lessons from seven international case studies, The King’s Fund, London, 2014.
G. Lamura, H. Döhner, and C. Kofahl, Eds., Supporting family carers of older people in Europe. Empirical evidence, policy trends and future perspectives, Lit Verlag, Hamburg, University of Hamburg-Eppendorf, 2008.
M. Cimperman, M. M. Brenčič, P. Trkman, and M. L. Stanonik, “Older adults' perceptions of home telehealth services,” Telemedicine Journal and E-Health, vol. 19, no. 10, pp. 786–790, 2013.View at: Publisher Site | Google Scholar
I. C. S. Swinkels, M. W. J. Huygens, T. M. Schoenmakers et al., “Lessons learned from a living lab on the broad adoption of eHealth in primary health care,” Journal of Medical Internet Research, vol. 20, no. 3, article e83, 2018.View at: Publisher Site | Google Scholar
World Health Organization (WHO), The world health report 2013, Research for Universal Health Coverage, Geneva, Switzerland, 2013.
European Commission, Report on Definition of a frame of reference in relation to primary care with a special emphasis on financing systems and referral systems. Expert Panel on effective ways of investing in Health (EXPH), DG Health & Consumers, Brussels, 2014.
A. Mills, J. P. Vaughan, D. L. Smith, and I. Tabibzadeh, Eds., Health System Decentralization: Concepts, Issues and Country Experience, World Health Organization (WHO), Geneva, 1990.
European Commission, Supporting decentralisation, local governance and local development through a territorial approach. Reference Document no 23, Directorate-General for International Cooperation and Development, Brussels, 2016.
T. Bodenheimer, L. Bauer, J. N. Olayiwola, and S. Syer, RN role reimagined: How empowering registered nurses can improve primary care, California Health Care Foundation, Oakland, CA, 2015.
J. Smolowitz, E. Speakman, D. Wojnar et al., “Role of the registered nurse in primary health care: meeting health care needs in the 21st century,” Nursing Outlook, vol. 63, no. 2, pp. 130–136, 2015.View at: Publisher Site | Google Scholar
M. Flinter, C. Hsu, D. A. Cromp, M. J. D. Ladden, and E. H. Wagner, “Registered nurses in primary care: emerging new roles and contributions to team-based care in high-performing practices,” The Journal of Ambulatory Care Management, vol. 40, no. 4, pp. 287–296, 2017.View at: Publisher Site | Google Scholar
D. M. Cutler and W. Everett, “Thinking outside the pillbox. Medication adherence as a priority for health care reform,” The New England Journal of Medicine, vol. 362, no. 17, pp. 1553–1555, 2010.View at: Publisher Site | Google Scholar
OECD/EU, Caring for quality in health: lessons learnt from 15 reviews of health care quality, OECD Reviews of Health Care Quality, OECD Publishing, Paris, 2017.
Y. Flaumenhaft and O. Ben-Assuli, “Personal health records, global policy and regulation review,” Health Policy, vol. 122, no. 8, pp. 815–826, 2018.View at: Publisher Site | Google Scholar
European Union, Data protection rules for the protection of personal data inside and outside the EU, European Union website, 2018.
H. Atherton, H. Brant, S. Ziebland et al., “The potential of alternatives to face-to-face consultation in general practice, and the impact on different patient groups: a mixed-methods case study,” Health Services and Delivery Research, vol. 6, no. 20, pp. 1–200, 2018.View at: Publisher Site | Google Scholar
T. Porat, B. Delaney, and O. Kostopoulou, “The impact of a diagnostic decision support system on the consultation: perceptions of GPs and patients,” BMC Medical Informatics and Decision Making, vol. 17, no. 1, p. 79, 2017.View at: Publisher Site | Google Scholar
S. O’Connell, V. J. C. Mc Carthy, and E. Savage, “Frameworks for self-management support for chronic disease: a cross-country comparative document analysis,” BMC Health Services Research, vol. 18, no. 1, p. 583, 2018.View at: Publisher Site | Google Scholar
R. Grol, M. Wensing, and M. Eccles, Improving Patient Care: The Implementation of Change in Clinical Practice, Elsevier Butterworth Heinemann, Edinburgh, 2005.
M. R. Lennon, M. M. Bouamrane, A. M. Devlin et al., “Readiness for delivering digital health at scale: lessons from a longitudinal qualitative evaluation of a national digital health innovation program in the United Kingdom,” Journal of Medical Internet Research, vol. 19, no. 2, article e42, 2017.View at: Publisher Site | Google Scholar
J. Ross, F. Stevenson, R. Lau, and E. Murray, “Factors that influence the implementation of e-health: a systematic review of systematic reviews (an update),” Implementation Science, vol. 11, no. 1, p. 146, 2016.View at: Publisher Site | Google Scholar
D. Mangin, J. Parascandalo, O. Khudoyarova, G. Agarwal, V. Bismah, and S. Orr, “Multimorbidity, eHealth and implications for equity: a cross-sectional survey of patient perspectives on eHealth,” BMJ Open, vol. 9, no. 2, article e023731, 2019.View at: Publisher Site | Google Scholar
H. J. M. Vrijhoef, “Make care coordination a high priority,” International Journal of Care Coordination, vol. 20, no. 4, pp. 121-122, 2017.View at: Publisher Site | Google Scholar
R. Miller, J. Cumming, and R. Q. Lewis, “Keeping the faith in integration and primary care,” Journal of Integrated Care, vol. 26, no. 3, pp. 170–174, 2018.View at: Publisher Site | Google Scholar
C. De Pietro and I. Francetic, “E-health in Switzerland: the laborious adoption of the federal law on electronic health records (EHR) and health information exchange (HIE) networks,” Health Policy, vol. 122, no. 2, pp. 69–74, 2018.View at: Publisher Site | Google Scholar
O. Ben-Assuli, “Electronic health records, adoption, quality of care, legal and privacy issues and their implementation in emergency departments,” Health Policy, vol. 119, no. 3, pp. 287–297, 2015.View at: Publisher Site | Google Scholar
D. Blumenthal and M. Tavenner, “The “meaningful use” regulation for electronic health records,” The New England Journal of Medicine, vol. 363, no. 6, pp. 501–504, 2010.View at: Publisher Site | Google Scholar
R. Lau, F. Stevenson, B. N. Ong et al., “Addressing the evidence to practice gap for complex interventions in primary care: a systematic review of reviews protocol,” BMJ Open, vol. 4, no. 6, article e005548, 2014.View at: Publisher Site | Google Scholar
P. Sugarhood, J. Wherton, R. Procter, S. Hinder, and T. Greenhalgh, “Technology as system innovation: a key informant interview study of the application of the diffusion of innovation model to telecare,” Disability and Rehabilitation: Assistive Technology, vol. 9, no. 1, pp. 79–87, 2013.View at: Publisher Site | Google Scholar
A. Lang, “Government capacities and stakeholders: what facilitates ehealth legislation?” Globalization and Health, vol. 10, no. 1, p. 4, 2014.View at: Publisher Site | Google Scholar
World Health Organization (WHO), WHO guideline: recommendations on digital interventions for health system strengthening, World Health Organization, Geneva, Switzerland, 2019.
R. Miller, C. Weir, and S. Gulati, “Transforming primary care: scoping review of research and practice,” Journal of Integrated Care, vol. 26, no. 3, pp. 176–188, 2018.View at: Publisher Site | Google Scholar
S. Gress, C. A. Baan, M. Calnan et al., “Co-ordination and management of chronic conditions in Europe: the role of primary care–position paper of the European Forum for Primary Care,” Quality in Primary Care, vol. 17, no. 1, pp. 75–86, 2009.View at: Google Scholar
D. Rudoler, A. Peckham, A. Grudniewicz, and G. Marchildon, “Coordinating primary care services: a case of policy layering,” Health Policy, vol. 123, no. 2, pp. 215–221, 2019.View at: Publisher Site | Google Scholar
H. Kluge, E. Kelley, S. Barkley et al., “How primary health care can make universal health coverage a reality, ensure healthy lives, and promote wellbeing for all,” The Lancet, vol. 392, no. 10156, pp. 1372–1374, 2018.View at: Publisher Site | Google Scholar
OECD/EU, Health at a Glance: Europe 2016. state of health in the EU cycle, OECD Publishing, Paris, 2016.
P. Lehoux, F. Roncarolo, H. P. Silva, A. Boivin, J. L. Denis, and R. Hébert, “What health system challenges should responsible innovation in health address? Insights from an international scoping review,” International Journal of Health Policy and Management, vol. 8, no. 2, pp. 63–75, 2019.View at: Publisher Site | Google Scholar
G. Berntsen, F. Strisland, K. Malm-Nicolaisen, B. Smaradottir, R. Fensli, and M. Røhne, “The evidence base for an ideal care pathway for frail multimorbid elderly: combined scoping and systematic intervention review,” Journal of Medical Internet Research, vol. 21, no. 4, article e12517, 2019.View at: Publisher Site | Google Scholar