Table of Contents Author Guidelines Submit a Manuscript
BioMed Research International
Volume 2017 (2017), Article ID 9569348, 12 pages
Research Article

Identifying High-Cost, High-Risk Patients Using Administrative Databases in Tuscany, Italy

1Medical School of Hygiene and Preventive Medicine, University of Florence, Florence, Italy
2Agenzia Regionale Sanità, Tuscany, Italy
3Health Care Continuity Unit, University Hospital of Careggi, Florence, Italy
4Local Health Authorities of Central Tuscany, Florence, Italy

Correspondence should be addressed to Irene Bellini

Received 24 November 2016; Revised 16 April 2017; Accepted 24 May 2017; Published 10 July 2017

Academic Editor: Alberto Raggi

Copyright © 2017 Irene Bellini et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


Objective. (1) Assessing the performance of the algorithm in terms of sensitivity and positive predictive value, considering General Practitioners’ (GPs) judgement as benchmark, and (2) describing adverse events (hospitalisation, death, and health services’ consumption) of complex patients compared to the general population. Data Sources. (i) Tuscany administrative database containing health data (2013-5); (ii) lists of complex patients indicated by GPs; and (iii) annual health registry of Tuscany. Study Design. The present study is a validation study. It compares a list of complex patients extracted through an administrative algorithm (criteria of high health consumption) to a gold standard list of patients indicated by GPs. GPs’ decision was subjective but fairly well reasoned. The study compares also adverse outcomes (Emergency Room visits, hospitalisation, and death) between identified complex patients and general population. Principal Findings. Considering GPs’ judgement, the algorithm showed a sensitivity of 72.8% and a positive predictive value of 64.4%. The complex cases presented here have higher incidence rates/100,000 (death 46.8; ER visits 223.2, hospitalisations 110.87, laboratory tests 1284.01, and specialist examinations 870.37) compared to the general population. Conclusions. The final validated algorithm showed acceptable sensitivity and positive predictive value.

1. Introduction

Several complex interventions were developed in the emerging field of multimorbidity. They are care management programmes aimed at meeting the needs of patients suffering from multiple chronic conditions, at high risk, with an important consumption of services and sited at the top of the Kaiser Permanente Pyramid [1]. These programmes are designed to assist patients and their caregivers to manage medical conditions and medical care plans, to improve the quality of care, and to reduce health care costs [25].

Some Italian regions are planning or testing care management initiatives to handle these problems. These projects identify patients at higher risk of hospitalisation using administrative data and subsequently improve their care at local level with multidisciplinary and multiprofessional teams. These initiatives are not coordinated with each other, and there are uncertainties regarding both the real ability to identify the most complex patients and the effectiveness of these models in providing health benefits and reducing resources’ consumption.

In October 2015, a project called “Chronic Diseases: Support and Comparative Evaluation of Interventions Aimed at the Proactive Identification and Taking Charge of Complex Patients, in Order to Prevent Repetitive Hospitalisations” was approved from the Italian Ministry of Health and officially implemented in Tuscany in March 2016 [6, 7]. The first identification phase of complex cases was thus concluded. This phase has both a diagnostic and a prognostic function: complex patients were characterised through administrative data and in the meanwhile analysed for prognosis.

The objectives of this study are both development and validation of the algorithm (based on administrative data) used to identify complex patients concerning(1)performance of the model considering complex patients identified by GPs as a benchmark;(2)a comparison in terms of adverse events (hospitalisations, death, and consumption of health services) between identified complex patients and the general population.

2. Materials and Methods

Firstly, from December 2015 to July 2016, a literature review [810] was conducted in order to determine what a complex patient is and the following teamwork allowed to regard him/her as “a community dwelling patient at higher risk of repetitive visits to the Emergency Room (excluding low codes and trauma) or repetitive hospitalisations (ordinary and for medical diagnosis) for one or more chronic conditions suitable to ambulatory care. These conditions require the patient to be taken in charge by a multidisciplinary team (general practitioner, nurse, specialist, social worker, and primary health care doctor) with a personalized care plan.”

All the characteristics chosen for the definition were taken from the literature (Table 1).

Table 1: Examples of elements of complexity found in the literature.

For a better definition, Region Tuscany’s resolution number 370 of 3/22/2010 was also considered. This regards a complete assistance for disabled patients focusing especially on complex social and health care needs. After a multidisciplinary evaluation called UVM (multidisciplinary assessment unit), since 2010 these patients have been receiving special indirect (financial support) or direct assistance (domiciliary visits by nurses or social workers or special programmes involving periodic examinations by GPs). Some of these patients can also be complex patients, but in this case they should also present the following key characteristics: chronic multimorbidity, polytherapy, and multidisciplinary health assistance needs. Complex patients should be involved in a case management programme comprehending a multidisciplinary team with specialists, more suitable to handle with complex health needs. The identification of complex patients requires an administrative algorithm and then the final judgement of the GPs. Patients at risk can be notified not just by the GPs but also by relatives, neighbours, and friends and their needs are assessed through UVM (nurse, social worker, and primary health care doctor). The consequent taking-in-charge of patients can be simpler if it involves just one type of professional (for example, nurses). Instead, complex patients having also social problems should receive social support in addition to care management and their involvement is supposed to occur according to the GP’s decision.

2.1. Data Sources

The source of data was administrative (registry data analysis) and it protects patients privacy hiding personal data [11]. Considered databases contained the following information: hospital discharges from Tuscan public or accredited hospitals (ICD 10 CM coded diagnosis), all drugs bought, all laboratory tests, and specialist examinations.

MaCro is a database that classifies patients with chronic diseases combining administrative databases.

For each disease in the above-mentioned flows, it detects cases meeting defined criteria [12].

The yearly health registry, containing all living residents, was finally used to assess the predictivity of the algorithm and to assess the mortality rate.

2.1.1. Objective  1: Performance of the Model

List according to the Algorithm. A list of complex patients was produced using administrative data. Complex patients were identified if they met the following criteria.

Criterion 1. We included community dwelling patients older than 59, whose consumption rate is in the highest 5% s, with at least one of the following characteristics:(1)More than 2 ordinary hospital admissions at medical facilities during the previous year(2)More than 2 Emergency Room (ER) visits, excluding white codes and trauma, during the previous year(3)Consumed more than 16 kinds of prescription drugs (ATC5) during the previous year(4)More than 6 laboratory tests during the previous year(5)More than 6 specialist examinations during the previous year(6)One multidisciplinary evaluation audit (composed of a community health doctor, nurse, and social worker and aimed at the drafting of a personalized care intervention) or being in a special domiciliary care programme called in Italy ADI or ADP (integrated or programmed domiciliary assistance, resp.).

Criterion 2. A further selection was carried out from the previous sample considering only those patients with at least one hospital admission during the previous three years for a diagnosis found in the chosen list of Aggregated Clinical Codes ACC (from now on defined as ACC database) and a revision of CCS (Clinical Classifications Software) (Table 2) or found in the MaCro database for being affected with diabetes, COPD, heart failure, ischemic heart disease, or dementia. Diagnoses with codes ICD10 CM corresponding to each ACC/CCS are available online [13].

Table 2: Chosen list of ACC/CCS codes.

List of GPs. The final list of complex patients according to GPs (gold standard) in 2015 was developed during several steps.

First Step. GPs produced a list of those patients among those who fulfilled the given criteria as at 12/31/2014.

The list included the following data:(i)Patient identity (with fiscal code)(ii)Criteria for the identification of complex patients(1)What are the patient’s complex chronic conditions?(2)Would you be surprised if the patient visited an ER and was admitted by a hospital because of a worsening of his/her chronic disease in the next 6 months?(3)If there was an opportunity for the patient to receive proactive and multidisciplinary care, would the patient avoid ER department visits or being admitted into a hospital?(iii)Drugs and possible polytherapy(iv)Functional status and ability to move(v)Cognitive status (dementia or memory disorders)(vi)Mental health(vii)Social network(viii)Socioeconomic status(ix)Living area and connections(x)Life expectation (considering the surprise question: “would you be surprised if the patient died in the next 12 months?”)(xi)Other free considerations51 GPs, working in 5 different Tuscan Local Health Units LHUs (which until the end of 2015 approximately corresponded to provinces) in Tuscany (Arezzo, Livorno, Massa, Lucca, and Florence), were voluntarily involved and produced the list.

Second Step. Fiscal codes containing all the data of each patient are currently replaced with another anonymous univocal code (called IdUni) in order to use health related data for statistical purposes without violating personal privacy [11].

Only LHUs have the key to switch from IdUni to fiscal codes and personal data of patients, so these 5 LHUs switched the fiscal codes given by GPs into IdUni codes and vice versa, in order to compare results between the lists given by the GPs and the final results of the developed algorithm. GPs received the administrative lists and could choose whether to maintain or remove cases found through the algorithm or add new ones. Validation test was conducted matching the identified complex patients through the algorithm with the lists of GPs (see further) and disaggregated according to the judgement of GPs in true positive (TP), false positive (FP), true negative (TN), and false negative (FN):(i)True positives (TPs) are those patients selected both by GPs and through the algorithm.(ii)False positives (FPs) are those patients identified through the algorithm but not confirmed by GPs.(iii)False negatives (FNs) are those patients indicated by GPs but not found through the algorithm.(iv)True negatives (TNs) are those patients not complex for both GPs and algorithm.Some GPs, who had previously sent their questionnaire, were removed for the following reasons:(i)They did not comment on the list of administrative data.(ii)They had a prevalence of complex cases lower than 5%.(iii)They did not change their mind at least for one false positive.

The final number of GPs considered was 40.

Final Adjustment. FNs not detected through the algorithm and not present in the MaCro database nor in the hospitalisation registry were reanalysed considering the information given by GPs regarding active diseases with an attributable ACC code.

2.1.2. Objective 2: Adverse Events’ Comparison

In order to assess prognosis in terms of adverse events (hospitalisation, death, and consumption of health services) comparing identified complex patients to the general population, the final algorithm was used on the whole population living in Tuscany on 12/31/2013 and recorded in the health registry. Some indicators, such as mortality, ER visits, hospitalisations, laboratory tests, and specialist examinations, were compared with noncomplex patients in order to test the predictivity of the model. For the population at 12/31/2013 outcomes were considered during 2014 to test the capacity of the algorithm to identify patients at higher risk of adverse events in the year following the one of identification (it was chosen to study outcomes in 2014 because in 2015 considered outcomes in 2016 were not still available).

3. Results

The results of the comparison between the final administrative algorithm and the judgement of the GPs can be described in the already mentioned three groups (Figure 1):(i)True positive (TP) cases were finally 808.(ii)False positive (FP) cases were 446, and the main reasons of exclusion explained by GPs were the following: 44%, well compensated; 25%, autonomous; and 11%, healed.(iii)False negative (FN) cases were 302.Definitive complex cases were then the true positive and false negative ones.

Figure 1: Final results.

The 40 GPs confirmed 1,110 complex cases, and the administrative algorithm found 1,254, with an initial concordance with the algorithm regarding only 260 patients, but another 506 were recognized as complex after the GPs received the lists. The administrative algorithm showed a sensitivity of 72.8% and a positive predictive value of 64.4%.

Table 3 shows that women prevailed in all three groups (TPs, FNs, and FPs), being, respectively, 52, 56, and 52%. The percentage of people aged 80 and over was higher among FNs (63%), followed by TPs (49%) and FPs (35%). Patients aged 60–74 years were more numerous among FPs (41%) than among TPs (31%) and FNs (21%). FNs were the oldest and FPs the youngest (Table 3).

Table 3: Characteristics and outcomes in 2015 for complex patients disaggregated by TP, FN, and FP.

Matching combined lists of complex patients found by GPs and algorithm and disaggregated in TPs, FPs, and FNs, with MaCro database (containing chronic diseases), the patients diagnosed with at least one chronic disease were 88% among TPs, 83% among FPs, and 58% among FNs. TPs always presented the highest prevalence for each disease, apart from diabetes, which is higher among FPs than TPs and FNs (33% versus 26% and 26%). FNs always showed the lowest prevalence for COPD, dementia, and diabetes but presented a higher rate of heart failure (16%) and ischemic cardiopathy (26%) compared to FPs (11 and 24%, resp.; see Table 3). Matching again the same list with ACC database, with FNs manually readjusted, the differences in the prevalence of diseases were smaller between TPs and FNs, even if TPs showed a higher burden for neurological problems (50% versus 9%). FP had a lower prevalence compared to TPs and FNs. The average number of ACC disease cases per capita was 1.1 for TPs, 0.7 for FNs, and 0.4 for FPs.

TPs had the highest health consumption too, apart for laboratory tests, performed more frequently among FP (48%) than among TPs (40%). FNs always showed the lowest health consumption (Table 3).

FNs were not detected by the algorithm for several reasons.

They had fewer diseases according to the MaCro database. 58% of FNs had at least one disease in the MaCro database, compared to 88% of TPs and 83% of FPs. Most of them were not high consumers (just 47 out of 302 met at least one consumption criterion and can be defined high consumers, as proved by the lower values in the “consumption” heading of Table 3). Among the 255 not high consumer FNs cases, 88 had at least one ACC, but it did not cause hospital admission nor any criterion for high consumption. 167 had not any ACC and they were not high consumers either. 46 were high consumers but they were not in the ACC database.

173 out of 255 FNs not high consumers were in the MaCro database with at least one diagnosis, meaning they had a chronic disease causing neither hospital admissions nor high consumption, 82 had neither MaCro diseases nor high consumption. 46 were not in the MaCro database but they were high consumers.

Matching the MaCro and hospitalisation databases for a particular ACC in the previous year, 93 patients were not found in any of these, and 25 of them turned out to be high consumers. The final adjustment we described tried to answer the question whether these FNs patients had diseases which were not considered or if they had diseases without specific related consumption. Information given by the GPs for these 93 patients was then reconsidered and manually recoded for a MaCro or ACC disease. The 25 FNs who were also high consumers but without diagnosis were also analysed to check their characteristics. For all 25 cases, we found one or more diseases, whose ACC or MaCro code could be attributed manually. The ACCs with the highest prevalence were Card1 and Neur (9 diagnoses each; see Table 2). As for the MaCro database, heart failure disease had the highest frequency (9 cases).

The FPs captured by the algorithm but rejected by the GPs were 446. The GPs reported a reason in 327 cases out of 446, and for 152 of them it was good compensation and a still autonomous lifestyle, 19 showed better conditions compared to the past exacerbations, and 12 were just following an oral anticoagulant therapy.

In the meanwhile, we studied the frequency of other characteristics found in the survey but not in the algorithm, such as functional status, social network, economic situation, area of residence, and end-of-life status on the first sample of 182 TPs patients (on a total of 808) and 300 FNs patients (out of a total of 302). These pieces of information were reported in the questionnaire filled by GPs and they were again analysed through Excel disaggregating records into TPs and FNs. The percentages were the same for TPs and FNs. For TPs, 20% were bedridden, 27% could only walk if aided, 13% had dementia, 17.5% had mental diseases, 15% lived alone, 15% were poor, 14% lived far from health care facilities, and 60% got a “No” at the surprise question.

For FNs, 13% were bedridden, 39% could only walk if aided, 13% had dementia, 18% had mental diseases, 18% lived alone, 14% were poor, 19% lived distant from health care facilities, and 60% got a “No” on the surprise question.

Overall, the prevalence of complex patients, considering our sample, is about 2.3% of the total patients found in the GPs’ lists. Considering that the enrolled GPs had an average number of patients of 1,250, the average number of complex patients for each GP was then 29.

Table 4 shows the comparison for the year 2014 between the 108,479 complex cases identified in the whole population living in Tuscany as at the 12/31/2013 (population identified through the algorithm is FP + TP) and the other supposedly noncomplex patients (FN + TN). Analysing outcomes (deaths, ER visits, and hospitalisations rates) and health consumption, TP complex cases identified through the algorithm, as inferable from Table 4, presented during the year 2014 the highest incidence rates/100,000 (deaths, 46.8; ER visits, 223.2; hospitalisations, 110.87; laboratory tests, 1284.01; specialist examinations, 870.37, resp.). Noncomplex patients identified through the algorithm as TN always presented the lowest incidence rates (deaths, 37.27; ER visits, 96.9, hospitalisations, 59.63, laboratory tests, 633.57, and specialist examinations, 454.68), apart from death and hospitalisation incidence rates, which were lower among FP. FN and FP had intermediate values, excluding the two exceptions mentioned above.

Table 4: Rates/100 person-years in 2014.

4. Discussion

As inferable from Tables 3 and 4, the use of the algorithm is very suitable and predictive in identifying the highest costs chronic patients having a greater impact on the Health Care System and a higher probability to die because of their diseases. However, complex patients are difficult to identify because they present different characteristics. Not all people extracted through the algorithm fulfilling the given criteria to be complex are indeed true positive, according to GPs’ judgement. The false positive patients identified, noncomplex, because they have lower death rates, ER visits, and hospitalisations, were anyway high consumers in terms of laboratory tests and specialistic examinations, as may be inferred from Table 4. They were detected by the algorithm because they met the criteria and had presumably more chronic diseases but were well compensated and consequently did not go to the hospital and died less often. The GPs reported indeed precisely these reasons for their exclusion. Instead, false negative patients were not extracted because they were not high consumers (laboratory tests and specialist examination rates were the lowest after TNs; see Table 4). However, they went to the hospital and died almost as often as TPs. This is in contrast with the findings reported in Table 3, where FNs seemed to present lower hospitalisation and ER visit rates. Evidently, the causes of hospitalisation were not among the ACCs chosen and consequently were not detected by the algorithm. To answer the above question, they probably had diseases that were still not codified (because they were difficult-to-reach patients) or they had codified diseases without specific related consumption (difficult-to-treat patients), but they were as ill as the TPs and with the same high risk of complications.

Other similar studies found the same difficulty [14]: counting the number of comorbid conditions does not necessarily mean that a patient is complex; instead it seemed that primary care physicians pointed that some patients of theirs with very complicated medical histories were relatively straightforward to manage (and they corresponded to the false positives often presenting a high prevalence of diseases and health consumption), whereas other patients could represent a real challenge despite relatively few medical diagnoses. Another study [15] emphasized the importance of social and behavioural contexts that can create important barriers to delivering high-quality primary care and declaring a patient to be complex and eligible for a care management programme.

Another study [16] found that PCPs considered the concept of patient complexity as a combination of medical illnesses, mental illnesses, socioeconomic challenges, and/or behaviours or traits that complicated care for chronic medical illnesses. In the same study, some physicians broadly defined complex patients as those who did not easily fit into guidelines or algorithms. The complexity is reported also as an interference with standard care and decision-making [17].

Our study did not find significant differences based on socioeconomic or social characteristics; therefore, the identification of FNs and of final complex patients is very difficult.

End-of-life patients, identified with the “surprise question,” were 60% among FNs and TPs, unexpectedly without significant differences between these two groups. However, this indicated that palliative care should be considered in the management of these patients.

The identification difficulties reflect the lack of guidelines and the difficult management of these patients. Individual experiences cannot be generalized. Another perspective is offered by a recent study [18], defining complexity as the gap between patient needs and health care services. This concept takes into account both the multiple considerations that affect the needs of patients with multiple chronic conditions and the contextual factors that influence service delivery.

The sensitivity found was 72.8%, considering GPs’ judgement as a validation. However, using just the administrative algorithm is not enough; the algorithm was not perfect, as proved by FNs and FPs. Complex patients often present not detectable characteristics except through the judgement of their GPs, whose role is then essential for the validation of data and identification of FNs and FPs cases.

The main limitations of the present study were as follows: predictors were not analysed; the list considered as gold standard (GPs’ judgement) was not independent from algorithm list. GPs received, indeed, the list extracted through administrative databases and were encouraged to change their mind adding or removing patients from their original lists. This unconventional method was considered the one with the highest face validity for our purpose. After several meetings among experts, being sure to “catch” all complex patients through GPs seemed the best one. GPs could indeed remember just some of these patients and the provided list extracted through the algorithm helped them to think about other patients among theirs too.

Overall, the role of administrative databases analysed by ARS was equally important, because algorithm reminded GPs, who had the task of confirming or editing patients in the list, of those high-risk cases which they had not thought of at first. They could, indeed, add those more socially vulnerable cases that, being neither big consumers nor high-costs patients, were not detected through the administrative algorithm, but who would benefit from a care management programme. In the same way, GPs could remove from their lists those cases classified as high-risk because of their high-cost but not eligible for care management.

5. Conclusion

Overall we can state that the final algorithm, validated through the judgement of GPs and confirmed by a further analyses on adverse outcomes, showed acceptable sensitivity and positive predictive value, even if the final lists should always be checked by the GPs because too many other behavioural, social, or different factors influence the definition and these cannot be detected with the common health administrative database.

Conflicts of Interest

The authors declare that they have no conflicts of interest.


The research was conducted by Agenzia Regionale Sanità (ARS) [regional health care agency], Florence, Tuscany. This material is based upon work funded by the Centre of Disease Control of the Italian Ministry of Health within the project called “Chronic Diseases: Support and Comparative Evaluation of Interventions Aimed at the Proactive Identification and Taking Charge of Complex Patients, in Order to Prevent Repetitive Hospitalisations.”


  1. Herefordshire Clinical commissioning group, Herefordshire Clinical Commissioning Group Long Term Conditions Strategy & Implementation Plan 2013–2016, p. 5,
  2. T. Freund, C. U. Kunz, D. Ose, J. Szecsenyi, and F. Peters-Klimm, “Patterns of multimorbidity in primary care patients at high risk of future hospitalization,” Population Health Management, vol. 15, no. 2, pp. 119–124, 2012. View at Publisher · View at Google Scholar · View at Scopus
  3. E. Shadmi and T. Freund, “Targeting patients for multimorbid care management interventions: the case for equity in high-risk patient identification,” International Journal for Equity in Health, vol. 12, article 70, 2013. View at Publisher · View at Google Scholar · View at Scopus
  4. J. A. Fleishman and J. W. Cohen, “Using information on clinical conditions to predict high-cost patients,” Health Services Research, vol. 45, no. 2, pp. 532–552, 2010. View at Publisher · View at Google Scholar · View at Scopus
  5. D. W. Bates, S. Saria, L. Ohno-Machado, A. Shah, and G. Escobar, “Big data in health care: using analytics to identify and manage high-risk and high-cost patients,” Health Affairs, vol. 33, no. 7, pp. 1123–1131, 2014. View at Publisher · View at Google Scholar · View at Scopus
  6. Tuscany Regional Council Resolution, no. 1014 of 26-10-2015.
  7. AIRT, 2012,
  8. M. M. Safford, J. J. Allison, and C. I. Kiefe, “Patient complexity: more than comorbidity. The vector model of complexity,” Journal of General Internal Medicine, vol. 22, no. 3, pp. 382–390, 2007. View at Publisher · View at Google Scholar · View at Scopus
  9. L. Edgren, “The meaning of integrated care: a systems approach,” International Journal of Integrated Care, vol. 8, no. 4, pp. 1–6, 2008. View at Publisher · View at Google Scholar
  10. A. Schaink, K. Kuluski, R. Lyons et al., “A scoping review and thematic classification of patient complexity: offering a unifying framework,” Journal of Comorbidity, vol. 2, pp. 1–9, 2012. View at Publisher · View at Google Scholar
  11. Italian Law, no. 675/1996, Tutela delle persone e di altri soggetti rispetto al trattamento dei dati personali, [Protection of persons and other subjects with regard to personal data processing],
  12. MaCro Ars,
  13. Healthcare Cost and Utilization Project website:
  14. What makes patients complex? Ask their primary care physicians,
  15. R. W. Grant, J. M. Ashburner, C. S. Hong, Y. Chang, M. J. Barry, and S. J. Atlas, “Defining patient complexity from the primary care physician’s perspective: a cohort study,” Annals of Internal Medicine, vol. 157, no. 12, article 152, pp. 797–804, 2012. View at Google Scholar
  16. D. F. Loeb, I. A. Binswanger, C. Candrian, and E. A. Bayliss, “Primary care physician insights into a typology of the complex patient in primary care,” Annals of Family Medicine, vol. 13, no. 5, pp. 451–455, 2015. View at Publisher · View at Google Scholar · View at Scopus
  17. C. J. Peek, M. A. Baird, and E. Coleman, “Primary care for patient complexity, not only disease,” Families, Systems, & Health, vol. 27, no. 4, pp. 287–302, 2009. View at Publisher · View at Google Scholar
  18. D. Grembowski, J. Schaefer, K. E. Johnson et al., “Conceptual model of the role of complexity in the care of patients with multiple chronic conditions,” Medical Care, vol. 52, supplement 3, pp. S7–S14, 2014. View at Publisher · View at Google Scholar · View at Scopus
  19. J. F. Fries, “The compression of morbidity,” Milbank Quarterly, vol. 83, no. 4, pp. 801–823, 2005. View at Publisher · View at Google Scholar · View at Scopus
  20. R. E. Upshur and S. Tracy, “Chronicity and complexity: is what’s good for the diseases always good for the patients?” Canadian Family Physician, vol. 54, no. 12, pp. 1655–1658, 2008. View at Google Scholar
  21. L. P. Fried, L. Ferrucci, J. Darer, J. D. Williamson, and G. Anderson, “Untangling the concepts of disability, frailty, and comorbidity: implications for improved targeting and care,” The Journals of Gerontology. Series A, Biological Sciences and Medical Sciences, vol. 59, no. 3, pp. 255–263, 2004. View at Publisher · View at Google Scholar
  22. M. Rijken, M. van Kerkhof, J. Dekker, and F. G. Schellevis, “Comorbidity of chronic diseases: effects of disease pairs on physical and mental functioning,” Quality of Life Research, vol. 14, no. 1, pp. 45–55, 2005. View at Publisher · View at Google Scholar · View at Scopus
  23. E. A. Bayliss, M. S. Bayliss, J. E. Ware Jr., and J. F. Steiner, “Predicting declines in physical function in persons with multiple chronic medical conditions: what we can learn from the medical problem list,” Health and quality of life outcomes, vol. 2, article 47, 2004. View at Google Scholar · View at Scopus
  24. A. Butchart, E. A. Kerr, M. Heisler, J. D. Piette, and S. L. Krein, “Experience and management of chronic pain among patients with other complex chronic conditions,” Clinical Journal of Pain, vol. 25, no. 4, pp. 293–298, 2009. View at Publisher · View at Google Scholar · View at Scopus
  25. M. Bernabeu-Wittel, A. Jadad, L. Moreno-Gaviño et al., “Peeking through the cracks: an assessment of the prevalence, clinical characteristics and health-related quality of life (HRQoL) of people with polypathology in a hospital setting,” Archives of Gerontology and Geriatrics, vol. 51, no. 2, pp. 185–191, 2010. View at Publisher · View at Google Scholar · View at Scopus
  26. D. R. Mutasingwa, H. Ge, and R. E. G. Upshur, “How applicable are clinical practice guidelines to elderly patients with comorbidities?” Canadian Family Physician, vol. 57, no. 7, pp. e253–e262, 2011. View at Google Scholar · View at Scopus
  27. C. M. Boyd, J. Darer, C. Boult, L. P. Fried, L. Boult, and A. W. Wu, “Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance,” The Journal of the American Medical Association, vol. 294, no. 6, pp. 716–724, 2005. View at Publisher · View at Google Scholar · View at Scopus
  28. R. Nardi and G. Scanelli, “Complexity in the care of elderly patients and polypharmacy,” European Journal of Internal Medicine, vol. 19, no. 4, article 304, 2008. View at Publisher · View at Google Scholar · View at Scopus
  29. R. E. G. Upshur, “Looking for rules in a world of exceptions: reflections on evidence-based practice,” Perspectives in Biology and Medicine, vol. 48, no. 4, pp. 477–489, 2005. View at Publisher · View at Google Scholar · View at Scopus
  30. M. Fortin, G. Bravo, C. Hudon, A. Vanasse, and L. Lapointe, “Prevalence of multimorbidity among adults seen in family practice,” Annals of Family Medicine, vol. 3, no. 3, pp. 223–228, 2005. View at Publisher · View at Google Scholar · View at Scopus
  31. M. Fortin, L. Lapointe, C. Hudon, and A. Vanasse, “Multimorbidity is common to family practice: is it commonly researched?” Canadian Family Physician, vol. 51, pp. 244-245, 2005. View at Google Scholar
  32. M. Fortin, L. Lapointe, C. Hudon, A. Vanasse, A. L. Ntetu, and D. Maltais, “Multimorbidity and quality of life in primary care: a systematic review,” Health and Quality of Life Outcomes, vol. 2, article 51, 2004. View at Publisher · View at Google Scholar · View at Scopus
  33. M. Fortin, H. Soubhi, C. Hudon, E. A. Bayliss, and M. van den Akker, “Multimorbidity’s many challenges,” The British Medical Journal, vol. 334, no. 7602, pp. 1016-1017, 2007. View at Publisher · View at Google Scholar · View at Scopus
  34. G. Laux, T. Kuehlein, T. Rosemann, and J. Szecsenyi, “Co- and multimorbidity patterns in primary care based on episodes of care: results from the German CONTENT project,” BMC Health Services Research, vol. 8, article 14, 2008. View at Publisher · View at Google Scholar · View at Scopus
  35. S. W. Mercer, S. M. Smith, S. Wyke, T. O’Dowd, and G. C. M. Watt, “Multimorbidity in primary care: developing the research agenda,” Family Practice, vol. 26, no. 2, pp. 79-80, 2009. View at Publisher · View at Google Scholar · View at Scopus
  36. L. C. Min, N. S. Wenger, C. Fung et al., “Multimorbidity is associated with better quality of care among vulnerable elders,” Medical Care, vol. 45, no. 6, pp. 480–488, 2007. View at Publisher · View at Google Scholar · View at Scopus
  37. C. Salisbury, L. Johnson, S. Purdy, J. M. Valderas, and A. A. Montgomery, “Epidemiology and impact of multimorbidity in primary care: a retrospective cohort study,” British Journal of General Practice, vol. 61, no. 582, pp. e12–e21, 2011. View at Publisher · View at Google Scholar · View at Scopus
  38. I. Schäfer, E.-C. von Leitner, G. Schön et al., “Multimorbidity patterns in the elderly: a new approach of disease clustering identifies complex interrelations between chronic conditions,” PLoS ONE, vol. 5, no. 12, Article ID e15941, 2010. View at Publisher · View at Google Scholar · View at Scopus
  39. S. M. Smith, H. Soubhi, M. Fortin, C. Hudon, and T. O’Dowd, “Interventions for improving outcomes in patients with multimorbidity in primary care and community settings,” Cochrane Database of Systematic Reviews, 2007, Protocols 2:CD006560. View at Google Scholar
  40. S. M. Smith, A. Ferede, and T. O’Dowd, “Multimorbidity in younger deprived patients: an exploratory study of research and service implications in general practice,” BMC Family Practice, vol. 9, article 6, 2008. View at Publisher · View at Google Scholar · View at Scopus
  41. A. Uijen and E. van de Lisdonk, “Multimorbidity in primary care: prevalence and trend over the last 20 years,” European Journal of General Practice, vol. 14, supplement 1, pp. 28–32, 2008. View at Publisher · View at Google Scholar · View at Scopus
  42. J. M. Valderas, B. Starfield, and M. Roland, “Multimorbidity’s many challenges: a research priority in the UK,” BMJ, vol. 334, no. 7604, article 1128, 2007. View at Google Scholar · View at Scopus
  43. M. Van den Akker, F. Buntix, J. F. M. Metsemakers, S. Roos, and J. A. Knottnerus, “Multimorbidity in general practice: prevalence, incidence, and determinants of co-occurring chronic and recurrent diseases,” Journal of Clinical Epidemiology, vol. 51, no. 5, pp. 367–375, 1998. View at Publisher · View at Google Scholar · View at Scopus
  44. R. Reid, R. Evans, M. Barer et al., “Conspicuous consumption: characterizing high users of physician services in one Canadian province,” Journal of Health Services Research and Policy, vol. 8, no. 4, pp. 215–224, 2003. View at Publisher · View at Google Scholar · View at Scopus
  45. M. E. Tinetti, S. T. Bogardus Jr., and J. V. Agostini, “Potential pitfalls of disease-specific guidelines for patients with multiple conditions,” The New England Journal of Medicine, vol. 351, no. 27, pp. 2786–2874, 2004. View at Publisher · View at Google Scholar · View at Scopus
  46. P. H. Noël, M. L. Parchman, J. W. Williams Jr. et al., “The challenges of multimorbidity from the patient perspective,” Journal of General Internal Medicine, vol. 22, supplement 3, pp. 419–424, 2007. View at Publisher · View at Google Scholar · View at Scopus
  47. L. H. Harpole, J. W. Williams Jr., M. K. Olsen et al., “Improving depression outcomes in older adults with comorbid medical illness,” General Hospital Psychiatry, vol. 27, no. 1, pp. 4–12, 2005. View at Publisher · View at Google Scholar · View at Scopus
  48. S. Moussavi, S. Chatterji, E. Verdes, A. Tandon, V. Patel, and B. Ustun, “Depression, chronic diseases, and decrements in health: results from the World Health Surveys,” The Lancet, vol. 370, no. 9590, pp. 851–858, 2007. View at Publisher · View at Google Scholar · View at Scopus
  49. M. Fortin, G. Bravo, C. Hudon, L. Lapointe, M.-F. Dubois, and J. Almirall, “Psychological distress and multimorbidity in primary care,” Annals of Family Medicine, vol. 4, no. 5, pp. 417–422, 2006. View at Publisher · View at Google Scholar · View at Scopus
  50. M. Fortin, C. Hudon, E. A. Bayliss, H. Soubhi, and L. Lapointe, “Caring for body and soul: the importance of recognizing and managing psychological distress in persons with multimorbidity,” International Journal of Psychiatry in Medicine, vol. 37, no. 1, pp. 1–9, 2007. View at Publisher · View at Google Scholar · View at Scopus
  51. C. S. Blaum, M. B. Ofstedal, and J. Liang, “Low cognitive performance, comorbid disease, and task-specific disability: findings from a Nationally Representative Survey,” The Journals of Gerontology Series A: Biological Sciences and Medical Sciences, vol. 57, no. 8, pp. M523–M531, 2002. View at Publisher · View at Google Scholar
  52. D. G. Bruce, G. P. Casey, V. Grange et al., “Cognitive impairment, physical disability and depressive symptoms in older diabetic patients: the fremantle cognition in diabetes study,” Diabetes Research and Clinical Practice, vol. 61, no. 1, pp. 59–67, 2003. View at Publisher · View at Google Scholar · View at Scopus
  53. B. Dickey, S.-L. T. Normand, R. D. Weiss, R. E. Drake, and H. Azeni, “Medical morbidity, mental illness, and substance use disorders,” Psychiatric Services, vol. 53, no. 7, pp. 861–867, 2002. View at Publisher · View at Google Scholar · View at Scopus
  54. M. Donald, J. Dower, and D. Kavanagh, “Integrated versus non-integrated management and care for clients with co-occurring mental health and substance use disorders: a qualitative systematic review of randomised controlled trials,” Social Science and Medicine, vol. 60, no. 6, pp. 1371–1383, 2005. View at Publisher · View at Google Scholar · View at Scopus
  55. Canadian Institute for Health Information, “Supporting informal caregivers: the heart of home care,” in Analysis in Brief, Canadian Institute for Health Information, Ontario, Canada, 2010, View at Google Scholar
  56. E. S. Hough, G. A. Brumitt, and T. N. Templin, “Social support, demands of illness, and depression in chronically ill urban women,” Health Care for Woman International, vol. 20, no. 4, pp. 349–362, 1999. View at Publisher · View at Google Scholar · View at Scopus
  57. I. Vassilev, A. Rogers, C. Sanders et al., “Social networks, social capital and chronic illness self-management: a realist review,” Chronic Illness, vol. 7, no. 1, pp. 60–86, 2011. View at Publisher · View at Google Scholar · View at Scopus
  58. P. H. Noël, B. C. Frueh, A. C. Larme, and J. A. Pugh, “Collaborative care needs and preferences of primary care patients with multimorbidity,” Health Expectations, vol. 8, no. 1, pp. 54–63, 2005. View at Publisher · View at Google Scholar · View at Scopus
  59. E. F. Ravenscroft, “Navigating the health care system: insights from consumers with multi-morbidity,” Journal of Nursing and Healthcare of Chronic Illness, vol. 2, no. 3, pp. 215–224, 2010. View at Publisher · View at Google Scholar
  60. E. A. Bayliss, A. E. Edwards, J. F. Steiner, and D. S. Main, “Processes of care desired by elderly patients with multimorbidities,” Family Practice, vol. 25, no. 4, pp. 287–293, 2008. View at Publisher · View at Google Scholar · View at Scopus
  61. M. A. Sevick, J. M. Trauth, B. S. Ling et al., “Patients with complex chronic diseases: perspectives on supporting self-management,” Journal of General Internal Medicine, vol. 22, supplement 3, pp. 438–444, 2007. View at Publisher · View at Google Scholar · View at Scopus
  62. M. Mirolla, The Cost of Chronic Disease in Canada: Executive Summary, The Chronic Disease Prevention Alliance of Canada, Ottawa, Canada, 2004.
  63. G. Finlayson, O. Ekuma, M. Yogendran, E. Burland, and E. Forget, “The additional cost of chronic disease in manitoba,” Tech. Rep., Manitoba Centre for Health Policy, Winnipeg, Canada, 2010. View at Google Scholar
  64. G. Anderson and J. Horvath, Chronic Conditions: Making the Case for Ongoing Care, Johns Hopkins University for The Robert Wood Johnson Foundation, Baltimore, Md, USA, 2002,
  65. RA. Berenson and J. Horvath, “The clinical characteristics of Medicare beneficiaries and implications for Medicare reform,” in Proceedings of the Conference on Medicare Coordinated Care, Report for The Centre of Medicare Advocacy, Inc., 2002,
  66. M.-J. Chi, C.-Y. Lee, and S.-C. Wu, “The prevalence of chronic conditions and medical expenditures of the elderly by chronic condition indicator (CCI),” Archives of Gerontology and Geriatrics, vol. 52, no. 3, pp. 284–289, 2011. View at Publisher · View at Google Scholar · View at Scopus
  67. R. Banerjea, U. Sambamoorthi, D. Smelson, and L. M. Pogach, “Expenditures in mental illness and substance use disorders among veteran clinic users with diabetes,” Journal of Behavioral Health Services and Research, vol. 35, no. 3, pp. 290–303, 2008. View at Publisher · View at Google Scholar · View at Scopus
  68. J. M. Valderas, B. Starfield, B. Sibbald, C. Salisbury, and M. Roland, “Defining comorbidity: Implications for understanding health and health services,” Annals of Family Medicine, vol. 7, no. 4, pp. 357–363, 2009. View at Publisher · View at Google Scholar · View at Scopus
  69. U. T. Kadam and P. R. Croft, “Clinical multimorbidity and physical function in older adults: a record and health status linkage study in general practice,” Family Practice, vol. 24, no. 5, pp. 412–419, 2007. View at Publisher · View at Google Scholar · View at Scopus
  70. A. S. Karlamangla, M. Tinetti, J. Guralnik, S. Studenski, T. Wetle, and D. Reuben, “Comorbidity in older adults: nosology of impairment, diseases, and conditions,” Journals of Gerontology—Series A: Biological Sciences and Medical Sciences, vol. 62, no. 3, pp. 296–300, 2007. View at Publisher · View at Google Scholar · View at Scopus
  71. M. Van Den Akker, F. Buntinx, J. F. M. Metsemakers, and J. A. Knottnerus, “Marginal impact of psychosocial factors on multimorbidity: results of an explorative nested case-control study,” Social Science and Medicine, vol. 50, no. 11, pp. 1679–1693, 2000. View at Publisher · View at Google Scholar · View at Scopus
  72. N. E. Schoenberg, C. Leach, and W. Edwards, “‘It’s a toss up between my hearing, my heart, and my hip’: prioritizing and accommodating multiple morbidities by vulnerable older adults,” Journal of Health Care for the Poor and Underserved, vol. 20, no. 1, pp. 134–151, 2009. View at Publisher · View at Google Scholar · View at Scopus
  73. R. Nardi, G. Scanelli, S. Corrao, I. Iori, G. Mathieu, and R. Cataldi Amatrian, “Co-morbidity does not reflect complexity in internal medicine patients,” European Journal of Internal Medicine, vol. 18, no. 5, pp. 359–368, 2007. View at Publisher · View at Google Scholar · View at Scopus
  74. C. Phillips-Harris, “Case management: high-intensity care for frail patients with complex needs,” Geriatrics, vol. 53, no. 2, pp. 62–68, 1998. View at Google Scholar · View at Scopus
  75. S. W. Mercer and G. C. M. Watt, “The inverse care law: clinical primary care encounters in deprived and affluent areas of Scotland,” Annals of Family Medicine, vol. 5, no. 6, pp. 503–510, 2007. View at Publisher · View at Google Scholar · View at Scopus
  76. J. Sarkar, L. M. Lix, S. Bruce, and T. Kue Young, “Ethnic and regional differences in prevalence and correlates of chronic diseases and risk factors in northern Canada,” Preventing Chronic Disease, vol. 7, no. 1, article A13, 2010. View at Google Scholar · View at Scopus
  77. M. A. Schofield and M. Ashworth, “Inequalities in health due to ethnicity and social deprivation—an analysis of primary care data from one inner-city area over a three year period,” UK National Audit Office, 2010, View at Google Scholar
  78. G. L. Jackson, M. Weinberger, N. S. Hamilton, and D. Edelman, “Racial/ethnic and educational-level differences in diabetes care experiences in primary care,” Primary Care Diabetes, vol. 2, no. 1, pp. 39–44, 2008. View at Publisher · View at Google Scholar · View at Scopus
  79. J. Conly, J. Glassford, N. Guebert, J. Lapin, K. Schultz, and G. Barrington, “Medical access to service project—calgary zone, phase 2—outcome assessment—final report,” Alberta Health Services, Alberta Health Services, Edmonton, Canada, 2009, View at Google Scholar