Table of Contents Author Guidelines Submit a Manuscript
Canadian Respiratory Journal
Volume 2019, Article ID 3435103, 11 pages
https://doi.org/10.1155/2019/3435103
Review Article

Effects of Meteorological Factors on Hospitalizations in Adult Patients with Asthma: A Systematic Review

1Ph.D. Candidate, Centre for Rural Health Studies, Clinical Epidemiology Department, Faculty of Medicine, Memorial University of Newfoundland, St. John’s, Canada
2MD, MSc, FACP, ABPM, FRCPC, Respirologist, Royal Victoria Regional Health Centre, Barrie, Ontario, Canada
3M.Sc. Candidate, Centre for Rural Health Studies, Clinical Epidemiology Department, Faculty of Medicine, Memorial University of Newfoundland, St. John’s, Canada
4MLIS, Public Services Librarian Health Sciences Library, Memorial University of Newfoundland, St. John’s, Canada
5MD, MPH, Ph.D., Associate Professor, Director of Centre for Rural Health Studies, Faculty of Medicine, Memorial University of Newfoundland, St. John’s, Canada

Correspondence should be addressed to Shabnam Asghari; ac.num.dem@irahgsa.manbahs

Received 22 January 2019; Revised 5 April 2019; Accepted 5 May 2019; Published 2 June 2019

Academic Editor: Angelo G. Corsico

Copyright © 2019 Elnaz Bodaghkhani et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background. Environmental factors such as weather variables contribute to asthma exacerbation. The impact of meteorological factors on asthma-related hospital admissions (HAs) or emergency department visits (EDVs) has been assessed in the literature. We conducted a systematic review to establish a conclusion of whether these findings from the literature are consistent and generalizable or if they vary significantly by certain subgroups. Objective. This study aims to review the effect of meteorological variables on asthma HAs and EDVs in adults, to identify knowledge gaps and to highlight future research priorities. Method. A systematic search was conducted in electronic databases such as PubMed, Embase, and CINAHL. All studies published in English were screened and included if they met the eligibility criteria. Two independent reviewers assessed the quality of the studies and extracted the data. The available evidence was summarized and presented using a harvest plot. Results. Our initial search returned a total of 3887 articles. After screening titles, abstracts, and full texts, 16 studies were included. Thirty-one percent of the included studies (5/16) found that temperature was the only factor associated with asthma hospitalization or EDVs. Six studies (37%) found that both temperature and relative humidity were associated with HAs. Four studies (25%) identified thunderstorms as a possible factor associated with asthma hospitalization in adults. Conclusion. Our review suggests that HAs and EDVs due to asthma are associated with many meteorological factors. Among the articles included in this review, changing temperature is the most commonly studied variable. We did not find studies that measured barometric pressure, weather phenomena, or the effect of tornados. To develop effective strategies to protect subjects at risk, further studies are required.

1. Introduction

Asthma is a chronic inflammatory condition which is characterized by reversible air flow obstruction [1]. Those affected by this condition may present symptoms such as wheezing, breathlessness, coughing, and chest tightness. This chronic condition is highly prevalent, and according to the World Health Organization (WHO), 300 million people around the world have asthma; it is estimated that 100 million more people will be affected by 2025 [2]. While the etiology of asthma is currently unknown, it is believed that factors such as genetics, lifestyle choices, and environmental factors contribute to asthma exacerbation which may lead to HAs [3].

Among environmental factors, weather and air pollution play an important role in increasing asthma exacerbations, which require special care or even hospitalization [4]. Many studies including systematic reviews assessed the effect of pollen, allergens, and air pollutions on asthma hospitalization. While many studies indicate that weather factors are positively associated with HAs due to asthma, the exact mechanism is unclear [1, 5, 6]. Some studies found temperature and humidity could have an influence on airway function and might affect lung function [7]. One theory suggests that water loss in airways during cold conditions causes inflammation that leads to asthma attacks [2]. Another theory suggests that cold and dry air increases the rate of evaporation of surface fluid in airways [8]. Furthermore, some studies show that changes among weather variables can lead to airway inflammation among people with asthma [3].

Some studies suggest that extreme temperature (both cold and hot) and high winds could increase EDVs and hospitalizations among those with asthma [9, 10]. In contrast, other authors did not find any correlation between weather variables and asthma HAs [11]. To our knowledge, there is no review that summarizes the evidence on the effects of meteorological variables on HAs and EDVs among adults with asthma. This review could be important for healthcare demand prediction during weather events. The objectives of this review are (1) to summarize and evaluate the effects of meteorological variables on asthma hospitalization and EDVs in adults, (2) to identify knowledge gaps, and (3) to highlight future research priorities.

2. Methods

2.1. Review Question

Our systematic review question “Do weather conditions affect HAs among adults living with asthma?” was defined using the PECO question format where the study Population is adults (age ≥18 years) who were diagnosed with asthma according to the asthma definition in the study. Exposure of interest includes any weather variables reported in the study. The Control groups are adults with asthma who were not exposed to weather variables, and the Outcome is any admission to hospital units or emergency departments as reported in the manuscripts.

2.2. Data Sources

We searched large electronic databases containing health and medical literature: PubMed (1946 to December 2018), Embase via Embase.com (1947 to December 2018) and CINAHL via Ebsco (1937 to December 2018). Moreover, references of included articles were searched, and the articles deemed eligible were included in the review. The search was originally done in November 2017 and updated to include articles published until December 31, 2018.

2.3. Search Strategy

A series of relevant terms were identified through consultation between content experts and a librarian. The keywords and Medical Subject Headings (MeSH) for this review fall under the following categories: (1) asthma, (2) hospitalization, and (3) meteorological factors. We included a combination of keywords such as temperature, precipitation, thunderstorm, wind speed, and air pressure that could potentially influence asthma hospitalizations and EDVs (see Table 1, a sample search strategy and the key words we used in PubMed).

Table 1: Literature search strategy for PubMed and number of identified articles.
2.4. Inclusion Criteria

Studies included in this review consisted of original research papers from peer-reviewed journals and those published in the English language. We identified studies that focused on HAs or EDVs due to weather factors and looked for adult patients diagnosed with asthma.

Dissertations, audits, policy analyses, book reviews, pilot studies, perspective articles, and research at the planning stage (unless provided in the research directory) were excluded. We also excluded studies that evaluated air pollution as the only exposure and those that used a pediatric population as children respond differently than adults to weather changes.

2.5. Directory of Identified Studies

A directory of publications was created in RefWorks. We used Mendeley to capture and tag the web pages’ information, which we then imported into RefWorks.

2.6. Study Selection

The eligibility of articles included in this review was assessed in two stages:

2.6.1. Stage 1: Prescreening

After removing duplicates, the titles and abstracts were screened by one reviewer (EB). We then selected articles that were deemed eligible for full-text review. A random selection of five percent of the articles was assessed by a second reviewer (CM) to assess the validity of the screening. There was 98% agreement, so a second review of the titles and abstracts was unnecessary.

2.6.2. Stage 2: Full-Text Review

We performed a full text review of relevant articles found in the prescreening phase. Two reviewers (EB and CM) independently checked the full-texts of the articles against the inclusion criteria and fine-tuned the final article selection for data extraction. Any discrepancies were discussed and resolved. Figure 1 shows our PRISMA diagram.

Figure 1: Preferred Reporting items for Systematic Reviews (PRISMA) diagram.
2.7. Data Extraction

A data extraction tool was developed using Excel. The data extraction tool included the following six characteristics: citations (e.g., authors, publication year, journal, and place of study), methodology (e.g., study design and sample size), characteristics of study population (e.g., location of study), meteorological factors (e.g., precipitation, thunderstorms, humidity, and temperature), hospitalization (e.g., HAs and EDVs), and study quality.

Data extraction was conducted by two independent reviewers (EB and CM). A calibration test was performed on the first 10% of the reviewed studies. The Kappa index was calculated to assess inter-reviewer agreement (kappa >0.7 was considered a good agreement). The discordant items were reassessed, and the data extraction tool was revised accordingly. The reviewers met weekly to discuss the extracted data and resolve any disagreements. A third reviewer (SA) was invited to mediate if the disagreement did not resolve.

2.8. Quality Assessment

We used the Critical Appraisal Skills Program (CASP, 2014) tool to assess the quality and risk of bias of included studies. The tool assesses the study design, population of study, sample size, statistical methods, confounding variables, and biases. We did not exclude low-quality studies from this review, but we kept into account this aspect when summarizing the results.

2.9. Synthesis of Results and Data Display

We described all studies that met the eligibility criteria including their quality score. We quantified the frequency of the reported meteorological variables and summarized their effects on HAs or EDVs separately.

We developed a harvest plot to present our systematic review results (Figure 2). A harvest plot is a novel approach to graphically summarize the results of a systematic review of complex and diverse studies [12]. The harvest plot method is flexible by allowing us to display the quantitative data for all studies when it would not be possible to combine in a traditional forest plot [13]. The results of our systematic review show three outcomes (increasing effect, decreasing effect, and no effect) and six weather variables as the exposure which includes temperature, wind speed, fog, rainfall, thunderstorms, and relative humidity. Each row of the plot shows the different exposures examined in these studies. All plots contain a digit at the top of the vertical bar representing the number of studies that examined the factors for the outcome of interest. Each vertical bar of the plot was colored to indicate the effect of that variable on asthma-related admissions (increasing effect, decreasing effect, and no effect) and the size of bar indicates the quality of studies (good, fair, and poor).

Figure 2: Evidence for the effect of meteorological factors on hospitalization and EDVs among adults with asthma. The rows indicate the all meteorological variables that affect asthma-related admission which are studied in the literature, and three columns shows different effects of each exposure. The numbers on the top of each bar indicate the number of studies that investigate the effect of that variable and find the result. The length of each bar shows the quality (good, fair, and poor) of the studies. The colors of each indicate the increase or decrease effect of the variable.

3. Results

Our search for asthma-related HAs due to weather factors returned a total of 2677 articles after deduplication. 1512 studies were excluded while screening for titles and abstracts. During full-text review, five studies were excluded because they were not published in English and nine more studies were excluded because they were not original research articles. Eighty-one articles included either adult or pediatric populations. Among them, 65 were excluded as the study population was only children, resulting in 16 studies to be included in this review. Figure 1 shows the PRISMA flow diagram of the included studies.

3.1. Study Characteristics

Seven of the 16 included studies were conducted in Asia (five in East Asia), five in the USA, two in Europe, and two in Australia (Table 2). Overall, these 16 studies covered 1,144,859 observations, where most articles included at least 50,000 observations each. The mean study period for included studies was 6.5 years with a standard deviation of 7.13 years. Aside from the single study with a case-control design, one ecological study, and one cohort study, eight studies in this review used time-series analysis and three conducted case-crossover designs. Articles included in this study used data sources from a health department database , hospital admission records , records from an insurance company , and a dataset from a fire department in Japan. All studies compared the individuals before and after they were exposed to weather conditions. There were no external comparison groups.

Table 2: Characteristics of studies that examine the effect of meteorological factors on asthma admissions.
3.2. Weather Variables

As shown in Tables 3 and 4, 31% (5/16) of the studies found that temperature was the only factor associated with asthma hospitalization or EDVs [4, 9, 11, 15, 18, 25]. Nearly 37% (6/16) of the studies found that both temperature and relative humidity were associated with HAs (Table 4) [6, 9, 16, 18, 21, 22]. Twenty-five percent (4/16) investigated the effect of thunderstorms as a possible element for asthma hospitalization in adults [14, 17, 23, 24]. We did not find any studies that measured weather variables such as barometric pressure, different types of storms (tropical storm, and snow storm), and tornados.

Table 3: Studies that examine the effect of meteorological factors on EDVs.
Table 4: Studies that examine the effect of meteorological factors on HAs.
3.3. Effect of Meteorological Factors on Hospitalization

Only one study showed a negative correlation between asthma hospitalization and daily mean temperature (5.79% risk increase, ) and lower minimum temperature (2.88% risk increase, ) during the cold season [19]. This study was conducted in Hong Kong and was adjusted for air pollution, solar radiation, and day of the week. Two studies, one in Finland (r = −0.11, ) [22] and one in China (r = −0.174, ) [9], have reported that asthmatic symptoms that lead to admission are influenced by daily temperature change during the study period. Five studies found that extremely cold or hot temperatures could trigger asthma attacks that lead to HAs [11, 14, 15, 16, 22, 29].

3.4. Effect of Meteorological Factors on EDVs

One study reported that during the summer months, EDVs for asthmatic patients had increased with increasing temperature and humidity [22]. Lower relative humidity was the cause of the increase in EDVs among asthmatic patients in another study [18]. One study [17] reported that rainfall events due to thunderstorms could increase the EDVs for asthmatic patients (Figure 2).

4. Discussion

Our review suggests that temperature variation can have both a positive or negative correlation with asthma hospital admissions, depending on the season and geographic area. The temperature measurement and the threshold for temperature vary from one study to another. Moreover, temperature itself could be influenced by other variables (e.g., wind speed and barometric pressure) which were not taken into account by many studies. Aside from temperature, other weather variables including relative humidity and precipitation [18, 19, 20], wind speed [17], and thunderstorms [24] could influence asthmatic patients’ condition and the number of HAs.

This study suggests that changes in weather variables could increase EDVs due to asthma. Temperature variation was the most frequently studied factor among the included studies. Thunderstorms [17], rainfall events [17, 27], low temperatures [6, 21], increase in humidity [19], and fungal spores [28] were other variables that could increase EDVs among patients living with this chronic condition. Kwon et al. described a negative relationship between the incidence of fog and EDVs [18]. It is important to note that the definition of weather variables and EDVs have not been consistent across all studies.

Our review has some limitations. First, many studies included in this review did not adjust for the effect of air pollution and pollens where the effect of weather variables was assessed. Air pollution and pollens are known risk factors for asthma exacerbation [27]. A review by D’Amato et al. recommends that changes in weather factors could influence the rate of asthma attacks depending on the intensity and length of the pollen season. Another study by the same author reported asthma exacerbations due to the increased pollen in the air during thunderstorms [29].

Other studies indicated a significant increase in the number of patients with bronchial asthma visiting an emergency clinic during December due to fungal spores [20]. A systematic review by Zheng et al. identified associations between several air pollutants and EDVs due to asthma. This study also showed that weather factors such as wind speed and direction play a key role in air pollution [30].

Only peer-reviewed articles published in English were included, making it possible that we missed studies published in other languages or in the grey literature.

Although there were no limitations to our study design or data collection methods, the studies included in this review are mainly observational studies (time-series and case-crossover studies) using secondary data where the data quality is a concern [28, 31, 32].

To our knowledge, this is the first systematic review assessing the effects of meteorological factors on asthma hospitalizations. We identified only 16 studies, 6.25% (1/16) with poor quality, suggesting a lack of available evidence. Estimating a summary effect of meteorological factors on asthma hospitalizations among adults was not possible due to heterogeneity across the studies.

5. Conclusion

Information on how particular weather events, such as extreme wind or cold, could affect asthma HAs is essential to predict hospital demands and to help prevent exacerbation among patients with asthma and its consequent HA. Our review shows that asthma HAs and EDVs in adults are associated with temperature variability. It also suggests that weather variables including relative humidity, rainfall, and wind are factors which influence EDVs and hospitalization among patients living with asthma. Our study suggests the possibility of a gap in the knowledge regarding the effect of barometric pressure, weather phenomena, and tornados. Due to inconsistencies of the methodological approaches and the differences in statistical analyses in the included articles, we were not able to generate a practical policy recommendation. Methodological limitations of the studies and inconsistencies in the study findings show great potential for future research.

Conflicts of Interest

The authors have no conflicts of interest.

References

  1. P. Subbarao, P. J. Mandhane, and M. R. Sears, “Asthma: epidemiology, etiology and risk factors,” Canadian Medical Association Journal, vol. 181, no. 9, pp. E181–E190, 2009. View at Publisher · View at Google Scholar · View at Scopus
  2. P. Marino, C. Bryden, W. Bird, and H. A. Watkin, “How different measures of cold weather affect chronic obstructive pulmonary disease (COPD) hospital admissions in London,” European Respiratory Review, vol. 15, no. 101, pp. 185-186, 2006. View at Publisher · View at Google Scholar
  3. P. Michelozzi, G. Accetta, M. De Sario et al., “High temperature and hospitalizations for cardiovascular and respiratory causes in 12 European cities,” American Journal of Respiratory and Critical Care Medicine, vol. 179, no. 5, pp. 383–389, 2009. View at Publisher · View at Google Scholar · View at Scopus
  4. G. D’Amato, C. E. Baena-Cagnani, L Cecchi et al., “Climate change, air pollution and extreme events leading to the increasing prevalence of allergic respiratory diseases,” Multidisciplinary Respiratory Medicine, vol. 8, no. 1, p. 12, 2013. View at Publisher · View at Google Scholar · View at Scopus
  5. M. Li, Q. Li, G. Yang, V. P. Kolosov, J. M. Perelman, and X. D. Zhou, “Cold temperature induces mucin hypersecretion from normal human bronchial epithelial cells in vitro through a transient receptor potential melastatin 8 (TRPM8)-mediated mechanism,” Journal of Allergy and Clinical Immunology, vol. 128, no. 3, pp. 626–634.e5, 2011. View at Publisher · View at Google Scholar · View at Scopus
  6. T. Abe, Y. Tokuda, S. Ohde, S. Ishimatsu, T. Nakamura, and R. B. Birrer, “The relationship of short-term air pollution and weather to ED visits for asthma in Japan,” American Journal of Emergency Medicine, vol. 27, no. 2, pp. 153–159, 2009. View at Publisher · View at Google Scholar · View at Scopus
  7. L. May, M. Carim, and K. Yadav, “Adult asthma exacerbations and environmental triggers: a retrospective review of ED visits using an electronic medical record,” American journal of emergency medicine, vol. 29, no. 9, pp. 1074–1082, 2011. View at Publisher · View at Google Scholar · View at Scopus
  8. H. O. Koskela, “Cold air-provoked respiratory symptoms: the mechanisms and management,” International Journal of Circumpolar Health, vol. 66, no. 2, pp. 91–100, 2007. View at Publisher · View at Google Scholar · View at Scopus
  9. Y. Zhang, L. Peng, H Kan et al., “Effects of meteorological factors on daily hospital admissions for asthma in adults: a time-series analysis,” PLoS One, vol. 9, no. 7, Article ID e102475, 2014. View at Publisher · View at Google Scholar · View at Scopus
  10. M. J. Strickland, L. A. Darrow, M. Klein et al., “Short-term associations between ambient air pollutants and pediatric asthma emergency department visits,” American Journal of Respiratory and Critical Care Medicine, vol. 182, no. 3, pp. 307–316, 2010. View at Publisher · View at Google Scholar · View at Scopus
  11. E. F. Fitzgerald, C. Pantea, and S. Lin, “Cold spells and the risk of hospitalization for asthma: New York, USA 1991–2006,” Lung, vol. 192, no. 6, pp. 947–954, 2014. View at Publisher · View at Google Scholar · View at Scopus
  12. D. Ogilvie, D. Fayter, M. Petticrew et al., “The harvest plot: a method for synthesising evidence about the differential effects of interventions,” BMC Medical Research Methodology, vol. 8, no. 1, p. 8, 2008. View at Publisher · View at Google Scholar · View at Scopus
  13. M. Crowther, A. Avenell, G. MacLennan, and G. Mowatt, “A further use for the harvest plot: a novel method for the presentation of data synthesis,” Research Synthesis Methods, vol. 2, no. 2, pp. 79–83, 2011. View at Publisher · View at Google Scholar
  14. W. Anderson, G. J. Prescott, S. Packham, J. Mullins, M. Brookes, and A. Seaton, “Asthma admissions and thunderstorms: a study of pollen, fungal spores, rainfall, and ozone,” QJM, vol. 94, no. 8, pp. 429–433, 2001. View at Publisher · View at Google Scholar
  15. J. P. Buckley and D. B. Richardson, “Seasonal modification of the association between temperature and adult emergency department visits for asthma: a case-crossover study,” Environmental Health, vol. 11, no. 1, p. 55, 2012. View at Publisher · View at Google Scholar · View at Scopus
  16. P. L. Delamater, A. O. Finley, and S. Banerjee, “An analysis of asthma hospitalizations, air pollution, and weather conditions in Los Angeles County, California,” Science of The Total Environment, vol. 425, pp. 110–118, 2012. View at Publisher · View at Google Scholar · View at Scopus
  17. A. Grundstein, S. E. Sarnat, M. Klein et al., “Thunderstorm associated asthma in Atlanta, Georgia,” Thorax, vol. 63, no. 7, pp. 659-660, 2008. View at Publisher · View at Google Scholar · View at Scopus
  18. J.-W. Kwon, Y.-J. Han, M. K. Oh et al., “Emergency department visits for asthma exacerbation due to weather conditions and air pollution in Chuncheon, Korea: a case-crossover analysis,” Allergy, Asthma & Immunology Research, vol. 8, no. 6, pp. 512–521, 2016. View at Publisher · View at Google Scholar · View at Scopus
  19. H. C. Y. Lam, A. M. Li, E. Y. Y. Chan, and W. B. Goggins, “The short-term association between asthma hospitalisations, ambient temperature, other meteorological factors and air pollutants in Hong Kong: a time-series study,” Thorax, vol. 71, no. 12, pp. 1097–1109, 2016. View at Publisher · View at Google Scholar · View at Scopus
  20. J. A. Qasem, H. Nasrallah, B. N. Al-Khalaf et al., “Meteorological factors, aeroallergens and asthma-related visits in Kuwait: a 12-month retrospective study,” Annals of Saudi Medicine, vol. 28, no. 6, pp. 435–441, 2008. View at Publisher · View at Google Scholar
  21. H. Qiu, I. T.-S. Yu, L. A. Tse, E. Y. Y. Chan, T. W. Wong, and L. Tian, “Greater temperature variation within a day associated with increased emergency hospital admissions for asthma,” Science of the Total Environment, vol. 505, pp. 508–513, 2015. View at Publisher · View at Google Scholar · View at Scopus
  22. O. V. Rossi, V. L. Kinnula, J. Tienari, and E. Huhti, “Association of severe asthma attacks with weather, pollen, and air pollutants,” Thorax, vol. 48, no. 3, pp. 244–248, 1993. View at Publisher · View at Google Scholar · View at Scopus
  23. E. Andrew, Z. Nehme, S. Bernard et al., “Stormy weather: a retrospective analysis of demand for emergency medical services during epidemic thunderstorm asthma,” BMJ, vol. 359, Article ID j5636, 2017. View at Publisher · View at Google Scholar · View at Scopus
  24. F. Thien, P. J. Beggs, D. Csutoros et al., “The Melbourne epidemic thunderstorm asthma event 2016: an investigation of environmental triggers, effect on health services, and patient risk factors,” The Lancet Planetary Health, vol. 2, no. 6, pp. e255–e263, 2018. View at Publisher · View at Google Scholar · View at Scopus
  25. K. U. Kunikullaya, A. Vijayaraghava, P. Asha, R. Kunnavil, and B. V. MuraliMohan, “Meteorological parameters and pollutants on asthma exacerbation in Bangalore, India—an ecological retrospective time-series study,” Journal of Basic and Clinical Physiology and Pharmacology, vol. 28, no. 2, pp. 133–141, 2017. View at Publisher · View at Google Scholar · View at Scopus
  26. S. Soneja, C. Jiang, J. Fisher, C. R. Upperman, C. Mitchell, and A. Sapkota, “Exposure to extreme heat and precipitation events associated with increased risk of hospitalization for asthma in Maryland, USA,” Environmental Health, vol. 15, no. 1, p. 57, 2016. View at Publisher · View at Google Scholar · View at Scopus
  27. G. D’Amato, S. T. Holgate, R. Pawankar et al., “Meteorological conditions, climate change, new emerging factors, and asthma and related allergic disorders: a statement of the World Allergy Organization,” World Allergy Organization Journal, vol. 8, no. 1, p. 25, 2015. View at Publisher · View at Google Scholar · View at Scopus
  28. J. Heaton, “Secondary data analysis,” in The A-Z of Social Research, pp. 285–288, Sage, London, UK, 2003. View at Google Scholar
  29. G. D’Amato, C. Vitale, M. D’Amato et al., “Thunderstorm-related asthma: what happens and why,” Clinical & Experimental Allergy, vol. 46, no. 3, pp. 390–396, 2016. View at Publisher · View at Google Scholar · View at Scopus
  30. X.-Y. Zheng, H. Ding, L.-N. Jiang et al., “Association between air pollutants and asthma emergency room visits and hospital admissions in time series studies: a systematic review and meta-analysis,” PloS One, vol. 10, no. 9, Article ID e0138146, 2015. View at Publisher · View at Google Scholar · View at Scopus
  31. H. G. Cheng and M. R. Phillips, “Secondary analysis of existing data: opportunities and implementation,” Shanghai Archives of Psychiatry, vol. 26, no. 6, pp. 371–375, 2014. View at Publisher · View at Google Scholar · View at Scopus
  32. J. Adams, H. Verbeek, and S. M. G. Zwakhalen, “The impact of organizational innovations in nursing homes on staff perceptions: a secondary data analysis,” Journal of Nursing Scholarship, vol. 49, no. 1, pp. 54–62, 2017. View at Publisher · View at Google Scholar · View at Scopus