A Comparative Study of Smartphone Game with Spirometry for Pulmonary Function Assessment in Stroke Patients

Joo, Sunghee; Lee, Kyeongjin; Song, Changho

doi:https://doi.org/10.1155/2018/2439312

BioMed Research International

On this page

Abstract Background Materials and Methods Results Discussion Conclusion Data Availability Conflicts of Interest Authors’ Contributions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2018 | Article ID 2439312 | https://doi.org/10.1155/2018/2439312

A Comparative Study of Smartphone Game with Spirometry for Pulmonary Function Assessment in Stroke Patients

Sunghee Joo,¹Kyeongjin Lee,²and Changho Song¹

Academic Editor: Nikolaos G. Koulouris

Received30 Jul 2018

Revised28 Sept 2018

Accepted24 Oct 2018

Published04 Nov 2018

Abstract

Background. The monitoring and rehabilitation of pulmonary function can be immensely important for long-term performance of daily life activities in stroke patients. In recent times, smartphone game-based assessment (SGA) has been gaining in popularity as an alternative to laboratory assessments. Hence, the aims of this study were (1) to quantify the reliability and validity of SGA for pulmonary function and (2) to assess the validity of SGA in comparison to spirometry. Materials/Methods. Thirty-four stroke subjects (age = 49.24 ± 8.25 years) performed spirometry and the smartphone game on different days. Spirometric values were obtained using a spirometer (SP-1, Schiller, USA). A breathing game application (Breathing+ package, Breathing Labs, Slovenia) was used to obtain the values for the SGA of pulmonary function. The concurrent validity was determined by comparing data collected from the 2 systems, and the reliability was determined by comparing data collected from 3 sessions of using the breathing game on a smartphone. Results. All parameters demonstrated excellent agreement with intraclass correlation coefficients (ICC (2.1)) values for reliability and concurrent validity. Conclusion. We compared the relationship between the SGA and the spirometry as certified pulmonary function test. The SGA data were statistically significant and reliable for pulmonary function assessment in stroke patients. It will therefore be useful during rehabilitation to improve pulmonary function and clinical monitoring in stroke patients.

1. Background

Following a stroke, patients may have impairments such as loss of muscle mass, pain, and functional limitation. Reduced tolerance to daily physical activity can additionally lead to a more sedentary lifestyle which increases risk of pulmonary infections [1, 2]. Respiratory complications in stroke patients may occur due to changes in respiratory patterns or weakness of respiratory muscles. Respiratory complications such as decreased ventilation and cough effectiveness lead to difficulty in eliminating secretions, which significantly increases the risk of pulmonary diseases in stroke patients [3, 4]. In a detailed study of pulmonary function in stroke patients, researchers found that pulmonary function (maximum inspiratory and expiratory pressure) was significantly reduced. Therefore, it is important for stroke patients to achieve, improve, and maintain the physical capability of carrying out daily functions by monitoring and rehabilitation of pulmonary function [2, 5, 6].

Spirometry is widely used in clinical practice as it provides detailed and easy-to-interpret information on pulmonary function. The use of spirometry is necessary for the evaluation and follow-up of respiratory diseases and for confirmation of return to respiratory normality [7]. Spirometry is particularly essential for the monitoring and follow-up of respiratory diseases such as asthma and chronic obstructive pulmonary disease (COPD) and of the respiratory complications of stroke [8]. Thus, spirometry should be a part of any routine health examination of subjects at risk of developing pulmonary diseases [9]. However, there are limitations to the frequent use of spirometry in primary care [10]. Firstly, the spirometry is not a very portable apparatus, so it is not ideal for monitoring individual patients. Secondly, it is expensive as specific components consist of specialized disposable accessories [11]. Thirdly, its use requires special training and periodical refresher training of primary care professionals. [12, 13] Consequently, more convenient measures need to be developed and evaluated for use in clinical settings.

In recent times, smartphone game-based assessment (SGA) has been gaining in popularity as an alternative to laboratory assessments. These measurements are suggested as practical solutions for lowering cost as well as improving accessibility, convenience, and portability [14]. An SGA application requires that subjects perform physical activities and makes it possible for users to monitor their physical activity level while performing game-exercises [15]. Some studies have investigated the effectiveness of smartphone applications as assessment tools [14–16]. They found out that the use of the SGA can be suitable for clinician analysis. Breathing+ (Breathing+ package, Breathing Labs, Slovenia) is a SGA, downloadable on a laptop or smartphone and requiring a headset, which acts as a breathing trainer to enhance its user's respiratory function. Joo, Shin [17] reported enhanced respiratory function in stroke patients when intervention was conducted using this application. However, it is unknown whether this SGA can be used as an assessment tool beyond a single treatment protocol in the pulmonary rehabilitation of stroke patients. Hence, the aims of this study were (1) to quantify the reliability of SGA for pulmonary function and (2) to assess the validity of pulmonary function SGA in comparison to spirometry.

2. Materials and Methods

2.1. Subjects

Thirty-four stroke subjects (age = 49.24 ± 8.25 years) recruited from the 'B' rehabilitation hospital (Gyeonggi Province, South Korea), voluntarily participated in the study (20 males, 14 females; Height 165.16 ± 8.23 cm; Weight 61.19 ± 8.26 kg; BMI 22.41 ± 2.77 kg/m²). The inclusion criteria were a history of stroke of at least 6 months before the study; the ability to understand and follow simple verbal instructions; a Minimental State Examination-Korean version (MMSE-K) score >24 [18]; no facial palsy or unrestricted movement of the lips; a forced expiratory volume in one second (FEV₁) < 93% of the predicted normal value [19]; and no history of orthopedic, neurologic, or cardiac conditions nor receptive aphasia, thoracic surgery or abdominal surgery. The exclusion criteria were a history of cardiac and/or chronic pulmonary disease; clinical signs of cardiac and/or pulmonary disease; presence of severe visual disability or visual field defects; inability to perform the tests; and the use of medications that could cause dizziness. All participants were provided verbal and written explanation of study procedures and they signed an informed consent form prior to participation. The University of Sahmyook Human Research Ethics Committee granted ethical approval.

2.2. Instruments

Spirometry is a physiological test that measures patient inspiratory and expiratory air volumes as functions of time. In this study, pulmonary function tests performed using the spirometer (SP-1, Schiller, USA) (Figure 1) and the SGA were compared. This spirometer unit satisfied all the American Thoracic Society (ATS, 2017) recommendations for spirometry [20]. Forced vital capacity (FVC), FEV₁, predicted FVC (%), and predicted FEV₁ (%) were the spirometric indices compared in this study because they are the most important spirometric parameters and the most commonly used indicators of disease severity in patients with pulmonary disease [21, 22]. FVC is the volume delivered during an expiration made as forcefully and as completely as possible after full inspiration, and FEV₁ is the volume delivered in the first second of an FVC maneuver. [22]

(a)

(b)

Breathing+ was the game application used for the evaluation. (Figure 1) This game application consists of 14 different games, all designed to guide the participants to maximum inspiration and expiration through a headset. A smartphone was placed on the table, and the participant sat in a wheelchair or chair. An adjustable table was used to enable participants comfortably see the smartphone. Participants selected and played the games they were familiar with. The game result showed the longest exhalation period, and the average exhalation period in real time by measuring air pressure as detected through the headset. We converted and used the average real-time values for comparison.

2.3. Procedure

Two physiotherapists with experience of spirometry in pulmonary rehabilitation conducted the procedures. All participants satisfied the standard recommendations and quality criteria (acceptability and repeatability) of the American Thoracic Society/European Respiratory Society guidelines [20]. The patients first performed spirometry and then played the smartphone game (SG) two hours later. There was no physical therapy or exercise performed to minimize physiological changes [23]. The subjects were re-evaluated using the same procedure and instruments at the same time after 24 hours for test-retest reliability by the same therapist and again re-evaluated using the same procedure and instruments at the same time after 48 hours for interrater reliability by the other therapist in this study. This time interval was considered suitable to allow for stability of the instruments over time while minimizing biological variability [24]. Furthermore, feedback on test performance was provided only after conclusion of all procedures to minimize the risk of feedback from an earlier test influencing performance on the next test [23].

2.4. Statistical Analysis

All measurements and values obtained from spirometry and SGA were evaluated for normality and homoscedasticity. Test-retest and interrater reliabilities for SGA were determined using an intraclass correlation coefficients (ICCs (2, 1)) with a 95% confidence interval (95% CI) [24]. The different parameters of the 2 systems were standardized for concurrent validity.

The coefficient of variation of method errors () [25] and 95% limits of agreement (LOA) [26] were calculated for absolute comparison of values obtained from the 2 systems. In the formulas below, represents the standard deviation of the differences between the 2 tests and X₁ and X₂ represent the 2 tests means. values were converted into percentages by calculating coefficients of variations of method errors collected using .In addition, the standard error of measurement (SEM) values was calculated using as the square root of the mean square error term from analysis of variance on data of test-retest and interrater reliabilities. It can alternatively be calculated using the formula below [27]:And minimum detectable changes (MDC₉₅) at a confidence level of 95%, also known as reliable change or smallest real difference, were calculated by multiplying the SEM by the z-score associated with the desired level of confidence and the square root of difference scores from measurements as below [28]:All statistical calculations were completed using the MedCalc® 2011 statistical software (version 11.5.1).

3. Results

The mean and standard deviations of parameters of spirometry and SGA are presented in Table 1. ICC (2, 1) values for SGA parameters based on expiratory time are listed in Table 2. All parameters demonstrated excellent agreement with ICC (2.1) values at 0.84 (95%CI, 0.65-0.93) for intratest and 0.96 (95%CI, 0.91-0.98) for intertest. The SEM, SEM%, MDC, and MDC% for the SGA parameters are also listed in Table 2. The SEM% ranged from 0.41% to 4.41% while MDC% ranged from 1.16% to 12.22% and CV% ranged from 15.04% to 24.84%. These values indicate strong and absolute reliability and a low level of variation between the sessions (Table 2). Table 3 shows ICC (2, 1) (95%CI), 95% LOA, and CV% values in correlation with each parameter between spirometry and SGA. The correlations are represented on the Bland Altman plot in Figure 2.

4. Discussion

Technological advances in the medical field have facilitated transition from bulky time-consuming devices to portable time-saving on such as smartphone that run application like Breathing+. The portable modern devices play an important, albeit indirect role in pulmonary function rehabilitation by measuring physiological effort. It was proposed that new methods based on recent technological advances must be evaluated and compared with established techniques. The purpose of this study was to evaluate SGA and compare it with spirometry. Overall, the results of this study suggest excellent reliability and acceptable measurement errors.

Relative reliability, which examines the relationship between repeated measurements and consistency among raters, can be evaluated using ICC [29]. According to Fleiss’ classification, ICC values above 0.75 indicate excellent reliability, values between 0.40 and 0.75 indicate fair to good reliability, and values less than 0.40, indicate poor reliability [30]. In this study, ICC values showed a strong correlation between spirometry and SGA despite systematic differences (intra-test: 0.84, inter-test: 0.96) and are shown in Table 2. However, as suggested by Menz, Latt [31], a high ICC value does not necessarily mean excellent reliability even though ICC is a more appropriate indicator of reliability than simple correlation coefficients such as Pearson’s or Spearman’s rho. Therefore, both CV and LOA were calculated to decrease the intrinsic limitation effects and ensure excellent reliability. represents the differences in values collected from the 2 systems as a percentage and can be used in clinical settings as an indicator of consistency since it is unaffected by sample heterogeneity [31]. The 95% LOA represents the expected range of difference between measurements, which is used to identify the presence of significant bias when they are repeatedly assessed. These results are shown in Tables 2 and 3. The of the test means that 0.92 and 0.18 were considered reliable. Bland and Altman [26] suggested the data not be used to assess repeatability if the differs significantly from zero.

SEM is calculated to estimate absolute reliability, which describes the within-participant variability attributable to repeated measures [29]. In this study, SEM calculated for intra- and intertests were expressed as percentages of the mean (SEM%) and showed a low level of measurement error, between 0.41% and -4.41%, which indicates strong absolute reliability. Small SEM values for SGA parameters indicate that SGA values were stable and reproducible over time, thereby implying precision in measurement [32]. A true change in the parameter of interest can be determined by assessing statistical significance and incorporating MDC or MDC% into clinical decision-making [29]. MDC indicates the minimum amount of change required to distinguish a true performance change from a change due to variability in performance or measurement error. [29] Since it is defined as the degree of sensitivity to change, MDC is used to determine actual occurrence of change over 2 measurement sessions [28]. Darter, Rodriguez [23] suggested that only MDC values less than 10% signify meaningful change. Relatively low MDC values (1.16%-12.22%) were obtained in this study when expressed as percentages of means. (Table 2) Moreover, as suggested by Bland and Altman [26], correlation analysis had to be followed by more specific investigations such as ICC and Bland-Altman plot to define agreement levels between the different systems. Figure 2 shows a correlation between parameters of spirometry and SGA. These findings indicate that SGA can confidently be used for clinical purposes as an alternative to spirometry as it circumvents the need for costly, frequent, and inconvenient testing in the clinic.

There are limitations to be recognized in this study. The sample size for our analysis was relatively small. It is possible that our results would have differed with a larger sample size. Although we have considered and standardized the real time SGA parameters with those of spirometry, the results of our study are not generalizable to other pulmonary function assessment devices. Another possible limiting factor of this study is the effect on results of learning during re-evaluation while using spirometry and/or SGA. The patients may have been motivated to use the instruments better through learning which would have affected the outcome.

This study is the first to investigate the reliability and validity of SGA in stroke patients. Conventional spirometers are not ideal for use in clinical settings for a variety of reasons, such as problems with continued use of damaged mouthpieces or incorrect use by patients. The SGA has the advantages of ease of setup, simplicity of use, and affordability which circumvent the shortcomings of conventional spirometers and make daily pulmonary function monitoring more attractive to patients. The SGA system could provide an interesting opportunity to promote home-based physical activity training sessions. Therefore, further research is needed to investigate differences in reliability and validity between the modern SGA system and the established spirometric setup in stroke patients with a view to optimizing outcome. In this study, excellent reliability and acceptable measurement errors were observed in SGA and spirometry. It is presumed that the study findings were due to the similarities between the SGA method requiring long-duration breathing and the spirometric measurement method for respiratory volumes and duration. This suggests that clinicians could benefit from using the SGA system by correlating SGA data to observed changes in functional status or to the quality of life postintervention.

5. Conclusion

We compared SGA and spirometry as certified pulmonary function test system. The SGA data were statistically significant and reliable for pulmonary function assessment in stroke patients. The SGA system will therefore be useful in clinical practice for the monitoring and rehabilitation of pulmonary function in stroke patients.

Data Availability

The Excel data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Authors’ Contributions

Sunghee Joo and Kyeongjin Lee contributed equally to this work.

Acknowledgments

This paper was supported by the Fund of the Sahmyook University in 2018.

References

J. J. Eng, A. S. Dawson, and K. S. Chu, “Submaximal exercise in persons with stroke: test-retest reliability and concurrent validity with maximal oxygen consumption,” Archives of Physical Medicine and Rehabilitation, vol. 85, no. 1, pp. 113–118, 2004.
View at: Publisher Site | Google Scholar
G. J. Luvizutto, M. R. L. dos Santos, L. C. A. Sartor et al., “Evaluation of Respiratory Muscle Strength in the Acute Phase of Stroke: The Role of Aging and Anthropometric Variables,” Journal of Stroke and Cerebrovascular Diseases, vol. 26, no. 10, pp. 2300–2305, 2017.
View at: Publisher Site | Google Scholar
Z. Zhou, F. Vincent, J.-Y. Salle, M.-T. Antonini, V. Aliamus, and J.-C. Daviet, “Acute stroke phase voluntary cough and correlation with maximum phonation time,” American Journal of Physical Medicine & Rehabilitation, vol. 91, no. 6, pp. 494–500, 2012.
View at: Publisher Site | Google Scholar
J. Yoon, J. Park, D. Lee, and H. Roh, “Comparisons of respiratory function and activities of daily living between spinal cord injury and stroke patients and normal elderly people,” Journal of Physical Therapy Science, vol. 24, no. 6, pp. 465–469, 2012.
View at: Publisher Site | Google Scholar
F. Harraf, K. Ward, W. Man et al., “Transcranial magnetic stimulation study of expiratory muscle weakness in acute ischemic stroke,” Neurology, vol. 71, no. 24, pp. 2000–2007, 2008.
View at: Publisher Site | Google Scholar
K. Ward, J. Seymour, J. Steier et al., “Acute ischaemic hemispheric stroke is associated with impairment of reflex in addition to voluntary cough,” European Respiratory Journal, vol. 36, no. 6, pp. 1383–1390, 2010.
View at: Publisher Site | Google Scholar
F. García-Río, M. Calle, F. Burgos et al., “Espirometría,” Archivos de Bronconeumología, vol. 49, no. 9, pp. 388–401, 2013.
View at: Publisher Site | Google Scholar
V. S. Peña, M. Miravitlles, R. Gabriel et al., “Geographic variations in prevalence and underdiagnosis of COPD: Results of the IBERPOC multicentre epidemiological study,” CHEST, vol. 118, no. 4, pp. 981–989, 2000.
View at: Publisher Site | Google Scholar
F. García-Río, M. Calle, F. Burgos et al., “Spirometry,” Archivos de Bronconeumología (English Edition), vol. 49, no. 9, pp. 388–401, 2013.
View at: Publisher Site | Google Scholar
G. Caramori, G. Bettoncelli, R. Tosatto et al., “Underuse of spirometry by general practitioners for the diagnosis of COPD in Italy,” Monaldi Archives for Chest Disease - Pulmonary Series, vol. 63, no. 1, pp. 6–12, 2005.
View at: Google Scholar
R. A. Pauwels, A. S. Buist, P. M. A. Calverley, C. R. Jenkins, and S. S. Hurd, “Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: NHLBI/WHO Global Initiative for Chronic Obstructive Lung Disease (GOLD) workshop summary,” American Journal of Respiratory and Critical Care Medicine, vol. 163, no. 5, pp. 1256–1276, 2001.
View at: Publisher Site | Google Scholar
V. Bellia, R. Pistelli, F. Catalano et al., “Quality control of spirometry in the elderly: The SA.R.A. study,” American Journal of Respiratory and Critical Care Medicine, vol. 161, no. 4 I, pp. 1094–1100, 2000.
View at: Publisher Site | Google Scholar
T. R. Schermer, J. E. Jacobs, N. H. Chavannes et al., “Validity of spirometric testing in a general practice population of patients with chronic obstructive pulmonary disease (COPD),” Thorax, vol. 58, no. 10, pp. 861–866, 2003.
View at: Publisher Site | Google Scholar
P. Silsupadol, K. Teja, and V. Lugade, “Reliability and validity of a smartphone-based assessment of gait parameters across walking speed and smartphone locations: Body, bag, belt, hand, and pocket,” Gait & Posture, vol. 58, pp. 516–522, 2017.
View at: Publisher Site | Google Scholar
F. Sgrò, G. Monteleone, M. Pavone, and M. Lipoma, “Validity Analysis of Wii Balance Board Versus Baropodometer Platform Using an Open Custom Integrated Application,” AASRI Procedia, vol. 8, pp. 22–29, 2014.
View at: Publisher Site | Google Scholar
M. Yamada, T. Aoyama, M. Nakamura et al., “The Reliability and Preliminary Validity of Game-Based Fall Risk Assessment in Community-Dwelling Older Adults,” Geriatric Nursing, vol. 32, no. 3, pp. 188–194, 2011.
View at: Publisher Site | Google Scholar
S. Joo, D. Shin, and C. Song, “The effects of game-based breathing exercise on pulmonary function in stroke patients: A preliminary study,” Medical Science Monitor, vol. 21, pp. 1806–1811, 2015.
View at: Publisher Site | Google Scholar
J. C. Polese, L. Ada, and L. F. Teixeira-Salmela, “Relationship between oxygen cost of walking and level of walking disability after stroke: An experimental study,” Physiotherapy Research International, vol. 23, no. 1, 2018.
View at: Google Scholar
E. Barreiro, C. Coronell, B. Laviña, A. Ramírez-Sarmiento, M. Orozco-Levi, and J. Gea, “Aging, sex differences, and oxidative stress in human respiratory and limb muscles,” Free Radical Biology & Medicine, vol. 41, no. 5, pp. 797–809, 2006.
View at: Publisher Site | Google Scholar
M. Chushkin, L. Popova, O. Ots, O. Nenasheva, and P. Struchkov, “Comparison between results of spirometry performed with the ATS/ERS quantitative criteria and simple visual inspection criteria,” European Respiratory Journal, 2017.
View at: Google Scholar
N. K. Leidy, “Functional performance in people with chronic obstructive pulmonary disease,” Image: the Journal of Nursing Scholarship, vol. 27, no. 1, pp. 23–34, 1995.
View at: Publisher Site | Google Scholar
M. R. Miller, J. Hankinson, V. Brusasco et al., “Standardisation of spirometry,” European Respiratory Journal, vol. 36, no. 2, pp. 319–338, 2005.
View at: Google Scholar
B. J. Darter, K. M. Rodriguez, and J. M. Wilken, “Test-retest reliability and minimum detectable change using the K4b 2: Oxygen consumption, gait efficiency, and heart rate for healthy adults during submaximal walking,” Research Quarterly for Exercise and Sport, vol. 84, no. 2, pp. 223–231, 2013.
View at: Publisher Site | Google Scholar
K. N. Fong, B. H. Ng, K. K. Chow et al., “Reliability and Validity of the Monitored Functional Task Evaluation (MFTE) for Patients with Chronic Obstructive Pulmonary Disease (COPD),” Hong Kong Journal of Occupational Therapy, vol. 11, no. 1, pp. 10–17, 2001.
View at: Publisher Site | Google Scholar
L. G. Portney and M. P. Watkins, Foundations of Clinical Research: Applications to Practice, Prentice Hall, 2000.
J. Martin Bland and D. Altman, “Statistical methods for assessing agreement between two methods of clinical measurement,” The Lancet, vol. 327, no. 8476, pp. 307–310, 1986.
View at: Publisher Site | Google Scholar
J. L. Fleiss, Design And Analysis of Clinical Experiments, John Wiley & Sons, 2011.
S. M. Haley and M. A. Fragala-Pinkham, “Interpreting change scores of tests and measures used in physical therapy,” Physical Therapy in Sport, vol. 86, no. 5, pp. 735–743, 2006.
View at: Google Scholar
P. Mohandas Nair, T. George Hornby, and A. Louis Behrman, “Minimal detectable change for spatial and temporal measurements of gait after incomplete spinal cord injury,” Topics in Spinal Cord Injury Rehabilitation, vol. 18, no. 3, pp. 273–281, 2012.
View at: Publisher Site | Google Scholar
J. L. Fleiss, “Classification of the depressive disorders by numerical typology,” Journal of Psychiatric Research, vol. 9, no. 2, pp. 141–153, 1972.
View at: Publisher Site | Google Scholar
H. B. Menz, M. D. Latt, A. Tiedemann, M. M. S. Kwan, and S. R. Lord, “Reliability of the GAITRite® walkway system for the quantification of temporo-spatial parameters of gait in young and older people,” Gait & Posture, vol. 20, no. 1, pp. 20–25, 2004.
View at: Publisher Site | Google Scholar
H. Beckerman, M. E. Roebroeck, G. J. Lankhorst, J. G. Becher, P. D. Bezemer, and A. L. M. Verbeek, “Smallest real difference, a link between reproducibility and responsiveness,” Quality of Life Research, vol. 10, no. 7, pp. 571–578, 2001.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2018 Sunghee Joo et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2494

Downloads

1057

Citations