Assessment of Cardiorespiratory Fitness without Exercise in
Elderly Men with Chronic Cardiovascular and Metabolic Diseases

Maranhão Neto, Geraldo A.; de Leon, Antonio P.; Lira, Vitor A.; Farinatti, Paulo T. V.

doi:https://doi.org/10.1155/2012/518045

Journal of Aging Research

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusion Acknowledgments References Copyright Related Articles

Special Issue

Physiological Changes Associated with Aging and Immobility

View this Special Issue

Research Article | Open Access

Volume 2012 | Article ID 518045 | https://doi.org/10.1155/2012/518045

Assessment of Cardiorespiratory Fitness without Exercise in Elderly Men with Chronic Cardiovascular and Metabolic Diseases

Geraldo A. Maranhão Neto,^1,2Antonio P. de Leon,^1,3Vitor A. Lira,⁴and Paulo T. V. Farinatti^2,5

Academic Editor: Antony Bayer

Received11 Jul 2011

Revised19 Sept 2011

Accepted20 Sept 2011

Published11 Dec 2011

Abstract

Low cardiorespiratory (CRF) is associated with health problems in elderly people, especially cardiovascular and metabolic disease. However, physical limitations in this population frequently preclude the application of aerobic tests. We developed a model to estimate CRF without aerobic testing in older men with chronic cardiovascular and metabolic diseases. Subjects aged from 60 to 91 years were randomly assigned into validation () and cross-validation () groups. A hierarchical linear regression model included age, self-reported fitness, and handgrip strength normalized to body weight (; SEE = 1.1 METs). The PRESS (predicted residual sum of squares) statistics revealed minimal shrinkage in relation to the original model and that predicted by the model and actual CRF correlated well in the cross-validation group (). The area under curve (AUC) values suggested a good accuracy of the model to detect disability in the validation (0.876, 95% CI: 0.793–0.959) and cross-validation groups (0.826, 95% CI: 0.677–0.975). Our findings suggest that CRF can be reliably estimated without exercise test in unhealthy elderly men.

1. Introduction

Cardiorespiratory fitness (CRF) maintenance is important for functional independence and physical capacity throughout aging [1, 2]. Substantial declines in the ability to tolerate physical exertion generally predict mobility problems and cardiovascular morbidity and mortality, particularly in the sedentary elderly [3, 4]. Despite the importance of CRF assessment, very low functional capacity and frailty may hinder the use of exercise tests in this population [5, 6]. In this context, nonexercise prediction models become practical alternatives to estimate CRF [7] and may have important applications both in clinical and epidemiological settings. These models are developed by means of regression-based equations that usually include variables of simple and fast assessment, such as anthropometric measures, demographic characteristics, and daily habits [8].

Recently, Mailey et al. [7] cross-validated an equation developed primarily in middle-aged adults by Jurca et al. [9] and suggested that nonexercise models could be used to estimate the CRF of older adults. The sample studied was mainly composed by healthy old women (~60%). However, the prevalence of chronic diseases such as cardiovascular disease and diabetes increases dramatically with age [10], and is associated to lower physical capacity, inactivity, and limitations in the ability to exercise [2]. It would be therefore important to take into account that elderly populations are not always healthy and free of cardiovascular and metabolic diseases, which on the contrary, are common in the later life. Notwithstanding to date nonexercise models to assess the CRF in elderly subjects with chronic diseases have not been proposed. Hence the present study aimed to develop a CRF nonexercise prediction linear model of cardiorespiratory fitness and test its validity in elderly men presenting chronic cardiovascular and metabolic diseases.

2. Materials and Methods

2.1. Subjects

The sample consisted initially of 108 subjects admitted to the Elderly Care Center of the Open University of the Third Age (UNATI) of the Rio de Janeiro State University (UERJ). These subjects went through clinical exams in order to detail their medical history and completed a brief questionnaire providing demographic information, which was used to determine whether they could perform maximal aerobic exercise testing.

The inclusion criteria were asymptomatic patients, stable disease, and no abnormalities in rest electrocardiogram for at least six months. Tests interrupted due to clinical reasons were not considered as maximal and therefore have been excluded from the study. Twelve participants did not complete the exercise testing (five were not allowed by the physicians to perform the test, four asked to stop before achieving maximal effort, and three exhibited high blood pressure).

From the initial sample, a total of 96 subjects remained in the study (60–91 years), being randomly assigned into two groups: validation (70%) and cross-validation (30%). The command “sample 70” from STATA statistical package version 10.1 (Stata, College Station, TX) was used with this purpose. The validation group was used to develop the statistical model while the cross-validation group was used to confirm the generalization potential of the obtained model.

The experimental protocol was approved by institutional Ethical Committee and participants provided a written informed consent for the use of their data for research prior to the commencement of the study, as stated in the Declaration of Helsinki.

2.2. Procedures

Individual data on anthropometry, self-reported physical fitness, and physiological measurements were assessed. Anthropometric measurements included weight and height [11] from which the body mass index (BMI) was calculated. The physical activity history was assessed by the Self-Reported Physical Activity Index (SRPA) [9]. The subjects were asked to choose one of five activity categories that best described their usual pattern of daily physical activities. Self-rated fitness was evaluated by means of the Rating of Perceived Capacity scale (RPC), a 1-20-scale previously adapted and translated to the Brazilian Portuguese language [12], in which the subject chooses the most strenuous activity that can be sustained for at least 30 min [13]. The RPC score is expressed in METs and the listed activities include walking, jogging, running, and cycling at different paces. Instead of asking of the physical activity history, the scale focuses on which activity the subject is able to perform.

The blood pressure at rest and during exercise was measured by auscultation with a sphygmomanometer WelchAlln (Tycos, Arden, MN, USA). A 12-lead electrocardiogram was used to assess the resting heart rate (RHR) and maximal heart rate (Micromed, Brasilia, DF, Brazil). Handgrip strength (HG) was measured with subjects keeping their shoulder adducted and neutrally rotated, with the arm fully extended and being encouraged to exert maximal grip force on a Lafayette dynamometer 78010 (Lafayette, IN, USA). The highest value in kilograms (kg) was determined after four trials in the dominant and nondominant hands and the relative handgrip strength (i.e., handgrip strength normalized to body weight and represented as the ratio handgrip/weight) was then used for further analyses.

All subjects performed a clinically supervised maximal exercise test in an electromagnetically braked cycloergometer (Cateye EC-1600, Osaka, Japan) using an individualized ramp protocol. Subjects were submitted to a familiarization trial to get used to the cycloergometer and mouthpiece on the day prior to the exercise test. The Wasserman et al. [14] prediction equation was used to estimate the test incremental workload in watts in order to achieve maximal exertion in approximately 10 minutes. The metabolic analyzer VO2000 (Medical Graphics, St. Paul, MN, USA) was used for gas exchange measures, using a medium flow pneumotachometer (10–120 L·min⁻¹).

Peak oxygen uptake () was determined as the maximal oxygen uptake at the point of test termination due to volitional exhaustion. A MET value of 3.5 mL·kg·min was considered for further calculations. The Borg CR-10 perceived exertion scale was used to estimate the degree of exertion [15] and standard clinical criteria for terminating exercise testing have been applied [16]. Before each test, the equipment was calibrated as recommended by the manufacturer, using standard reference gases. The test was considered maximal when at least two of the following criteria were observed: (a) respiratory exchange ratio (RER) > 1.1, (b) VO₂ plateau despite an increase in workload (increase <2.0 mL·kg⁻¹·min⁻¹ between the last two loads), and (c) maximum volitional exhaustion.

2.3. Statistical Analyses

Data normality was confirmed by univariate analysis. Differences between the validation and cross-validation groups were analyzed by t-test Student’s and chi-square tests. Age, relative strength index (handgrip strength/body weight), an anthropometric measure (BMI), self-related fitness (RPC scale), self-related physical activity (SRPA index), and resting heart rate (RHR) were entered, respectively, into the first, second, third, fourth, fifth, and sixth blocks of the hierarchical linear regression procedure to develop a model to predict MET_peak (i.e., the number of METs achieved at ).

The coefficient of determination () and the standard error of estimate (SEE) were calculated and the prediction equation generated was then cross-validated using the PRESS method (predicted residual sum of squares), a statistical jack-knife procedure that consists of refitting the proposed model many times, leaving each observation out of the model fit in turn, so as to predict and then calculate the residual for that observation [17]. The second series of cross-validation analyses based on the independent sample was performed using the Pearson correlation between the MET_peak predicted by the model and the MET_peak measured, as well as the difference between the CRF estimated by the prediction model and measured CRF (defined in the maximal exercise testing) was analyzed by the t-test. A Bland-Altman analysis of measurement differences plotted versus mean values was used to assess the degree of agreement [18].

In order to evaluate the accuracy of the model in screening individuals that present very low cardiorespiratory fitness, and therefore are at higher risk for mortality and morbidity, a disability index was used to dichotomize CRF. Basically, the CRF level below which successful independent living is significantly compromised (i.e., 5 METs) [19], was used as a cutoff to calculate the model sensitivity, specificity, and the area under the receiver operation curve (AUC). A 95% confidence interval (95%) was also calculated. The AUC is a measure of diagnostic power of the model and describes the probability that the model will correctly identify subjects with low CRF. The predicted and measured CRF categories from the validation and cross-validation groups were cross-tabulated to detect classification accuracy.

3. Results

Table 1 presents the descriptive statistics, as well as values for cardiorespiratory variables at rest and in response to maximal exercise for subjects in both validation and cross-validation groups. These groups did not significantly differ in any of the variables studied (). All subjects attended at least two of the criteria adopted to consider the cardiopulmonary exercise testing as maximal: respiratory exchange ratio (RER) > 1.1 (87% of the sample), VO₂ plateau despite an increase in workload (75%), and (c) maximum volitional exhaustion (100%).

Three levels of physical activity were detected by the SRPA index: inactivity or little activity other than usual daily activities (58% of the whole sample), participation in physical activities requiring low levels of exertion that result in slight increases in breathing and heart rate for at least 10 minutes at a time (38%), and participation in aerobic exercises such as brisk walking, jogging or running, cycling, swimming, or vigorous sports at a comfortable pace or other activities requiring similar levels of exertion for 20 to 60 minutes per week (4%).

Only three of four variables were significantly associated () with CRF after the linear regression procedure (Table 2). Age, relative handgrip strength, and RPC explained 44%, 22%, and 13% of CRF variance, respectively. The BMI (, ), SRPA index (, ), and RHR (, ) were not significant predictors. Based on the value, the obtained model explained 79% of the variability in . The low shrinkage of adjusted and the -PRESS conferred a good generalization to the model. The SEE_p was essentially equal to the corresponding SEE value. The following prediction equation was generated from the coefficients presented in Table 2: MET_peak = 6.095 − 0.096 (Age) + 8.84 (Handgrip strength/Weight) + 0.67 (RPC).

Once the statistical model was established it was then further tested in an independent sample for cross-validation. There were no significant differences between predicted CRF mean and actual CRF mean in both validation and cross-validation groups (Figure 1). The Pearson correlation coefficient between predicted and actual CRF in the cross-validation group was 0.85 (), ratifying that the model was appropriate to estimate CRF in elderly subjects with cardiovascular and metabolic diseases. The Bland Altman analysis (Figure 2) showed that few values fell outside the ranges established by the ±2 SDs, which suggests a good agreement between the values estimated by the statistical model and the actual MET values.

(a)

(b)

Table 3 exhibits the model accuracy from the validation and cross-validation groups after diagnostic tests. The results demonstrated that the model presents very good sensitivity and specificity. The model was almost equally efficient in identifying subjects with CRF ≤ 5 METs and with CRF > 5 METs. The AUC further confirmed the high accuracy of the model in screening subjects presenting CRF either below or above 5 METs.

4. Discussion

The negative effect of aging on CRF as well as the use of self-reported fitness are both well documented in the literature and are frequently included in prediction models [8, 20]. Although not previously used in other models, the relative handgrip strength was a very significant predictor of CRF in the present study. One could argue that the inclusion of handgrip strength may limit the widespread applicability of this equation, given that it requires equipment that may not be routinely used in epidemiological studies. In fact, the handgrip dynamometry has been a very important tool to assess the functional status of elderly samples, and the inclusion of this measurement in epidemiological settings should be reconsidered. The handgrip strength test is very simple and inexpensive, and has been previously related to mortality, mobility, functional capacity, and correlated with walking speed and overall strength, which are variables strongly related to the functional independence and health in older persons [1, 21, 22].

Despite of the fact that 79% () of variance in the prediction of CRF was explained by the obtained statistical model, the SEE (Table 2) suggests that more precise methods as maximal tests are recommended if the exactly CRF value is needed. On the other hand, the AUC values (Table 3) suggested that the model has good accuracy to stratify elderly men with very low (i.e., CRF ≤ 5 METs) and higher cardiorespiratory capacity (i.e., CRF > 5 METs). In other words, the model was capable to identify elder subjects whose functional and exercise capacity are compromised. Based on this finding, the proposed model can be useful for population-based investigations or epidemiological studies, especially those searching for associations between CRF and other physical and mental health outcomes, such as cognitive function and wellbeing. In clinical studies our model could be used to screen elderly individuals before maximal exercise testing.

Mailey et al. [7] tested the validity of the nonexercise model proposed by Jurca et al. [9] in old adults, and reported a multiple of 0.72 () for the regression in a sample composed mainly of old women, which were somewhat more physically active than our subjects. Our model was developed in a sample of elderly men with cardiovascular and metabolic diseases and produced a multiple of 0.89 (). It is also worthy to note that metabolic and cardiovascular diseases in the elderly are highly prevalent [10], reinforcing the relevance of the present model for this population.

Although comparisons between the two models are difficult because they were developed in different populations, we have included variables from Mailey’s model in our regression model, and they were not significant. We have also compared the CRF estimation accuracy of the models, and the results were favorable to the present equation (Mailey’s model in the validation group: ; EPE = 1.7 METs, and in the cross-validation group: ; EPE = 1.6 METs).

The adoption of a cycloergometer maximal exercise testing protocol to assess the MET_peak must be justified. Although treadmill tests are known to engage larger muscle mass and therefore may elicit higher peak VO₂ [16, 23], some authors have proposed that cycloergometer tests would be more appropriate to assess the cardiorespiratory fitness in older subjects, mainly for safety reasons. For instance, it has been suggested that high-intensity treadmill exercise should be avoided in older subjects with balance restrictions or joint problems [24]. Moreover, the poor mechanical efficiency while running seems to reduce the performance of older compared to younger subjects during treadmill exercise [25], which would very likely limit the peak VO₂ in maximal cardiopulmonary tests. Such limitation has been considered by previous research that adopted cycloergometer protocols to assess the cardiorespiratory fitness in older populations [4, 26].

The main finding of this study was that CRF of elderly men with cardiovascular and metabolic diseases and low physical capacity can be classified without aerobic tests using a combination of information on the subject’s daily activity levels, relative handgrip strength, and a self-report of physical fitness level. Maximal aerobic tests have a higher cost, demand familiarization with ergometers, and are frequently difficult to perform in old adults due to poor balance and coordination, gait problems, and fear of exercising [27]. It is also worthy to mention that the accuracy of some submaximal exercise testing models to estimate CRF [28, 29] could be comparable to the accuracy of the present prediction model. It also represents an alternative to some walking tests because it does not require encouragement, which can be a source of disparity across trials, and does not require fatigue and dyspnea measurements.

This study has some limitations, namely, the relatively small sample size, the prediction model restricted to unhealthy men. It is worthy to mention that since running tests may potentially produce higher MET_peak values, the reproducibility of our findings in treadmill exercise testing should also be addressed, despite the fact that cycloergometer tests are frequently indicated due to safety and mechanical efficiency reasons. Another issue refers to whether the model is capable to show changes in fitness. Probably, changes in age, handgrip strength, and self-related fitness would influence the functional capacity and the METs levels, but only longitudinal studies could confirm this possibility. Additionally, the main objective of the present study was similar to other studies that developed nonexercise models, which were not conceived to detect slight longitudinal variations. In brief, the model aims to classify and compare individuals within a given population, and does not intend to replace cardiopulmonary exercise testing to precisely assess the CRF. Therefore, it is possible that small changes in CRF due to training cannot be detected by our equation.

5. Conclusion

CRF level is an important indicator of morbidity and mortality in elderly men. However, the CRF assessment is usually limited due the mobility issues and the risk of cardiovascular events especially in older people with chronic conditions. The present study presented an accurate fitness prediction model for elderly men with cardiovascular and metabolic diseases. The model provides a very fast and safe assessment of fitness, without any chance for cardiovascular events during assessment, which could be very feasible in many healthcare settings to estimate CRF and stratify elderly subjects accordingly, and very attractive for epidemiological studies.

Conflict of Interests

The authors declare that there is no conflict of interest related to the paper.

Acknowledgments

This paper was partially supported by grants conferred to Paulo T. V. Farinatti (CNPq-Brazil 305729/2006-3 and FAPERJ-Brazil E26/102.916/2008) and to Antonio P. de Leon (CNPq-Brazil 309156/2007-6).

References

A. Mroszczyk-McDonald, P. D. Savage, and P. A. Ades, “Handgrip strength in cardiac rehabilitation: normative values, interaction with physical function, and response to training,” Journal of Cardiopulmonary Rehabilitation and Prevention, vol. 27, no. 5, pp. 298–302, 2007.
View at: Publisher Site | Google Scholar
G. A. Heckman and R. S. McKelvie, “Cardiovascular aging and exercise in healthy older adults,” Clinical Journal of Sport Medicine, vol. 18, no. 6, pp. 479–485, 2008.
View at: Publisher Site | Google Scholar
J. A. Berlin and G. A. Colditz, “A meta-analysis of physical activity in the prevention of coronary heart disease,” American Journal of Epidemiology, vol. 132, no. 4, pp. 612–628, 1990.
View at: Google Scholar
M. E. Cress and M. Meyer, “Maximal voluntary and functional performance levels needed for independence in adults aged 65 to 97 years,” Physical Therapy, vol. 83, no. 1, pp. 37–48, 2003.
View at: Google Scholar
N. B. Alexander, D. R. Dengel, R. J. Olson, and K. M. Krajewski, “Oxygen-uptake (VO₂) kinetics and functional mobility performance in impaired older adults,” Journals of Gerontology—Series A, vol. 58, no. 8, pp. 734–739, 2003.
View at: Google Scholar
T. S. Church, T. M. Gill, A. B. Newman, S. N. Blair, C. P. Earnest, and M. Pahor, “Maximal fitness testing in sedentary elderly at substantial risk of disability: LIFE-P study experience,” Journal of Aging and Physical Activity, vol. 16, no. 4, pp. 408–415, 2008.
View at: Google Scholar
E. L. Mailey, S. M. White, T. R. Wójcicki, A. N. Szabo, A. F. Kramer, and E. McAuley, “Construct validation of a non-exercise measure of cardiorespiratory fitness in older adults,” BMC Public Health, vol. 10, article 59, 2010.
View at: Publisher Site | Google Scholar
G. de A. Maranhão Neto, P. M. Lourenço, and P.de T. Farinatti, “Prediction of aerobic fitness without stress testing and applicability to epidemiological studies: a systematic review,” Cadernos de Saude Publica, vol. 20, no. 1, pp. 48–56, 2004.
View at: Google Scholar
R. Jurca, A. S. Jackson, M. J. LaMonte et al., “Assessing cardiorespiratory fitness without performing exercise testing,” American Journal of Preventive Medicine, vol. 29, no. 3, pp. 185–193, 2005.
View at: Publisher Site | Google Scholar
C. Hoffman, D. Rice, and H. Y. Sung, “Persons with chronic conditions: their prevalence and costs,” Journal of the American Medical Association, vol. 276, no. 18, pp. 1473–1479, 1996.
View at: Publisher Site | Google Scholar
T. G. Lohman, A. F. Roche, and R. Martorell, Anthropometric Standardization Reference Manual, Human Kinetics, Champaign, Ill, USA, 1998.
G.de A. Maranhão Neto, A. C. M. P. de Leon, and P.de T. Farinatti, “Cross-cultural equivalence of three scales used to estimate cardiorespiratory fitness in the elderly,” Cadernos de Saude Publica, vol. 24, no. 11, pp. 2499–2510, 2008.
View at: Google Scholar
A. G. M. Wisén, R. G. Farazdaghi, and B. Wohlfart, “A novel rating scale to predict maximal exercise capacity,” European Journal of Applied Physiology, vol. 87, no. 4-5, pp. 350–357, 2002.
View at: Publisher Site | Google Scholar
K. Wasserman, J. E. Hansen, D. Y. Sue, W. W. Stringer, and B. J. Whipp, Principles of Exercise Testing and Interpretation, Lippincott Williams & Wilkins, Philadelphia, Pa, USA, 4th edition, 2004.
G. Borg, Borg's Perceived Exertion and Pain Scales, Human Kinetics, Champaign, Ill, USA, 1998.
American College of Sports Medicine, ACSM's Guidelines for Exercise Testing and Prescription, Lippincott Williams & Wilkins, Philadelphia, Pa, USA, 8th edition, 2010.
D. B. Holiday, J. E. Ballard, and B. C. McKeown, “PRESS-related statistics: regression tools for cross-validation and case diagnostics,” Medicine and Science in Sports and Exercise, vol. 27, no. 4, pp. 612–620, 1995.
View at: Google Scholar
J. M. Bland and D. G. Altman, “Statistical methods for assessing agreement between two methods of clinical measurement,” The Lancet, vol. 327, no. 8476, pp. 307–310, 1986.
View at: Google Scholar
P. S. Visich and J. K. Ehrman, “Graded exercise testing and exercise prescription,” in Clinical Exercise Physiology, J. K. Ehrman , P. M. Gordon, P. S. Visich, and S. J. Keteyian, Eds., Human Kinetics, Champaign, Ill, USA, 2nd edition, 2009.
View at: Google Scholar
G. de A. Maranhão Neto and P. de T. Farinatti, “Non-exercise models for prediction of aerobic fitness and applicability on epidemiological studies: descriptive review and analysis of the studies,” Revista Brasileira de Medicina do Esporte, vol. 9, no. 5, pp. 304–324, 2003.
View at: Google Scholar
H. Syddall, C. Cooper, F. Martin, R. Briggs, and A. A. Sayer, “Is grip strength a useful single marker of frailty?” Age and Ageing, vol. 32, no. 6, pp. 650–656, 2003.
View at: Publisher Site | Google Scholar
H. Sasaki, F. Kasagi, M. Yamada, and S. Fujita, “Grip strength predicts cause-specific mortality in middle-aged and elderly persons,” American Journal of Medicine, vol. 120, no. 4, pp. 337–342, 2007.
View at: Publisher Site | Google Scholar
G. A. McKay and E. W. Banister, “A comparison of maximum oxygen uptake determination by bicycle ergometry at various pedaling frequencies and by treadmill running at various speeds,” European Journal of Applied Physiology and Occupational Physiology, vol. 35, no. 3, pp. 191–200, 1976.
View at: Google Scholar
D. L. Huggett, D. M. Connelly, and T. J. Overend, “Maximal aerobic capacity testing of older adults: a critical review,” Journals of Gerontology—Series A, vol. 60, no. 1, pp. 57–66, 2005.
View at: Google Scholar
P. de T. Farinatti and W. D. Monteiro, “Walk-run transition in young and older adults: with special reference to the cardio-respiratory responses,” European Journal of Applied Physiology, vol. 109, no. 3, pp. 379–388, 2010.
View at: Publisher Site | Google Scholar
P. de T. Farinatti and P. P. S. Soares, “Cardiac output and oxygen uptake relationship during physical effort in men and women over 60 years old,” European Journal of Applied Physiology, vol. 107, no. 6, pp. 625–631, 2009.
View at: Publisher Site | Google Scholar
S. W. Arnett, J. H. Laity, S. K. Agrawal, and M. E. Cress, “Aerobic reserve and physical functional performance in older adults,” Age and Ageing, vol. 37, no. 4, pp. 384–389, 2008.
View at: Publisher Site | Google Scholar
M. J. Peterson, C. F. Pieper, and M. C. Morey, “Accuracy of VO₂(max) prediction equations in older adults,” Medicine and Science in Sports and Exercise, vol. 35, no. 1, pp. 145–149, 2003.
View at: Publisher Site | Google Scholar
L. J. Brandon, D. A. Ross, J. A. Sanford, and A. Lloyd, “Predicting oxygen uptake in older adults using lower-limb accelerometer measures,” Journal of Rehabilitation Research and Development, vol. 41, no. 6, pp. 861–869, 2004.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2012 Geraldo A. Maranhão Neto et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

6840

Downloads

1479

Citations