Research Article | Open Access
Reliability and Validity of the Nigerian (Hausa) Version of the Stroke Impact Scale (SIS) 3.0 Index
This study aims to test the translated Hausa version of the stroke impact scale SIS (3.0) and further evaluate its psychometric properties. The SIS 3.0 was translated from English into Hausa and was tested for its reliability and validity on a stratified random sample adult stroke survivors attending rehabilitation services at stroke referral hospitals in Kano, Nigeria. Psychometric analysis of the Hausa-SIS 3.0 involved face, content, criterion, and construct validity tests as well as internal and test-retest reliability. In reliability analyses, the Cronbach’s alpha values for the items in Strength, Hand function, Mobility, ADL/IADL, Memory and thinking, Communication, Emotion, and Social participation domains were 0.80, 0.92, 0.90, 0.78, 0.84, 0.89, 0.58, and 0.74, respectively. There are 8 domains in stroke impact scale 3.0 in confirmatory factory analysis; some of the items in the Hausa-SIS questionnaire have to be dropped due to lack of discriminate validity. In the final analysis, a parsimonious model was obtained with two items per construct for the 8 constructs (Chi-square/df 3, TLI and CFI 0.9, and RMSEA 0.08). Cross validation with 1000 bootstrap samples gave a satisfactory result (P = 0.011). In conclusion, the shorter 16-item Hausa-SIS seems to measure adequately the QOL outcomes in the 8 domains.
The impact of stroke can be devastating, and unlike other disabling neurological conditions, stroke has a sudden onset leaving the individual and the family ill-prepared to deal with its residual impairments of physical, psychological, and social functions [1–3]. But until recently, stroke research in Nigeria has been largely focused on survival. The notion of quality of life (QOL) among researchers studying the consequence of stroke has gained increasing popularity in health care research following the increased need to improve the quality of lives saved. Recognition of variables related to life satisfaction is essential for such effort . QOL is used as an outcome measure in clinical trials, in population studies, and in descriptive studies of patient groups.
QOL as a construct has been accepted as a multidimensional approach which covers the physical, functional, psychological, and social health dimensions and derived its theoretical framework based on modifications from the WHO’s International Classification of Impairment, Disabilities, and Handicaps [5–9]. Instruments for the measurement of QOL can be generic or specific but are mainly developed in the English Language. They are often translated into other languages and validated for use in different cultures . Many generic and disease specific health-status measurement instruments have been developed for the use in clinical trials evaluating various medical therapies, but their use in examining the impact of stroke and stroke interventions is limited [8, 11]. QOL data in stroke research will prove valuable in providing information and strategies to be utilized by health care providers and professionals in their attempt to improve the QOL of stroke patients. It may also be valuable in providing researchers/professionals with a global picture of recovery following stroke, development of more comprehensive rehabilitation interventions, resource allocation, policy formulation in a resource poor country, planning of rehabilitation services, and specific therapeutics.
While the use of outcome measures has generated increased interest in recent years [11, 12], the use of stroke specific measures such as the SIS 3.0 is also receiving a growing impetus in its use to evaluate QOL among stroke patients across cultures. Currently, there is no tool developed in Hausa language for the evaluation of QOL among stroke survivors. Since SIS 3.0 is written in the English Language, it is necessary to carry out linguistic validation of the MSPSS in Hausa language and further evaluate its psychometric properties so that it can be used in clinical research and practice in Nigeria.
The procedure involved in the development of the Hausa version of the SIS 3.0 involved linguistic translation which was published elsewhere  and the subsequent testing and psychometric validation of the Hausa-SIS 3.0. These cognitive processes are deemed important to make sure that the Hausa-SIS 3.0 was measuring the same concept as the original English version. This is important if comparisons are to be made on the QOL outcomes between different cultures.
This study was conducted at three stroke referral hospitals that are dedicated to the rehabilitation and neurologic disorders in Kano, Nigeria: Aminu Kano Teaching Hospital, Murtala Mohammad Specialist Hospital, and Mohammad Abdullahi Wase Specialist Hospital. Patients with a diagnosis of stroke who were admitted or seen as outpatients during the subacute stage of recovery at the neurology and physiotherapy clinics in these three hospitals between December 2010 and January 2012 were included in the study.
3. Description of the Survey Instrument
The stroke impact scale (SIS) version 3.0 (Supplementary Appendix 1, see Supplementary Material available online at http://dx.doi.org/10.1155/2014/302097) is a stroke specific measure of QOL that has undergone extensive psychometric testing and reported excellent internal consistency, with Cronbach’s alpha values ranging from 0.93 to close to 1 [14–18]. SIS 3.0 was developed based on the viewpoint, perception, position, and contributions of stroke patients, caregivers, and health professionals with stroke expertise . It is a psychometrically robust 59-item stroke-specific self-report measure developed to assess a number of dimensions of QOL. It consists of 8 domains: Strength, Hand function, Mobility, Physical and instrumental activities of daily living (ADL/IADL), Memory and thinking, Communication, Emotion, and Social participation. Scores for each domain range from 0 to 100, where higher scores indicate better QOL. The items in Strength subscale measure physical strength. The items in Memory and thinking, Communication, ADL/IADL, Mobility, and Hand function subscales measure the level of difficulty. Items in the Emotion and Social Participation subscales are rated in terms of frequency. The SIS 3.0 also includes a question (item 60) to assess the patient’s global perception of recovery. The respondent is asked to rate his or her percentage of recovery on a visual analogue scale of 0 to 100, with 0 meaning no recovery and 100 meaning full recovery. Past studies indicate substantial improvement in most SIS domains in patients recovering from mild and moderate stroke [20, 21].
The translated Hausa version of the SIS 3.0  was administered among 35 stroke patients and they were reassessed a week after the first evaluation. The data collected were used in reliability and test-retest reliability analyses. This preliminary test was done by face-to-face interviews with the patients in order to acquire remarks and suggestions on the Hausa scale.
Subsequently, the psychometric properties of the Hausa-SIS was tested using a sample of 140 stroke surviving patients, aged between 35 to 82 years old, selected randomly from the three stroke referral hospitals in Kano, Nigeria. Besides testing the questionnaire, the feasibility of administering the questionnaire under field conditions was also noted. In the confirmatory factor analysis (CFA), the AMOS version 18 software was used to test the instrument validity. AMOS 18 software enables specification, estimation, assessment, and presentation of models to show hypothesized relationship among variables. The software helps build models accurately than multivariate techniques. It provides structural equation modeling, uses Bayesian analysis to improve estimate of model parameter, and offers various models to create different data sets. CFA categorically tests a priori hypotheses about relations between observed variables and latent variables or factors [22, 23].
Approval for the conduct of this study was obtained from the Medical Ethics Committee of the University of Malaya (Eth. Comm./IRB Reference number 830.7), Ministry of Health Kano state, Nigeria (HMB/GEN/488/11), and Aminu Kano Teaching Hospital, Nigeria (AKTH/MAC/SUB/12A/P3/IV/801).
4. Data Analysis
The psychometric properties of the Hausa-SIS were tested through content validity, face validity, criterion validity, construct validity, and internal consistency. Double data entry was carried out and cross-checked to assure the consistency and quality of the data. Most analyses were carried out using the statistical program SPSS for Windows version 20.0. Descriptive statistics were obtained for demographic variables, means, and standard deviations for continuous variables and frequency and percentages for categorical variables. The face and content validity were tested through a pilot test involving stroke patients during the linguistic validation process by the experts in quality of life measures, Public Health, and stroke rehabilitation. The criterion validity of the Hausa-SIS is defined as the performance of the instrument as compared to the existing gold standard or outcome that the measure was intended to assess . Confirmatory factor analysis (CFA) was performed using AMOS version 18 to determine if the number of factors and the loadings measured (indicator) variables on them conform to what is expected on the basis of preestablished theory . In CFA the 8 constructs with their respective indicators were tested simultaneously.
All the 140 stroke survivors who were selected agreed to participate. There were 73 females and 67 males in the study and their ages ranged from 35 to 82 years with a mean age of years. In the sample, cerebral ischemic stroke was detected in 48 (34.3%) patients, and cerebral haemorrhage was in 11 (7.9%) and could not be determined (indeterminate) in 81 (57.9%) patients. 63 (45.0%) patients had left hemispheric lesions, whereas 77 (55.0%) had affected right hemisphere. In the sample 107 (76.4%) were urban residents.
Content and face validity testing of the Hausa-SIS was performed by the experts to ensure that the Hausa-SIS had achieved conceptual, semantic, and operational equivalence with the original index. During translation and where required, expressions used in the items were subjected to more culturally acceptable linguistic equivalents similar to concept and meaning to the original items. A pretesting and pilot study with 30 stroke survivors additionally attested the face and content validation of the Hausa-SIS. The time taken to answer the questionnaire was also acceptable, that is, 15–20 minutes. The feasibility of administering the instrument under field condition was also verified. The instrument was found to be easily conceivable, simple, clear, and appropriate for the assessment of QOL among this group of stroke survivors.
In reliability analyses, the Cronbach’s alpha values for the items in Strength, Hand function, Mobility, ADL/IADL, Memory and thinking, Communication, Emotion, and Social participation domains were 0.80, 0.92, 0.90, 0.78, 0.84, 0.89, 0.58, and 0.74, respectively.
In CFA, the 8-factor model (Figure 1) did not fit well (Chi-square/df > 3, TLI and CFI < 0.9, and RMSEA > 0.08). Guided by modification indices option in AMOS, the model was corrected shortcoming in discriminant validity.
In the final analysis, a parsimonious model (Figure 2) was obtained with two items per construct for the 8 constructs (Chi-square/df < 3, TLI and CFI > 0.9 and RMSEA < 0.08).
The unstandardized regression weights and the factor loadings (standardized regression weights) are shown in Table 1.
All the factor loadings are more than 0.7 and the average variance extracted (AVE) for all the constructs are more than 0.50. The pairwise correlation coefficients between the constructs are provided in Table 2.
Since the highest correlation value is less than 0.85, there is no sign of multicollinearity . Further test on discriminant validity was done by comparing the AVE and the -squared values between constructs, pairwise. There is sufficient discriminant validity ids the AVEs are more than the -square value . Based on the results that are summarized in Table 3, there is sufficient discriminant validity between the constructs.
|Values in parenthesis are AVEs and the others are the pair-wise -squared values.|
In Table 3, the average variance extracted (AVE) values are more than 0.5. Thus, there is sufficient convergent validity within the construct. When compared pairwise, all the AVEs are higher than the -squared values. Thus, there is sufficient discriminant validity between the constructs.
The principal results from the investigation of the SIS 3.0 with stroke survivors in Kano, Nigeria suggest that the SIS 3.0 is a suitable measure for assessing quality of life among stroke survivors. The SIS 3.0 validation was conducted in close collaboration between the translation committee comprising of the multiprofessional experts from University of Malaya, Bayero University Kano, Nigeria and professional translators from the Freedom Radio Nigeria muryar jama’a 99.5FM (an independent radio), and the copyright owner/developers of the questionnaire. During translation and where required, expressions used in the items were subjected to more culturally acceptable linguistic equivalents similar to concept and meaning to the original items.
During pilot study, the respondents did not encounter problems with understanding the contents of the Hausa version of the SIS 3.0 but raised concern on some of the terms used in the items. They provided some suggestions and a consensus was reached and we retained the items by providing supplementary explanatory sentences. The instrument was found to be easily conceivable, simple, clear, and appropriate for the assessment of QOL among this group of stroke survivors. In the reliability analysis, the cronbach’s alpha values for the items in the respective 8 domains were above 0.55. This indicates that the Hausa-SIS 3.0 index items are well correlated with one another in a decisive way and are suitable to constitute an index. In the CFA, the initial tested model did not fit well (Chi-square/df > 3, TLI and CFI < 0.9 and RMSEA > 0.08). After correcting for lack of discriminant validity, the 8 domains were maintained but reduced to two items each. The model fit in the final model was good (Chi-square/df < 3, TLI and CFI > 0.9, and RMSEA < 0.08).
To our knowledge, this study is the first of its kind conducted in Nigeria that involved translating and testing the psychometric properties of the Hausa version of the SIS 3.0. In accordance with the proposal by Clark and Watson, the number of items in an instrument determines the sample size to be used in the psychometric testing. For an instrument with 20 items or less, a sample size between 100 and 200 subjects is deemed to be adequate [25, 26]. Hence, in this study the sample size of 140 is considered to be adequate for testing the psychometric properties of the Hausa-SIS 3.0 index.
The strength of our study was the fact that the study involved rigorous forward-backward translations of the tool. An extensive AMOS modelling to confirm the factor structure, and in the end we obtained a good validated instrument. The study had some limitations; firstly, although we have a good sample size, it would have been better with a bigger sample size. Secondly, the measure was not tested against any measure of quality of life including disability and dependence in the activities of daily living. Analysis of the metric properties for severity groups is also absent. This needed to be conducted in further studies.
It was found that the 16-item Hausa-SIS 3.0 (Supplementary Appendix 2) which is the Hausa short version of the SIS 3.0 seems to measure adequately the QOL outcomes in the 8 domains. Such researchers investigating quality of life in stroke survivors could use this instrument for studies with the hope that it will prove valuable in providing information and strategies to be utilized by health care providers and professionals in their attempt to improve the QOL of stroke patients.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
The authors would like to thank the University of Malaya Postgraduate Research Grant for supporting us with the funds to conduct this study (Project no. PS034-2012A). They are also grateful to staff and the volunteered stroke patients of the Aminu Kano Teaching Hospital and Murtala Mohammad Specialist Hospital, Nigeria for their active involvement in the translation process.
The Stroke Impact Scale (SIS) version 3.0 (Supplementary material) is a stroke specific measure of QOL developed based on the viewpoint, perception, position and contributions of stroke patients, caregivers, and health professionals with stroke expertise. It is a psychometrically robust 59-item stroke-specific self-report measure developed to assess a number of dimensions of QOL. It consist of 8 domains: strength, hand function, mobility, physical and instrumental activities of daily living (ADL/IADL), memory and thinking, communication, emotion and social participation. Scores for each domain range from 0 to 100, where higher scores indicate better QOL. The SIS 3.0 also includes a question (item 60) to assess the patient’s global perception of recovery. The respondent is asked to rate his or her percentage of recovery on a visual analogue scale of 0 to 100, with 0 meaning no recovery and 100 meaning full recovery.
- S.-M. Lai, S. Perera, P. W. Duncan, and R. Bode, “Physical and social functioning after stroke: comparison of the stroke impact scale and short form-36,” Stroke, vol. 34, no. 2, pp. 488–493, 2003.
- M. L. Hackett, J. R. Duncan, C. S. Anderson, J. B. Broad, and R. Bonita, “Health-related quality of life among long-term survivors of stroke: Results from the Auckland stroke study, 1991-1992,” Stroke, vol. 31, no. 2, pp. 440–447, 2000.
- M. D. Patel, C. McKevitt, E. Lawrence, A. G. Rudd, and C. D. A. Wolfe, “Clinical determinants of long-term quality of life after stroke,” Age and Ageing, vol. 36, no. 3, pp. 316–322, 2007.
- T. B. Wyller, J. Holmen, P. Laake, and K. Laake, “Correlates of subjective well-being in stroke patients,” Stroke, vol. 29, no. 2, pp. 363–367, 1998.
- J. Larson, Å. Franzén-Dahlin, E. Billing, M. von Arbin, V. Murray, and R. Wredling, “The impact of gender regarding psychological well-being and general life situation among spouses of stroke patients during the first year after the patients' stroke event: a longitudinal study,” International Journal of Nursing Studies, vol. 45, no. 2, pp. 257–265, 2008.
- D. Buck, A. Jacoby, A. Massey, and G. Ford, “Evaluation of measures used to assess quality of life after stroke,” Stroke, vol. 31, no. 8, pp. 2004–2010, 2000.
- J. Carod-Artal, J. A. Egido, J. L. González, and E. V. Seijas, “Quality of life among stroke survivors evaluated 1 year after stroke: experience of a stroke unit,” Stroke, vol. 31, no. 12, pp. 2995–3000, 2000.
- C. Haacke, A. Althaus, A. Spottke, U. Siebert, T. Back, and R. Dodel, “Long-term outcome after stroke: evaluating health-related quality of life using utility measurements,” Stroke, vol. 37, no. 1, pp. 193–198, 2006.
- S. Barak and P. W. Duncan, “Issues in selecting outcome measures to assess functional recovery after stroke,” NeuroRx, vol. 3, no. 4, pp. 505–524, 2006.
- M. G. Lima, M. B. De Azevedo Barros, C. L. G. César, M. Goldbaum, L. Carandina, and R. M. Ciconelli, “Impact of chronic disease on quality of life among the elderly in the state of Sao Paulo, Brazil: a population-based study,” Revista Panamericana de Salud Publica/Pan the American Journal of Public Health, vol. 24, no. 4, pp. 314–321, 2009.
- P. J. Doyle, “Measuring health outcomes in stroke survivors,” Archives of Physical Medicine and Rehabilitation, vol. 83, no. 12, pp. S39–S43, 2002.
- F. J. Carod-Artal, D. S. Trizotto, L. F. Coral, and C. M. Moreira, “Determinants of quality of life in Brazilian stroke survivors,” Journal of the Neurological Sciences, vol. 284, no. 1-2, pp. 63–68, 2009.
- A. M. Hamza, “Evaluation of Quality of Life among stroke Survivors: linguistic validation of the Stroke Impact Scale 3.0 in Hausa language,” Journal of the Nigeria Society of Physiotherapy, vol. 20, pp. 52–59, 2012.
- P. W. Duncan, R. K. Bode, S. M. Lai, and S. Perera, “Rasch analysis of a new stroke-specific outcome scale: The stroke impact scale,” Archives of Physical Medicine and Rehabilitation, vol. 84, no. 7, pp. 950–963, 2003.
- J. H. White, M. K. Alston, J. L. Marquez et al., “Community-dwelling stroke survivors: function is not the whole story with quality of life,” Archives of Physical Medicine and Rehabilitation, vol. 88, no. 9, pp. 1140–1146, 2007.
- F. J. Carod-Artal, L. F. Coral, D. S. Trizotto, and C. M. Moreira, “The stroke impact scale 3.0: evaluation of acceptability, reliability, and validity of the brazilian version,” Stroke, vol. 39, no. 9, pp. 2477–2484, 2008.
- O. Altindag, N. Soran, A. Demirkol, and M. Y. Özkul, “The association between functional status, health related quality of life and depression after stroke,” Turkish Journal of Physical Medicine and Rehabilitation, vol. 54, pp. 89–91, 2008.
- P. W. Duncan, R. K. Bode, S. M. Lai, and S. Perera, “Rasch analysis of a new stroke-specific outcome scale: the stroke impact scale,” Archives of Physical Medicine and Rehabilitation, vol. 84, no. 7, pp. 950–963, 2003.
- D. Kranciukaite and D. Rastenyte, “Measurement of quality of life in stroke patients,” Medicina, vol. 42, no. 9, pp. 709–716, 2006.
- P. W. Duncan, H. S. Jorgensen, and D. T. Wade, “Outcome measures in acute stroke trials: a systematic review and some recommendations to improve practice,” Stroke, vol. 31, no. 6, pp. 1429–1438, 2000.
- C. Acquadro, K. Conway, C. Girourdet, and I. Mear, “Linguistic validation manual for patient-reported outcomes (PRO) instruments Lyon: MAPI Research Trust,” 2004.
- D. E. Beaton, C. Bombardier, F. Guillemin, and M. B. Ferraz, “Guidelines for the process of cross-cultural adaptation of self-report measures,” Spine, vol. 25, no. 24, pp. 3186–3191, 2000.
- T. A. Brown, Confirmatory Factor Analysis for Applied Research, Guilford Press, New York, NY, USA, 2006.
- A. P. Field, Discovering Statistics Using SPSS, Sage, 3rd edition, 2009.
- L. A. Clark and D. Watson, “Constructing validity: basic issues in objective scale development,” Psychological Assessment, vol. 7, no. 3, pp. 309–319, 1995.
- Z. Y. M. Yusof and N. Jaafar, “A Malay version of the Child Oral Impacts on Daily Performances (Child-OIDP) index: assessing validity and reliability,” Health and Quality of Life Outcomes, vol. 10, article 63, 2012.
Copyright © 2014 Ashiru Hamza Mohammad et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.