Research Article | Open Access
Ali Hassan Alhaiti, Alanod Raffa Alotaibi, Linda Katherine Jones, Cliff DaCosta, George Binh Lenon, "Psychometric Evaluation of the Revised Michigan Diabetes Knowledge Test (V.2016) in Arabic: Translation and Validation", Journal of Diabetes Research, vol. 2016, Article ID 9643714, 7 pages, 2016. https://doi.org/10.1155/2016/9643714
Psychometric Evaluation of the Revised Michigan Diabetes Knowledge Test (V.2016) in Arabic: Translation and Validation
Objective. To translate the revised Michigan Diabetes Knowledge Test into the Arabic language and examine its psychometric properties. Setting. Of the 139 participants recruited through King Fahad Medical City in Riyadh, Saudi Arabia, 34 agreed to the second-round sample for retesting purposes. Methods. The translation process followed the World Health Organization’s guidelines for the translation and adaptation of instruments. All translations were examined for their validity and reliability. Results. The translation process revealed excellent results throughout all stages. The Arabic version received 0.75 for internal consistency via Cronbach’s alpha test and excellent outcomes in terms of the test-retest reliability of the instrument with a mean of 0.90 infraclass correlation coefficient. It also received positive content validity index scores. The item-level content validity index for all instrument scales fell between 0.83 and 1 with a mean scale-level index of 0.96. Conclusion. The Arabic version is proven to be a reliable and valid measure of patient’s knowledge that is ready to be used in clinical practices.
Diabetes mellitus, as defined by the World Health Organization , is “a metabolic disorder of multiple aetiology characterized by chronic hyperglycaemia with disturbances of carbohydrate, fat and protein metabolism resulting from defects in insulin secretion, insulin action or both.” The International Diabetes Federation (IDF) has indicated that there are 415 million people with diabetes in the world and this number is expected to rise to 642 million by 2040. Conversely, only 12% of global health expenditure, estimated at a cost of US 673 billion, is directed toward diabetes .
Saudi Arabia, according to data released by IDF, is one of the top five countries for the prevalence of diabetes in the middle-eastern and north-African regions, with 3.8 million patients with diabetes, which represents 23.9% of the population. This may be due to different cultural structures, active socioeconomic growth, and significant recent adjustments in lifestyle [2, 3]. Studies reveal that diabetes cost Saudi Arabia an estimated 9.4 billion in 2010, a figure that has been predicted to increase sevenfold to 6.5 billion by 2020 .
Diabetes self-management education (DSME) is a critical approach that provides the foundation to assist people with diabetes to make a multitude of conventional self-management arrangements and to perform multiple care activities. The primary intention of DSME is to encourage active self-care behaviour facilitating the knowledge, skill, and ability required for diabetes self-care . Further, studies have reported that the utilisation of healthcare services and facilities decreases when people receive educational support compared with those who do not. DSME helps control HbA1c levels an effect that likewise results in significant healthcare savings .
The estimation of patient’s levels of knowledge has been the cornerstone of medical assessment for many years. In 1998, the diabetes knowledge test (DKT) was validated and introduced as a reliable instrument for the expert evaluation of patients’ general knowledge of diabetes . Since then, the test has been used by diabetes researchers throughout the world and translated into multiple languages, such as Spanish, Greek, Navajo, Norwegian, Arabic, and Malaysian .
The DKT is a 23-item instrument designed to assess patient knowledge of diabetes concerning diet, exercise, blood glucose levels, and testing and self-care activities. The first 14 items apply to all patients and the remaining nine items are relevant to those using insulin . A 2011 review of the 1998 version of the DKT showed that the test was outdated and needed to be updated according to evidence provided by more recent literature . The DKT has since been revised and modified based on current self-management education and practice standards and was renamed DKT-2 in 2016. No items were added to or withdrawn from the new DKT-2 and most modifications were minor. Seven items were adjusted to simplify the questions and answers, two items were modified to improve the grammar, and the last four items were changed to meet current national standards .
The aim of this current study is to translate a valid version of the DKT-2 into Arabic and to evaluate the psychometric properties of this new Arabic version.
The translation of the DKT-2 was conducted in accordance with the WHO process for the translation and adaptation of instruments . Professional translation and validation of texts are attained through several distinct steps, as shown in Figure 1: forward- and back-translation, expert panel review, pretesting, cognitive interviewing, and psychometric evaluation.
2.1. Study Setting and Sampling Procedures
This study was conducted in the Specialised Diabetes and Endocrine Centre in King Fahad Medical City (KFMC), which is one of the largest health care facilities in the Gulf region with a total capacity of 1059 beds. The centre consists of four hospitals and multiple departments providing tertiary care for all patients across the Kingdom of Saudi Arabia.
A convenience sample of 139 participants was identified between September and October 2015. Participants were required to meet the following inclusion criteria at the time of the study in order to be considered: (1) they were patients at KFMC, (2) they were at least 20 years old, (3) they had been diagnosed with type 2 diabetes (T2D), and (4) they were able to read and write in Arabic or English.
After providing informed consent, the recruited participants were asked to complete a questionnaire. The haemoglobin A1c (HbA1c) levels were obtained from medical records with permission of patients. A researcher was available to answer any questions arising from the questionnaire. To determine test-retest reliability, participants were informed that there would be a follow-up appointment in two weeks’ time. In total, 34 participants completed the questionnaire twice.
2.3. Ethical Considerations
This study received ethics approval from the ethics committee at KFMC in Saudi Arabia (H-01-R-012), IRB with OHRP/NIH, USA (IRB00008644), and RMIT University in Australia (ASEHAPP 59–14).
2.4. Process of Translation and Validation
In the first stage, the DKT-2 was translated into Arabic for a fee by a professional independent translator. The translator was requested to retain the concepts, to use appropriate language to reach the broadest possible audience, and to comply with the WHO general guidelines . The assignment was completed over five days and, with the return of the forward-translation, the first Arabic version was ready.
2.4.2. Expert Panel 1
Researchers organized a panel group, consisting of five members including the original translator, experts in health, and experts experienced in research-instrument adoption, according to WHO recommendations. The panel reviewed all related materials provided by the principal investigators along with the translation and were requested to identify and modify any inadequate expressions or concepts. Their recommendations were adopted for the DKT-2, including the phrases utilised in items one, two, three, four, and eight for non-US-patient populations.
The expert panel discussed the individual words and expressions comprising each item and suggested alternatives. Each of the recommendations made by the panel members was considered, except for those that the majority of the panel were able to clearly justify dismissing. On the completion of this stage, the translated text was ready for back-translation.
The DKT-2 was sent to a second independent and this time native-English-speaking translator, who had not yet engaged in this process and who had no prior knowledge of the study, for back-translation into English. The job was completed and sent back to the researcher three days later. The back-translated version was remarkably similar to the original text with the exception of the sections recommended for non-US-patient populations.
2.4.4. Expert Panel 2
For the second round of revision and modification, the researcher invited another bilingual panel group to assess the content validity index (CVI) and to prepare the final version of the Arabic DKT-2. As shown in Table 1, committee members of both sexes were recruited with the majority of these experts being nurses; however, the sample also included a clinical educator, a clinical-research consultant, the head of diabetes education, and a translator. All worked at KFMC in Riyadh.
Content validity has been defined as “the degree to which an instrument has an appropriate sample of items for the construct being measured” . CVI is the most broadly utilised index in content assessment. It consists of two characters: the item-level content validity index (I-CVI) defining the content validity of individual items and the scale-level content validity index (S-CVI) determining the content validity of an overall scale . Researchers confirm that an acceptable content validity has I-CVI of 0.78 or higher and proportionate unanimous approval or S-CVI/universal agreement (S-CVI/UA) of 0.8 or 0.9 or greater .
Studies recommend that a minimum of three experts should engage in this task and that a 4-point scale should be employed to rate the items, with 1 = not relevant, 2 = somewhat relevant, 3 = quite relevant, and 4 = highly relevant . The purpose of the use of CVI is to determine the cultural appropriateness and effectiveness of the DKT-2 Arabic version in measuring patient levels of knowledge in the Arabic-speaking population.
2.5. Statistical Analysis
All statistical calculations were undertaken using the Statistical Package for the Social Sciences (SPSS v.23) software. Descriptive statistics were used to describe participant characteristics. Test-retest reliability () was determined by the intraclass correlation coefficient (ICC) using a two-way, random form. ICC of 0.75 is considered an excellent level of test-retest reliability, rates between 0.40 and 0.75 reflect a good level of reliability, and rates of less than 0.4 indicate poor test-retest reliability . Cronbach’s alpha was used to evaluate the text’s internal consistency; an acceptable Cronbach alpha score for internal consistency is 0.70 and above .
3.1. Participant Characteristics
In total, 139 patients participated in the first round but only 34 (or 24%) were admitted to the second round. Demographic data reflected HbA1c level, age, gender, monthly income, level of education, time since T2D diagnoses, and number of diseases contracted. As shown in Table 2, 51% () of participants indicated poor levels of HbA1c-level control, 40.3% () were between 18 and 30 years of age, 44.6% () were males and 53.2% () were females, 40.3% () received less than SR5000 per month, 41% () held a bachelor degree, 44% () had been diagnosed with T2D for more than 10 years, and 38% () had more than one disease.
3.2. Reliability and Validity of the Arabic DKT-2
The Arabic DKT-2 received an internal consistency score of 0.75, which is within the recommended range of Cronbach’s alpha test . The outcomes of the test-retest (see Table 3) revealed excellent instrument reliability with a mean ICC of 0.90 . The content validity analysis presented in Table 4 depicts the I-CVI for all instrument scales as between 0.83 and 1 and a mean S-CVI of 96, indicating strong agreement between the two versions. According to Lynn , the I-CVI should be no lower than 0.78 or 0.80 for the S-CVI to be judged acceptable.
|Note. Two-way mixed-effects model where people effects are random and measures effects are fixed.|
estimator is the same whether the interaction effect is present or not.
A ICCs using an absolute agreement definition.
achieve an estimate, this number is computed assuming the interaction effect is absent.
4. Discussion and Conclusion
This study sought to evaluate the translation of the DKT-2, the most commonly used instrument for determining knowledge of diabetes care and management, from English into Arabic . The results demonstrated that the Arabic DKT-2 questionnaire is an acceptable cross-cultural research instrument as shown in the following list which could be used in Saudi Arabia. It was a challenge to translate this text into another language taking into consideration cultural differences [15, 16]. The translation and validation process followed the recommendations of WHO for the translation and adaptation of instruments , which included forward-translation conducted by an independent translator followed by a systematic panel meeting to discuss the translation’s quality and modify the instrument in keeping with WHO’s guidelines. The next step required another independent translator to perform a back-translation before a third version of the Arabic DKT-2 was produced and, finally, another panel met to discuss the CVI and translation outcomes. This panel reported that the I-CVI for all instruments was between 0.83 and 1, with a mean S-CVI of 96, indicating excellent agreement according to Lynn . Statistical psychometric analyses determined that the DKT-2 received the acceptable result of 0.75 for its internal consistency (Cronbach’s alpha test) as well as an excellent reliability ICC level of 0.90.
Michigan Diabetes Research and Training Center’s Revised Diabetes Knowledge Test(1)The diabetes diet is:(a)The way most American people eat(b)A healthy diet for most people(c)Too high in carbohydrate for most people(d)Too high in protein for most people(2)Which of the following is highest in carbohydrate?(a)Baked chicken(b)Swiss cheese(c)Baked potato(d)Peanut butter(3)Which of the following is highest in fat?(a)Low fat (2%) milk(b)Orange juice(c)Corn(d)Honey(4)Which of the following is a “free food”?(a)Any unsweetened food(b)Any food that has “fat free” on the label(c)Any food that has “sugar free” on the label(d)Any food that has less than 20 calories per serving(5)A1C is a measure of your average blood glucose level for the past:(a)Day(b)Week(c)6–12 weeks(d)6 months(6)Which is the best method for home glucose testing?(a)Urine testing(b)Blood testing(c)Both are equally good(7)What effect does unsweetened fruit juice have on blood glucose(a)Lowers it(b)Raises it(c)Has no effect(8)Which should not be used to treat low blood glucose?(a)3 hard candies(b)1/2 cup orange juice(c)1 cup diet soft drink(d)1 cup skim milk(9)For a person in good control, what effect does exercise have on blood glucose(a)Lowers it(b)Raises it(c)Has no effect(10)What effect will an infection most likely have on blood glucose?(a)Lowers it(b)Raises it(c)Has no effect(11)The best way to take care of your feet is to:(a)Look at and wash them each day(b)Massages them with alcohol each day(c)Soak them for one hour each day(d)Buy shoes a size larger than usual(12)Eating foods lower in fat decreases your risk for:(a)Nerve disease(b)Kidney disease(c)Heart disease(d)Eye disease(13)Numbness and tingling may be symptoms of:(a)Kidney disease(b)Nerve disease(c)Eye disease(d)Liver disease(14)Which of the following is usually not associated with diabetes:(a)Vision problems(b)Kidney problems(c)Nerve problems(d)Lung problems.
The original instrument was well-developed, validated, and widely used to assess general diabetes knowledge. It is a simple and user-friendly instrument and it has been translated into many languages . It has consistently achieved acceptable results in Cronbach’s alpha-validity tests . Further, the results of this study are consistent with AlJohani et al. (2016) who used similar methods for the translation and validation of the summary of diabetes self-care activities survey into Arabic .
In conclusion, this Arabic version of DKT-2 has been demonstrated to be a reliable and valid measure of diabetes knowledge which can be used in clinical practice. However, the sample sizes used by this study for testing-retesting, as well as the convenience sampling methods, may not be representative of all situations in Saudi Arabia.
The authors declare that they have no competing interests in this project.
Ali Alhaiti, George Lenon, and Linda Jones established the project and designed the study. Alanod Alotaibi managed the recruitment and data collection. Ali Alhaiti, George Lenon, and Cliff DaCosta worked on the data analysis. Initial manuscript was prepared by Ali Alhaiti and reviewed and edited by George Lenon, Linda Jones, Cliff DaCosta, and Alanod Alotaibi. All the authors approved the final manuscript.
This work was supported by King Fahad Medical City with Grant no. IRF–015–049. The project of the original instrument was supported by the National Institute of Diabetes and Digestive and Kidney Diseases Grant no. P30DK092926 (MCDTR). The authors special thanks are extended for the valuable support of research participants and staff at the Specialised Diabetes and Endocrine Centre at King Fahad Medical City where this survey was conducted.
- WHO, Fact sheet 2016, http://www.who.int/mediacentre/factsheets/fs312/en/.
- International Diabetes Federation, IDF Diabetes Atlas, International Diabetes Federation, Brussels, Belgium, 7th edition, 2016, http://www.diabetesatlas.org/.
- A. K. Alhowaish, “Economic costs of diabetes in Saudi Arabia,” Journal of Family and Community Medicine, vol. 20, no. 1, pp. 1–7, 2013.
- M. A. Powers, J. Bardsley, M. Cypress et al., “Diabetes self-management education and support in type 2 diabetes: a joint position statement of the American Diabetes Association, the American Association of Diabetes Educators, and the Academy of Nutrition and Dietetics,” Diabetes Care, vol. 38, no. 7, pp. 1372–1382, 2015.
- G. A. Davis, “Diabetes self-management education,” South Carolina Nurse, vol. 17, no. 3, p. 2, 2010.
- J. T. Fitzgerald, M. M. Funnell, R. M. Anderson, R. Nwankwo, R. B. Stansfield, and G. A. Piatt, “Validation of the revised brief Diabetes Knowledge Test (DKT2),” The Diabetes Educator, vol. 42, no. 2, pp. 178–187, 2016.
- H. K. Al-Qazaz, M. A. Hassali, A. A. Shafie, S. A. S. Sulaiman, and S. Sundram, “The 14-item Michigan diabetes knowledge test: translation and validation study of the Malaysian version,” Practical Diabetes International, vol. 27, no. 6, pp. 238–241, 2010.
- F. Al-Maskari, M. El-Sadig, J. M. Al-Kaabi, B. Afandi, N. Nagelkerke, and K. B. Yeatts, “Knowledge, attitude and practices of diabetic patients in the United Arab Emirates,” PLoS ONE, vol. 8, no. 1, Article ID e52857, 2013.
- F. Denise and C. T. B. Polit, Study Guide to Accompany Nursing Research: Principles and Methods, Lippincott Williams & Wilkins, Philadelphia, Pa, USA, 7th edition, 2004.
- J. T. Fitzgerald, M. M. Funnell, G. E. Hess et al., “The reliability and validity of a brief diabetes knowledge test,” Diabetes Care, vol. 21, no. 5, pp. 706–710, 1998.
- D. F. Polit and C. T. Beck, “The content validity index: are you sure you know what's being reported? Critique and recommendations,” Research in Nursing & Health, vol. 29, no. 5, pp. 489–497, 2006.
- I. E. O. Moljord, M. L. Lara-Cabrera, L. Perestelo-Pérez, A. Rivero-Santana, L. Eriksen, and O. M. Linaker, “Psychometric properties of the Patient Activation Measure-13 among out-patients waiting for mental health treatment: a validation study in Norway,” Patient Education and Counseling, vol. 98, no. 11, pp. 1410–1417, 2015.
- H. A. DeVon, M. E. Block, P. Moyle-Wright et al., “A psychometric toolbox for testing validity and reliability,” Journal of Nursing Scholarship, vol. 39, no. 2, pp. 155–164, 2007.
- M. R. Lynn, “Determination and quantification of content validity,” Nursing Research, vol. 35, no. 6, pp. 382–386, 1986.
- F. Guillemin, C. Bombardier, and D. Beaton, “Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines,” Journal of Clinical Epidemiology, vol. 46, no. 12, pp. 1417–1432, 1993.
- D. Wild, A. Grove, M. Martin et al., “Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR Task Force for Translation and Cultural Adaptation,” Value in Health, vol. 8, no. 2, pp. 94–104, 2005.
- K. A. AlJohani, G. E. Kendall, and P. D. Snider, “Psychometric evaluation of the Summary of Diabetes Self-Care Activities-Arabic (SDSCA-Arabic): translation and analysis process,” Journal of Transcultural Nursing, vol. 27, no. 1, pp. 65–72, 2016.
Copyright © 2016 Ali Hassan Alhaiti et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.