- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
ISRN Obstetrics and Gynecology
Volume 2013 (2013), Article ID 361435, 7 pages
Similar Adverse Pregnancy Outcome in Native and Nonnative Dutch Women with Pregestational Type 2 Diabetes: A Multicentre Retrospective Study
1Department of Endocrinology, University Medical Centre Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
2Department of Obstetrics and Gynaecology, University Medical Centre Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
3Department of Endocrinology, University Medical Centre Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands
4Department of Obstetrics and Gynaecology, University Medical Centre Utrecht, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands
5Division of Medical Biology, University Medical Centre Groningen, University of Groningen, Hanzeplein 1, 9713 GZ Groningen, The Netherlands
6Department of Internal Medicine, Academic Medical Centre, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands
7Department of Internal Medicine, Erasmus Medical Centre, ’s-Gravendijkwal 230, 3015 CE Rotterdam, The Netherlands
8Department of Internal Medicine, Medical Centre Haaglanden, Lijnbaan 32, 2512 VA The Hague, The Netherlands
9Department of Endocrinology, Atrium Medical Centre, Henri Dunantstraat 5, 6419 PC Heerlen, The Netherlands
10Department of Endocrinology, Meander Medical Centre, Ringweg Randenbroek 110, 3816 CP Amersfoort, The Netherlands
Received 2 August 2013; Accepted 9 September 2013
Academic Editors: F. M. Reis and G. Rizzo
Copyright © 2013 Bart Groen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Objective. To assess the incidence of adverse pregnancy outcome in native and nonnative Dutch women with pregestational type 2 diabetes (T2D) in a multicenter study in The Netherlands. Methods. Maternal characteristics and pregnancy outcome were retrospectively reviewed and the influence of ethnicity on outcome was evaluated using independent -test, Mann-Whitney -test, and chi-square test. Results. 272 pregnant women (80 native and 192 non-native Dutch) with pregestational T2D were included. Overall outcome was unfavourable, with a perinatal mortality of 4.8%, major congenital malformations of 6.3%, preeclampsia of 11%, preterm birth of 19%, birth weight >90th percentile of 32%, and a Caesarean section rate of 42%. In nonnative Dutch women, the glycemic control was slightly poorer and the gestational age at booking somewhat later as compared to native Dutch women. However, there were no differences in incidence of preeclampsia/HELLP, preterm birth, perinatal mortality, macrosomia, and congenital malformations between those two groups. Conclusions. A high incidence of adverse pregnancy outcomes was found in women with pregestational T2D, although the outcome was comparable between native and non-native Dutch women. This suggests that easy access to and adequate participation in the local health care systems contribute to these comparable outcomes, offsetting potential disadvantages in the non-native group.
Pregestational diabetes mellitus comprises both type 1 and type 2 diabetes mellitus. Pregestational type 1 diabetes mellitus is clearly associated with an increased incidence of adverse maternal, fetal, and neonatal outcome [1–4], and several studies in the last two decades have shown that pregestational type 2 diabetes poses an emerging problem, with pregnancy outcomes at least as poor as in women with type 1 diabetes [5–9]. This gains even more importance in view of the global diabetes epidemic which leads to ever increasing numbers of women in the childbearing age with pregestational type 2 diabetes [5, 10]. To add to the problem, pregestational type 2 diabetes is encountered frequently in specific subpopulations in north-western Europe, such as recently migrated women from Africa, Asia, and the Middle East . These women are possibly more prone to suboptimal participation in the health care system because of frequently existing language barriers, generally less financial resources, and low education levels in those immigrant groups.
The Netherlands can be considered as a representative developed European country with ethnic minorities reflecting economic and social history . Data from an epidemiological study from the Netherlands revealed that perinatal mortality is increased in women with a nonnative Dutch origin . Therefore, the question rises if ethnicity plays a role in the development of pregnancy complications in women with type 2 diabetes, since the incidence of type 2 diabetes is more common in specific ethnicities . Unfortunately, the possible relation between ethnicity and pregnancy complications in women with type 2 diabetes has received limited attention in western Europe. Data from two British studies showed no differences in pregnancy outcome between native British and one single other ethnic (i.e., Afro-Caribbean or Indo-Asian) women with type 2 diabetes [14, 15]. However, these studies were not nationwide and compared no mixture of ethnicities. Therefore, to elucidate more comprehensively the potential impact of ethnic origin (and their possible accompanying problems) on pregnancy outcome, we performed a retrospective multicentre study to assess maternal, fetal, and neonatal outcome in a large group of native and a mixture of nonnative Dutch women with pregestational type 2 diabetes from different hospitals spread throughout the Netherlands. We hypothesized that nonnative Dutch women with type 2 diabetes had a more unfavourable pregnancy outcome as compared to native Dutch women with type 2 diabetes.
A multicentre, retrospective study was performed involving seven large hospitals (University Medical Centre Groningen, University Medical Centre Utrecht, Academic Medical Centre Amsterdam, Erasmus Medical Centre Rotterdam, Medical Centre Haaglanden the Hague, Atrium Medical Centre Heerlen, and Meander Medical Centre Amersfoort) spread around the Netherlands. All women with pregestational type 2 diabetes are referred to hospital care in the Netherlands. 272 women in whom a singleton pregnancy progressed beyond 20 weeks of gestation and who delivered between January 1997 and August 2009 were included in an anonymised database and subsequently evaluated.
The diagnosis pregestational type 2 diabetes was accepted when patients were anti-GAD antibody negative and/or had never experienced a keto-acidotic episode and the diabetes was being managed with diet alone or oral blood glucose-lowering agents and/or insulin. In the latter case, the diagnosis of type 2 diabetes was accepted when treatment with insulin was initiated >6 months after the initial diagnosis.
Patients were divided into native and nonnative Dutch groups, which was representative for the socioeconomic history of the Netherlands. Patients in the latter group were of North-African, Hindu, Afro-Caribbean, Asian, or other nonnative origin.
We retrospectively reviewed all charts and recorded maternal characteristics (age, body mass index, ethnic origin, alcohol use, smoking habits, and parity), duration of diabetes, presence of chronic complications, and preconceptional treatment of diabetes. To assess the potential impact of ethnicity on pregnancy outcome, the origin of the pregnant women was classified as (1) native Dutch and (2) nonnative Dutch. The size of the different ethnic groups (i.e., North-African, Hindu or Afro-Caribbean, etc.) was too small for adequate statistical analysis of these specific ethnicities. HbA1c (mmol/mol) values were recorded and median HbA1c was calculated in the periods one year before pregnancy and during the first, second, and third trimesters.
2.3. Outcome Measures
2.3.1. Obstetric Complications
Preeclampsia was defined as a diastolic blood pressure ≥90 mmHg on two occasions at least four hours apart in the second half of pregnancy in previously normotensive women and de novo albuminuria (≥300 mg/24 h) . In women with preexisting hypertension, pre-eclampsia was diagnosed when albuminuria de novo occurred in the second half of pregnancy. HELLP syndrome was defined as platelet count ≤100 · 109/L, elevated liver enzymes (serum alanine aminotransferase >70 U/L and/or serum aspartate aminotransferase >70 U/L), and haemolysis characterised by serum lactic dehydrogenase level >600 U/L . Preterm birth was defined as delivery before 37 completed weeks of gestation.
2.3.2. Perinatal Outcome
Only major congenital malformations, defined as abnormalities that were fatal, required major surgery or resulted in severe organ malfunction or cosmetic defects were recorded and classified as related to the cardiovascular, central nervous, urogenital system, or other systems. Perinatal mortality was defined as fetal loss after 22 weeks of gestation or neonatal loss during the first 28 days after delivery. Large for gestational age (LGA) was defined as a birth weight above the 90th percentile corrected for gestational age, sex, and parity .
2.4. Statistical Analysis
Continuous parameters were expressed as mean ± SD when normally distributed and as median (–) in case of a skewed distribution. Categorical results were expressed as percentages. The appropriate (non)parametric tests (i.e., independent -test when normally distributed and Mann-Whitney -test in case of a skewed distribution) were used to compare differences between groups for continuous data and the chi-square or Fisher’s exact test for categorical variables. A value <0.05 was considered as statistically significant. All statistical analyses were performed using PASW for windows version 18.0 (SPSS, Inc., Chicago, IL, USA).
A total of 287 singleton pregnancies in women with pregestational type 2 diabetes were referred to our centers. 15 pregnancies ended before 20 weeks of gestation, leaving 272 ongoing pregnancies and deliveries (11 in Amersfoort, 28 in Groningen, 72 in Utrecht, 65 in Amsterdam, 39 in Rotterdam, 10 in Heerlen, and 47 in the Hague). Data from 36 women from one of the centres have been published before .
3.1. Maternal Characteristics
Baseline data of the women are shown in Table 1. 80 pregnancies (29.4%) were from women of native Dutch origin and 192 pregnancies were from women of nonnative Dutch origin (70.6%). The specific origin of nonnative women with pregestational type 2 diabetes was North African in 73 (26.8%), Hindu in 59 (21.7%), Afro-Caribbean in 43 (15.8%), Asian in ten (3.7%) and, other nonnative in seven (2.6%) women. The mean age at conception was 33.0 ± 5.6 (range 18–48 years) and comparable between native and nonnative Dutch women (32.9 ± 4.8 versus 33.1 ± 5.9; ). The median gestational age (GA) at first booking was significantly higher in the nonnative group compared to the native group (11.5 (8.0–19.0) versus 8.0 (6.0–10.3) weeks; ). The clinical duration of diabetes was generally short. There was a significant difference in the use of medication between the two groups: about half of the native women were on insulin, whereas about three-quarters of the nonnative women were on oral glucose-lowering drugs or diet only at presentation (). The glycemic control was less favourable in nonnative women as compared to native women before and during pregnancy ( values 0.04 and <0.001, resp.), although in itself quite reasonable.
3.2. Maternal and Perinatal Outcome
Pregnancy outcome of the total study population and between native and nonnative Dutch women is shown in Table 2. In the total study population, median GA at delivery was 38 weeks; no data of delivery mode was available in one woman because she was referred to another hospital while in labour. Delivery started spontaneously in 75 (27.7%) women, labour was induced in 131 (48.3%), women and a primary Caesarean section (CS) was performed in 65 (24.0%) women. 49 of the 206 women (23.7%) who were planned to deliver vaginally had a secondary CS. The total CS rate was 42.1%. The incidence of CS was significantly higher in native Dutch women as compared to nonnative Dutch women. This difference was caused by a higher incidence of primary CS in native Dutch women with no difference in the incidence of secondary CS between the two groups. The other maternal outcome variables were not different between native and nonnative Dutch women.
Perinatal Mortality. 13 perinatal deaths (4.8%) occurred in the total study group, five fetal and eight neonatal deaths (Table 3). Four (31%) deaths were associated with congenital malformations; four (31%) infants died before or at a GA of 25 weeks and the remaining five (38%) deaths were due to infection (), premature rupture of the membranes (), tension pneumothorax (), or remained unexplained (). No differences in perinatal mortality reflecting maternal ethnicity were found.
Congenital Malformations. Major congenital malformations occurred in 17 (6.3%) infants of the total study population; the incidence in native and nonnative Dutch women was similar. Major congenital malformations involved the cardiovascular system (), the central nervous system (), urogenital system anomalies (), or other structures (). Three of these women were on oral glucose-lowering drugs during the first trimester.
Large for Gestational Age. 85 (31.3%) infants were large for gestational age in the total study population, with no differences between native and nonnative Dutch women.
In contrast to our hypothesis, we showed no differences in pregnancy outcome between native and nonnative Dutch women with pregestational type 2 diabetes, with the exception of a higher CS rate in native Dutch women. However, a high incidence of adverse pregnancy outcomes in the complete group of women with pregestational type 2 diabetes living in the Netherlands was found.
Pregnancy outcome of women with pregestational type 2 diabetes has been studied before and our results are generally in accordance with those reports [5, 7–9]. According to the results of a study on ethnic differences in perinatal mortality in the Netherlands , we expected that outcome in nonnative women with type 2 diabetes would be poorer as compared to native Dutch women, for example, linked to cultural or knowledge barriers in some ethnic minorities affecting access to and effectiveness of care. However, we did not find significant differences in pregnancy outcome (except for the incidence of CS). These data are in accordance with studies from New Zealand and Europe [14, 15, 20, 21]. In the previous European studies, native Caucasians were compared with a single other group. In the study of Hughes et al. from New Zealand, three main ethnicities (i.e., Polynesian, Asian, and European women) were compared. There are some differences between these studies and ours. Firstly, we included all ethnicities, although the limited group size forced us to treat them statistically as one group. Secondly, none of these studies were truly nationwide, while the hospitals participating in our study were spread throughout the Netherlands. From these studies and from our data, it can be concluded that in a setting of easy access to and compliance with the local health care system, outcome in nonnative women with pregestational type 2 diabetes can be similar to that in native women with pregestational type 2 diabetes. This easy access to care might be positively affected by the fact that medical care, for example, in the Netherlands is fully reimbursed with insurance coverage for basically all inhabitants, resulting in an absence of any financial barriers to receive medical care. Apparently, potential negative effects of slightly poorer glycemic control and later presentation are offset by the care system.
The only parameter which differed between native and nonnative Dutch women with pregestational type 2 diabetes was the higher incidence of a (primary) CS in the native group. This difference might partly be due to a higher incidence of maternal overweight, which according to US papers is related to the CS incidence [22, 23]. It may also be that women of native Dutch origin more often opted and negotiated for a primary CS.
The proportion native/nonnative Dutch (i.e., 29.4% versus 70.6%) was not representative for the normal Dutch population . Firstly, this can be explained by a higher incidence of type 2 diabetes among specific non-European subpopulations, such as African, Asian, or Middle-Eastern populations . Secondly, the hospitals that cooperated to this study are mainly located in the urban areas of the Netherlands, where the majority of nonnative Dutch people are living .
Nevertheless, the pregnancy outcome of all studied women still seems worse than the outcome of the general population. According to our study, ethnicity appears not to be involved in the development of this adverse outcome. Possibly, other factors play a pathophysiological role in this process and offer opportunities to improve this adverse outcome. Firstly, general awareness of the necessity of pregnancy planning in women with type 2 diabetes may be less than optimal in The Netherlands, since these women are generally seen in long-term community care and only referred to secondary care when already pregnant. Unfortunately, we were unable to report about the preconceptional care of the studied women, due to the retrospective nature of our study. Therefore, a prospective study about the effects of preconceptional care and pregnancy planning on pregnancy outcome in women with type 2 diabetes is needed. Secondly, postprandial spikes of the blood glucose levels contribute to a high-normal or a minimally elevated, but acceptable (42–53 mmol/mol), HbA1c level . Nowadays, there are novel technical options to improve the glycemic control, like continuous glucose monitoring and insulin pumps [1, 27]. Thirdly, several studies indicate that a low socioeconomic status (SES) is associated with adverse pregnancy outcomes [13, 28, 29]. Since the incidence of type 2 diabetes is the highest in populations with a low SES , an etiological role of this “risk factor” may be expected in the development of complications during pregnancy among women with pregestational type 2 diabetes. Unfortunately, SES was not sufficiently recorded in our retrospective study and SES should, therefore, be analyzed in future prospective studies.
Limitations of our study are the retrospective nature, the limited size of the total study population and of the different ethnic groups, and the possibility of selection bias. Only 272 pregnancies were studied from seven large hospitals covering a representative area in The Netherlands, but possibly not fully representative, since four centres are tertiary care centres and three are larger secondary care centres. This might have led to a selection bias, since patients with a poor obstetrical history are referred to tertiary centres.
In conclusion, this study has demonstrated that ethnicity seems not to be a major issue in the cause of pregnancy complications in women with pregestational type 2 diabetes with easy access to medical care. The results are still not approaching the pregnancy outcome of healthy, nondiabetic women. More prospective research is needed to validate these results and to pay more attention to possible causative factors like preconceptional care, avoiding postprandial spikes of the blood glucose and socio-economic status, in the development of adverse pregnancy outcome in women with pregestational type 2 diabetes.
Conflict of Interests
All the authors declare that they have no duality of interest associated with this paper.
The authors want to thank their research nurse Bianca Silvius, who revised the complete database.
- H. R. Murphy, G. Rayman, K. Lewis et al., “Effectiveness of continuous glucose monitoring in pregnant women with diabetes: randomised clinical trial,” British Medical Journal, vol. 337, article a1680, 2008.
- I. M. Evers, H. W. de Valk, and G. H. Visser, “Risk of complications of pregnancy in women with type 1 diabetes: nationwide prospective study in the Netherlands,” British Medical Journal, vol. 328, no. 7445, pp. 915–918, 2004.
- G. Hawthorne, S. Robson, E. A. Ryall, D. Sen, S. H. Roberts, and M. P. Ward Platt, “Prospective population based survey of outcome of pregnancy in diabetic women: results of the northern diabetic pregnancy audit, 1994,” British Medical Journal, vol. 315, no. 7103, pp. 279–281, 1997.
- D. M. Jensen, P. Damm, L. Moelsted-Pedersen et al., “Outcomes in type 1 diabetic pregnancies: a nationwide, population-based study,” Diabetes Care, vol. 27, no. 12, pp. 2819–2823, 2004.
- D. S. Feig and V. A. Palda, “Type 2 diabetes in pregnancy: a growing concern,” The Lancet, vol. 359, no. 9318, pp. 1690–1692, 2002.
- U. M. Schaefer-Graf, T. A. Buchanan, A. Xiang, G. Songster, M. Montoro, and S. L. Kjos, “Patterns of congenital anomalies and relationship to initial maternal fasting glucose levels in pregnancies complicated by type 2 and gestational diabetes,” The American Journal of Obstetrics and Gynecology, vol. 182, no. 2, pp. 313–320, 2000.
- T. D. Clausen, E. Mathiesen, P. Ekbom, E. Hellmuth, T. Mandrup-Poulsen, and P. Damm, “Poor pregnancy outcome in women with type 2 diabetes,” Diabetes Care, vol. 28, no. 2, pp. 323–328, 2005.
- M. Balsells, A. García-Patterson, I. Gich, and R. Corcoy, “Maternal and fetal outcome in women with type 2 versus type 1 diabetes mellitus: a systematic review and metaanalysis,” Journal of Clinical Endocrinology & Metabolism, vol. 94, no. 11, pp. 4284–4291, 2009.
- R. Bell, K. Bailey, T. Cresswell, G. Hawthorne, J. Critchley, and N. Lewis-Barned, “Trends in prevalence and outcomes of pregnancy in women with pre-existing type I and type II diabetes,” British Journal of Obstetrics and Gynaecology, vol. 115, no. 4, pp. 445–452, 2008.
- A. L. Rosenbloom, J. R. Joe, R. S. Young, and W. E. Winter, “Emerging epidemic of type 2 diabetes in youth,” Diabetes Care, vol. 22, no. 2, pp. 345–354, 1999.
- H. King and M. Rewers, “Global estimates for prevalence of diabetes mellitus and impaired glucose tolerance in adults. WHO Ad Hoc diabetes reporting group,” Diabetes Care, vol. 16, no. 1, pp. 157–177, 1993.
- A. Albertinelli, B. Knauth, K. Kraszewska, and D. Thorogood, “Migrants in Europe. A statistical portrait of the first and second generation,” 2011, http://epp.eurostat.ec.europa.eu/cache/ITY_OFFPUB/KS-31-10-539/EN/KS-31-10-539-EN.PDF.
- A. C. Ravelli, M. Tromp, M. Eskes et al., “Ethnic differences in stillbirth and early neonatal mortality in The Netherlands,” Journal of Epidemiology and Community Health, vol. 65, no. 8, pp. 696–701, 2011.
- T. Chaudhry, A. M. Ghani, T. H. Mehrali et al., “A comparison of foetal and labour outcomes in Caucasian and Afro-Caribbean women with diabetes in pregnancy,” International Journal of Clinical Practice, vol. 58, no. 10, pp. 932–936, 2004.
- F. P. Dunne, P. A. Brydon, M. Proffitt, T. Smith, H. Gee, and R. L. Holder, “Fetal and maternal outcomes in Indo-Asian compared to Caucasian women with diabetes in pregnancy,” Quarterly Journal of Medicine, vol. 93, no. 12, pp. 813–818, 2000.
- D. A. Davey and I. MacGillivray, “The classification and definition of the hypertensive disorders of pregnancy,” The American Journal of Obstetrics and Gynecology, vol. 158, no. 4, pp. 892–898, 1988.
- “Report of the national high blood pressure education program working group on high blood pressure in pregnancy,” The American Journal of Obstetrics and Gynecology, vol. 183, no. 1, pp. S1–S22, 2000.
- G. H. Visser, P. H. Eilers, P. M. Elferink-Stinkens, H. M. Merkus, and J. M. Wit, “New Dutch reference curves for birthweight by gestational age,” Early Human Development, vol. 85, no. 12, pp. 737–744, 2009.
- H. W. de Valk, N. H. van Nieuwaal, and G. H. Visser, “Pregnancy outcome in type 2 diabetes mellitus: a retrospective analysis from the Netherlands,” The Review of Diabetic Studies, vol. 3, no. 3, pp. 134–142, 2006.
- H. R. Murphy, S. A. Steel, J. M. Roland et al., “Obstetric and perinatal outcomes in pregnancies complicated by type1 and type2 diabetes: influences of glycaemic control, obesity and social disadvantage,” Diabetic Medicine, vol. 28, no. 9, pp. 1060–1067, 2011.
- R. Hughes and J. Rowan, “Perinatal outcomes and macrosomia in a multi-ethnic population of women with type 2 diabetes,” Australian and New Zealand Journal of Obstetrics and Gynaecology, vol. 46, no. 6, pp. 552–555, 2006.
- J. Ford, J. Grewal, R. Mikolajczyk, S. Meikle, and J. Zhang, “Primary cesarean delivery among parous women in the united states, 1990–2003,” Obstetrics and Gynecology, vol. 112, no. 6, pp. 1235–1241, 2008.
- D. Getahun, D. Strickland, J. M. Lawrence, M. J. Fassett, C. Koebnick, and S. J. Jacobsen, “Racial and ethnic disparities in the trends in primary cesarean delivery based on indications,” The American Journal of Obstetrics and Gynecology, vol. 201, pp. 422.e1–427.e1, 2009.
- Central Bureau of Statistics, Amsterdam, the Netherlandshttp://statline.cbs.nl/StatWeb/publication/?DM=SLNL&PA=37325&D1=a&D2=0&D3=0&D4=0&D5=0-4, 137, 152, 215, 232&D6=0, 4, 9, (l-1)-l&HDR=G2, G1, G3, T&STB=G4, G5&VW=T.
- “Compendium voor de leefomgeving,” 2011, http://www.compendiumvoordeleefomgeving.nl/indicatoren/nl2109-Allochtonen.html?i=15-12.
- American Diabetes Association, “Standards of medical care in diabetes—2012,” Diabetes Care, vol. 35, supplement 1, pp. S11–S63, 2012.
- S. G. Gabbe, E. Holing, P. Temple, and Z. A. Brown, “Benefits, risks, costs, and patient satisfaction associated with insulin pump therapy for the pregnancy complicated by type 1 diabetes mellitus,” The American Journal of Obstetrics and Gynecology, vol. 182, no. 6, pp. 1283–1291, 2000.
- V. S. Raleigh, D. Hussey, I. Seccombe, and K. Hallt, “Ethnic and social inequalities in women's experience of maternity care in England: results of a national survey,” Journal of the Royal Society of Medicine, vol. 103, no. 5, pp. 188–198, 2010.
- V. Flenady, P. Middleton, G. C. Smith et al., “Stillbirths: the way forward in high-income countries,” The Lancet, vol. 377, no. 9778, pp. 1703–1717, 2011.
- B. T. Smith, J. W. Lynch, C. S. Fox et al., “Life-course socioeconomic position and type 2 diabetes mellitus: the Framingham offspring study,” The American Journal of Epidemiology, vol. 173, no. 4, pp. 438–447, 2011.