Biometrics and BiosecurityView this Special Issue
Research Article | Open Access
A Classification Method of Normal and Overweight Females Based on Facial Features for Automated Medical Applications
Obesity and overweight have become serious public health problems worldwide. Obesity and abdominal obesity are associated with type 2 diabetes, cardiovascular diseases, and metabolic syndrome. In this paper, we first suggest a method of predicting normal and overweight females according to body mass index (BMI) based on facial features. A total of 688 subjects participated in this study. We obtained the area under the ROC curve (AUC) value of 0.861 and kappa value of 0.521 in Female: 21–40 (females aged 21–40 years) group, and AUC value of 0.76 and kappa value of 0.401 in Female: 41–60 (females aged 41–60 years) group. In two groups, we found many features showing statistical differences between normal and overweight subjects by using an independent two-sample t-test. We demonstrated that it is possible to predict BMI status using facial characteristics. Our results provide useful information for studies of obesity and facial characteristics, and may provide useful clues in the development of applications for alternative diagnosis of obesity in remote healthcare.
Obesity and overweight have become major health issues, because the prevalence of obesity has rapidly risen worldwide. The causes of this phenomenon are excessive ingestion of food, lack of physical activity, and environmental and genetic factors [1, 2]. Obesity and abdominal obesity are potential risk factors for insulin resistance and type 2 diabetes, cardiovascular diseases, stroke, ischemic heart disease, and metabolic syndrome [3–6], and many studies have investigated the relationship between obesity, disease, and body mass index (BMI) [7–13]. In the medical field and public health, BMI is commonly used as an indicator of overall adiposity. So, BMI is essential medical information for the prognostic prediction of diseases and clinical therapy. The principal cutoff points for underweight (<18.50 kg/m2), normal range (18.50–24.99 kg/m2), overweight or preobese (25.00–29.99 kg/m2), and obese (≥30.00 kg/m2) have been set by the World Health Organization (WHO).
A large number of studies on human face have focused on facial morphology, face recognition, and medicine [14–23]. Facial characteristics provide clinical information on the present or future health conditions of patients. For example, the status of cheeks, neck circumference, and craniofacial morphology are associated with health complications, such as type 2 diabetes, hypertension, and sleep apnea . Using computed tomographic (CT) scanning, Levine et al.  showed that the quantity of buccal fat is strongly related to visceral abdominal fat accumulation, based on the fact that patients with chubby facial cheeks tend to have upper-body obesity, and argued that plump cheeks of patients may be a high potential risk factor for metabolic complications related to obesity. Further, using facial measurements, Sadeghianrizi et al.  showed that craniofacial morphology is significantly different between normal and obese adolescents. They suggested that facial skeletal structures of obese adolescents tended to be relatively large, and that obesity was associated with bimaxillary prognathism.
The motivation for this study is conveyed by the following 2 questions: which features or facial characteristics are associated with overweight and normal BMI status? If we identify facial features that differ between normal and overweight, how accurately can we identify normal and overweight using these features? Contributions of this study are as follows. We first propose a method of classifying normal and overweight status using only facial characteristics. To date, no study has addressed a method that predicts BMI status using facial features. Furthermore, we introduce meaningful and discriminatory features that show a statistically significant difference between normal and overweight by statistical analysis, and identify compact and useful feature sets for BMI classification using facial features in female group. The results of this study will be useful in understanding the relationship between obesity-related diseases and facial characteristics.
2. Materials and Methods
2.1. Data Collection
A total of 688 subjects participated in this study. At the Korea Institute of Oriental Medicine, frontal and profile photographs of subjects’ faces with a neutral expression were acquired using a digital camera with a ruler (Nikon D700 with an 85 mm lens) and the subjects’ clinical information, such as name, age, gender, weight, height, blood pressure, and pulse were recorded. All images were captured at a resolution of pixels in JPEG format. Height and weight of subjects were measured by a digital scale (GL-150; G Tech International Co., Ltd, Republic of Korea).
Based on identifiable feature points from the front and profile images of subjects, a total of 86 features were extracted. The extracted features included distance between points and in a frontal (or profile) image, vertical distance between and in a frontal (or profile) image, angles of 3 points , , and in a frontal (or profile) image, area of the triangle formed by the 3 points , , and in a profile image, and so forth. All points in a front and profile image are showed in Figure 1, and all the extracted features and brief descriptions are given in Table 1.
2.2. Normal and Overweight Cutoff Points
BMI was calculated as weight (kg) divided by the square of height (m) of the individual. Health consequences and BMI ranges of overweight and obesity are open to dispute [10, 24]. There is natural consequence. Physiological and environmental factors of race are associated with differences in BMI values and the assignment of BMI values for obesity and overweight depends on various factors, such as ethnic groups, national economic statuses, and rural/urban residence . For instance, BMI values of a population in an Asian region tend to be lower than those of a population in a Western region; however, Asians have risk factors for cardiovascular disease and obesity-related diabetes at relatively low BMI values [11, 25]. In this study, we followed the suggestions of WHO to assign the cutoff point for each class in the Asia-Pacific region . The proposed categories are as follows: normal, 18.5–22.9 kg/m2; overweight, ≥23 kg/m2.
Since the facial features and BMI are influenced by gender and age , participants were divided into 2 groups: female; 21–40 (females aged 21–40 years) and female: 41–60 (females aged 41–60 years). Detailed data and basic statistics of each group are presented in Table 2.
For the selection of useful and discriminatory features, only features presenting -values < 0.05 in each group by an independent two-sample t-test were used in this study. In other words, only features with a value < 0.05 were included in classification experiments. Thus, features used in each group are different due to the difference of age. A detailed analysis of the statistical data and the selected features is presented in Section 3.2.
2.3. Preprocessing and Experiment Configurations
In the preprocessing step, the experiment was performed in 2 ways: (1) only the normalization method (scale 0~1 value) was applied to raw datasets, and (2) normalization and discretization were applied for better classification accuracy. We used the entropy-based multi-interval discretization (MDL) method introduced by Fayyad and Irani . For classification performance evaluation, we used the area under the curve (AUC) and kappa as major evaluation criteria. Additionally, sensitivity, 1-specificity, precision, F-measure, and accuracy were used for detailed performance analysis. All the results were based on 10-fold cross-validation method for a statistical evaluation of learning algorithm. All experiments were conducted by Naive Bayes classifier in WEKA software , and statistical analyses were conducted by SPSS version 19 for Windows (SPSS Inc., Chicago, IL, USA).
3. Results and Discussion
3.1. Performance Evaluation
For brief summarization of performance evaluation, the AUC and kappa for the 2 groups with and without the use of MDL method (i.e., 2 ways of preprocessing) are depicted in Figure 2.
AUC values of the method using MDL in 2 female groups ranged from 0.760 to 0.861, whereas AUC of the method without the use of MDL ranged from 0.730 to 0.771. AUC and kappa values of the method using MDL showed improvements of 0.09 and 0.115, respectively, in the female 21–40 group, and 0.03 and 0.073, respectively, in female: 41–60.
Comparing AUC and kappa values, the classification performance of the method with MDL was higher than that of the method without MDL. These results showed that the BMI classification method of applying MDL was significantly better than that of not applying MDL.
The identification of normal and overweight in female: 41–60 group was more difficult than that of normal and overweight in female: 21–40 group. The exact reason behind this phenomenon is unknown, but obesity and menopause-related research studies offer some clues [29–31]. Menopause leads to changes in fat tissue distribution, body composition, waist-to-hip ratio (WHR), and waist-to-height (W/Ht) in females. For instance, Douchi et al.  demonstrated that the lean mass of the head of premenopausal and postmenopausal females were not different, while trunk and legs were altered following menopause. Detailed results of the performance evaluation of each class and group are described in Tables 3 and 4. We think that these results imply the possibility of predicting normal and overweight status using human face information.
3.2. Statistical Analysis of Facial Features
Statistical analysis of the comparison between normal and overweight classes was performed using an independent two-sample t-test, and a -value < 0.05 was considered statistically significant. Features with a -value < 0.05 in each group are described in Tables 5 and 6.
In female: 21–40, 42 features were significantly different between normal and overweight classes (), and 11 of these features exhibited highly significant differences (). Four features concerning distances between and points in a frontal image (FD43_143, FD53_153, FD94_194, and FDH33_133 related to the mandibular width or face width) exhibited particularly significant differences. The features FA18_17_43 and FA118_117_143 representing the angles between three points (medial canthus), (midpoint of the upper eyelid), and (mandibular ramus) in a frontal image were highly significantly different. Comparing female: 21–40 and female: 41–60 groups, many features related to the eyelid were found in female: 21–40, but the features were not found in Female: 41–60. For instance, EUL_R_DH (horizontal distance from er1 to er7 in the eye image) was highly significantly different between the normal and overweight classes. The means of EUL_R_DH in normal and overweight status were 3.188 (0.226) and 3.322 (0.241) (, ). In female: 41–60, a total of 21 features were significantly different between the normal and overweight classes, and 8 of these features were highly significantly different (FD43_143, FD53_153, FD94_194, FDH33_133, FA118_125_143, FR06_psu, FR08_psu, and FArea03; ).
Many features that were significantly different between the normal and overweight classes in particular age group were identified. 25 features such as EUL_R_St, FD117_126, Fh_Cur_Max_Distan, FDH12_14, EUL_R_DH, and EUL_R_Khmean were found only in the female: 21–40 group, while the features FD17_25, FA117_125_143, FDV12_14, FDH14_21, and Nose_Angle_14_21 were only found in female: 41–60.
3.3. Medical Applications and Limitations
Patients or potential patients with obesity-related diseases must constantly check their own BMI based on their weight. Measurements using calibrated scales and ruler are ideal, but may not always be possible in the critically ill  and in telemedicine or emergency medical services in real time in remote locations. Our method was designed under the prerequisite that above method cannot be used in situations such as elderly trauma or intensive care in emergency medicine, remote healthcare, and so forth.
Several studies have been performed on patient BMI and weight estimation in emergency medical service and telemedicine [32–35]. These are important to enable accurate drug dosage, counter shock voltage calculation, or treatment, particularly in situations of serious illness, such as elderly trauma or intensive care [33, 34]. On the one hand, most patients are not aware of their body weight because the body weight of many individuals changes over time. For example, although patient self-estimates of weight are better than estimates by residents and nurses in emergency departments, 22% of patients do not estimate their own weight within 5 kg . The method described herein can provide clues to the development of alternative methods for BMI estimation in the above situations or telemedicine, and the development of medical fields because facial characteristics provide substantial clinical information on the present or future health conditions of patients [18, 19].
The relationship between obesity, diseases, and face that are associated with health complications has been researched for a long time. Here, we have proposed and demonstrated the possibility of identifying normal and overweight status using only facial characteristics, and found statistically significant differences between the 2 classes in 2 female groups. Although there are still problems to be solved for the complete classification of BMI status, this method would provide basic information and benefits to studies in face recognition, obesity, facial morphology, medical science, telemedicine, and emergency medicine.
This work was supported in part by National Research Foundation of Korea (NRF) Grant funded by the Korea Government (MEST) (20110027738).
- O. H. James and J. C. Peters, “Environmental contributions to the obesity epidemic,” Science, vol. 280, no. 5368, pp. 1371–1374, 1998.
- A. G. Comuzzie and D. B. Allison, “The search for human obesity genes,” Science, vol. 280, no. 5368, pp. 1374–1377, 1998.
- J. P. Després and I. Lemieux, “Abdominal obesity and metabolic syndrome,” Nature, vol. 444, no. 7121, pp. 881–887, 2006.
- H. Hirose, T. Takayama, S. Hozawa, T. Hibi, and I. Saito, “Prediction of metabolic syndrome using artificial neural network system based on clinical data including insulin resistance index and serum adiponectin,” Computers in Biology and Medicine, vol. 41, no. 11, pp. 1051–1056, 2011.
- L. L. Yan, M. L. Daviglus, K. Liu et al., “BMI and health-related quality of life in adults 65 years and older,” Obesity Research, vol. 12, no. 1, pp. 69–76, 2004.
- C. Ni Mhurchu, A. Rodgers, W. H. Pan et al., “Body mass index and cardiovascular disease in the Asia-Pacific Region: an overview of 33 cohorts involving 310 000 participants,” International Journal of Epidemiology, vol. 33, no. 4, pp. 751–758, 2004.
- T. Haas, S. Svacina, J. Pav, R. Hovorka, P. Sucharda, and J. Sonka, “Risk calculation of type 2 diabetes,” Computer Methods and Programs in Biomedicine, vol. 41, no. 3-4, pp. 297–303, 1994.
- C. M. Y. Lee, S. Colagiuri, M. Ezzati, and M. Woodward, “The burden of cardiovascular disease associated with high body mass index in the Asia-Pacific region,” Obesity Reviews, vol. 12, no. 501, pp. e454–e459, 2011.
- L. Li, A. P. De Moira, and C. Power, “Predicting cardiovascular disease risk factors in midadulthood from childhood body mass index: utility of different cutoffs for childhood body mass index,” American Journal of Clinical Nutrition, vol. 93, no. 6, pp. 1204–1211, 2011.
- E. Anuurad, K. Shiwaku, A. Nogi et al., “The new BMI criteria for Asians by the regional office for the Western Pacific region of WHO are suitable for screening of overweight to prevent metabolic syndrome in elder japanese workers,” Journal of Occupational Health, vol. 45, no. 6, pp. 335–343, 2003.
- S. P. Hye, S. Y. Yeong, Y. P. Jung, S. K. Young, and M. C. Joong, “Obesity, abdominal obesity, and clustering of cardiovascular risk factors in South Korea,” Asia Pacific Journal of Clinical Nutrition, vol. 12, no. 4, pp. 411–418, 2003.
- J. Y. Kim, H. M. Chang, J. J. Cho, S. H. Yoo, and S. Y. Kim, “Relationship between obesity and depression in the Korean working population,” Journal of Korean Medical Science, vol. 25, no. 11, pp. 1560–1567, 2010.
- H. Fonseca, A. M. Silva, M. G. Matos et al., “Validity of BMI based on self-reported weight and height in adolescents,” Acta Paediatrica, International Journal of Paediatrics, vol. 99, no. 1, pp. 83–88, 2010.
- K. Sobottka and I. Pitas, “A novel method for automatic face segmentation, facial feature extraction and tracking,” Signal Processing: Image Communication, vol. 12, no. 3, pp. 263–281, 1998.
- Y. Wang, C. S. Chua, and Y. K. Ho, “Facial feature detection and face recognition from 2D and 3D images,” Pattern Recognition Letters, vol. 23, no. 10, pp. 1191–1202, 2002.
- C. L. Huang and Y. M. Huang, “Facial Expression Recognition Using Model-Based Feature Extraction and Action Parameters Classification,” Journal of Visual Communication and Image Representation, vol. 8, no. 3, pp. 278–290, 1997.
- M. H. Yang, D. J. Kriegman, and N. Ahuja, “Detecting faces in images: a survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 34–58, 2002.
- E. N. Reither, R. M. Hauser, and K. C. Swallen, “Predicting adult health and mortality from adolescent facial characteristics in yearbook photographs,” Demography, vol. 46, no. 1, pp. 27–41, 2009.
- J. A. Levine, A. Ray, and M. D. Jensen, “Relation between chubby cheeks and visceral fat,” New England Journal of Medicine, vol. 339, no. 26, pp. 1946–1947, 1998.
- A. Sadeghianrizi, C. M. Forsberg, C. Marcus, and G. Dahllöf, “Craniofacial development in obese adolescents,” European Journal of Orthodontics, vol. 27, no. 6, pp. 550–555, 2005.
- C. Frowd, C. Lee, A. Petkovic, K. Nawaz, and Y. Bashir, “Further automating and refining the construction and recognition of facial composite images,” International Journal of Bio-Science and Bio-Technology, vol. 1, no. 1, pp. 59–74, 2009.
- C. D. Frowd, S. Ramsay, and P. J. B. Hancock, “The influence of holistic interviewing on hair perception for the production of facial composites,” International Journal of Bio-Science and Bio-Technology, vol. 3, no. 3, pp. 55–64, 2011.
- M. Soltane, N. Doghmane, and N. Guersi, “Face and speech based multi-modal biometric authentication,” International Journal of Advanced Science and Technology, vol. 21, no. 6, pp. 41–56, 2010.
- World Health Organisation, International Association for the Study of Obesity, International Obesity TaskForce, and The Asia-Pacific Perspective, “Redefining obesity and its treatment,” Health Communications, Sydney, Australia, 2000.
- C. Barba, T. Cavalli-Sforza, J. Cutter et al., “Appropriate body-mass index for Asian populations and its implications for policy and intervention strategies,” Lancet, vol. 363, no. 9403, pp. 157–163, 2004.
- D. D. Pham, J. H. Do, B. Ku, H. J. Lee, H. Kim, and J. Y. Kim, “Body mass index and facial cues in Sasang typology for young and elderly persons,” Evidence-Based Complementary and Alternative Medicine, vol. 2011, Article ID 749209, 9 pages, 2011.
- U. M. Fayyad and K. B. Irani, “Multi-interval discretization of continuous-valued attributes for classification learning,” in Proceedings of the 13th International Joint Conference on Uncertainty in Artificial Intelligence, vol. 2, pp. 1022–1027, 1993.
- M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, “The WEKA data mining software: an update,” SIGKDD Explorations, vol. 11, pp. 10–18, 2009.
- T. Douchi, S. Yamamoto, S. Nakamura et al., “The effect of menopause on regional and total body lean mass,” Maturitas, vol. 29, no. 3, pp. 247–252, 1998.
- M. Skrzypczak and A. Szwed, “Assessment of the body mass index and selected physiological parameters in pre- and post-menopausal women,” HOMO- Journal of Comparative Human Biology, vol. 56, no. 2, pp. 141–152, 2005.
- Q. Wang, C. Hassager, P. Ravn, S. Wang, and C. Christiansen, “Total and regional body-composition changes in early postmenopausal women: age-related or menopause-related?” American Journal of Clinical Nutrition, vol. 60, no. 6, pp. 843–848, 1994.
- D. Krieser, K. Nguyen, D. Kerr, D. Jolley, M. Clooney, and A. M. Kelly, “Parental weight estimation of their child's weight is more accurate than other weight estimation methods for determining children's weight in an emergency department?” Emergency Medicine Journal, vol. 24, no. 11, pp. 756–759, 2007.
- T. R. Coe, M. Halkes, K. Houghton, and D. Jefferson, “The accuracy of visual estimation of weight and height in pre-operative supine patients,” Anaesthesia, vol. 54, no. 6, pp. 582–586, 1999.
- W. L. Hall, G. L. Larkin, M. J. Trujillo, J. L. Hinds, and K. A. Delaney, “Errors in weight estimation in the emergency department: comparing performance by providers and patients,” Journal of Emergency Medicine, vol. 27, no. 3, pp. 219–224, 2004.
- S. Menon and A. M. Kelly, “How accurate is weight estimation in the emergency department?” Emergency Medicine Australasia, vol. 17, no. 2, pp. 113–116, 2005.
Copyright © 2012 Bum Ju Lee et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.