Abstract

The present study investigates the prediction of increased blood pressure by body mass index (BMI), waist (WC) and hip circumference (HC), and waist hip ratio (WHR) using a machine learning technique named classification tree. Data were collected from 400 college students (56.3% women) from 16 to 63 years old. Fifteen trees were calculated in the training group for each sex, using different numbers and combinations of predictors. The result shows that for women BMI, WC, and WHR are the combination that produces the best prediction, since it has the lowest deviance (87.42), misclassification (.19), and the higher pseudo (.43). This model presented a sensitivity of 80.86% and specificity of 81.22% in the training set and, respectively, 45.65% and 65.15% in the test sample. For men BMI, WC, HC, and WHC showed the best prediction with the lowest deviance (57.25), misclassification (.16), and the higher pseudo (.46). This model had a sensitivity of 72% and specificity of 86.25% in the training set and, respectively, 58.38% and 69.70% in the test set. Finally, the result from the classification tree analysis was compared with traditional logistic regression, indicating that the former outperformed the latter in terms of predictive power.

1. Introduction

Obesity (body mass index > 29.9 kg/m2) has been considered a global public health problem due to its high prevalence and high morbidity [1]. In fact, the prevalence of obesity has increased substantially, both in developed and in under development countries. In the United States, for example, it is estimated that 35.5% of women and 32.2% of adult men present obesity [2]. The Brazilian Institute of Geography and Statistics (IBGE) indicates that 50.1% of men and 48% of women have overweight (25 kg/m2 ≤ BMI < 29.9 kg/m2), while 12.4% of men and 16.9% of women are suffering from obesity in Brazil [3].

The high risk attributed to obesity is related particularly to its association with increased risk factors for cardiovascular disease, notably hypertension [4, 5]. In order to adopt early preventive/therapeutic actions to minimize the risk of cardiovascular events in obese individuals, methods that can predict hypertension using low cost procedures are necessary, especially in underdeveloped and in developing countries.

Body mass index (BMI), waist circumference (WC), hip circumference (HC), and waist-hip ratio (WHR) are among the most practical and cost effective measures for evaluation of obesity, with the advantage that both WC and WHR present positive correlations with the amount of visceral fat, and together effectively predict cardiovascular risk [6, 7]. Furthermore, these anthropometric measures are predictors of metabolic factors and multiple health risks [8, 9]. Yong et al. [9] used the ROC curve analysis to verify the predictive power of WC, WHR, and BMI on blood pressure in 722 Chinese adults. WC presented a cutoff of 89.05 cm for men (sensibility = 70%, specificity = 42%, ) and 90.90 cm for women (sensibility = 60%, specificity = 67%, ). Waist-hip ratio was not a significant predictor for men () or women (), with a cutoff of 0.92 cm for the first (sensibility = 67%, specificity = 54%) and 0.85 cm for the second (sensibility = 83%, specificity = 40%). Finally, BMI presented a cutoff of 23 kg/m2 for men (sensibility = 76%, specificity = 49%, ) and 23.3 kg/m2 for women (sensibility = 75%, specificity = 59%, ). Although less employed in the study of health conditions related to obesity, hip circumference is pointed as a variable that can increase the predictive power of the other anthropometric variables and should be included in the obesity studies [10]. It seems that the combination of multiple anthropometric variables increases the sensibility of the prediction [11, 12].

From the usual methods employed to study the relationship between anthropometric variables and obesity, the receiver-operating characteristic (ROC) curve analysis is the technique used to provide and to verify the quality of the cutoff points. This statistical method is highly recommended in epidemiological studies [13] because it can describe the accuracy of a variable to classify people into relevant clinical groups. However, the ROC curve methodology is not an informative technique to evaluate the contribution of an additional variable to the model [14]. The use of the ROC curve analysis became limited to investigate incremental validity, that is, the improvement in the prediction or in the amount of variance explained when an additional variable enters the model. Thus, in order to discover the strength of any combination of WC, HC, and WHR to predict hypertension, it is necessary to employ a statistical method that can provide sensitive information about incremental validity.

Health researches could benefit from employing machine learning techniques to verify the combination of variables that best predict a given outcome, as well as to verify their cutoff values. Machine learning is a relatively new science field focused on the construction and study of systems that can automatically learn from data [14], generating high accurate predictive models. Although incipient, machine learning methods are already in use in the health literature, as in the sustained weight loss study [15], in the evaluation of program cost effectiveness [16], in the obesity prediction [17], in the classification of prostate cancer levels [18], and in the classification of electronic patient records [19]. In 2013, The Microsoft Research Machine Learning Summit presented new applications of the machine learning techniques in health science, including applications to analyze clinical [20], genetic [21], and medical image data [22].

Among the techniques of machine learning, the classification and regression tree (CART) is of special interest for health studies, since it is useful: (1) to discover which variable, or combination of variables, better predicts a given outcome (e.g., presence of increased blood pressure,) and (2) to identify the cutoff values for each variable that maximally predicts the chosen outcome.

CART is a type of supervised learning technique [14] for recursively partitioning a feature space into several parts (or nodes), based on the relationship between an outcome variable and one or more predictors. The recursive binary partition is used to achieve a solution that divide the feature space into more pure nodes, that is, into a classification with the highest amount of cases with the same condition (e.g., hypertension). In sum, CART works as follows: (1) iteratively split variables into groups; (2) split the data where it is maximally predictive and (3) maximize the amount of homogeneity in each group [23].

Two main indexes, misclassification and deviance, can be used to indicate the quality of the prediction. Hastie et al. [14] explain how both work: In a node m, representing region , with observations, let the proportion of class observations in node . We classify the observations in node to class , the majority class in node . Different measures of node impurity () include the following:

Misclassification error: .

Cross entropy or deviance: (p. 309).

Misclassification is the index indicating the total amount of wrong predictions made or its rate (number of wrong predictions/total number of cases). Deviance is an index that is sensible to both the misclassification and the purity of the feature space partitions. As pointed by Hastie et al. [14] and by Golino et al. deviance is a better index to compare different models than misclassification, since it is more sensitive to node purity.

The present study has as the main goal to introduce and to apply the machine learning technique named classification and regression tree (CART) in the context of increased blood pressure. The machine learning field is a set of innovative techniques that provides state-of-the-art predictions in terms of accuracy. CART is becoming popular in different science fields since its interpretability is straightforward; the result of the prediction is easily understandable by experts of the field; it is applicable to a wide range of problems, can use any kind of variable as predictor, is a nonparametric technique, and is sensible to the impact of additional variables in the predictive model. Through the application of the CART analysis we expect to contribute with future studies focusing on the prediction of increased blood pressure by any kind of variable (e.g., genes, daily life habits, biomarkers, etc.). Additionally, we are going to compare the results from the CART analysis with traditional logistic regression analysis, in terms of strength of the prediction (pseudo- and AUC). In the present study we will analyze which variable, or combination of variables (BMI, WC, HC, and WHR), better predicts increased blood pressure (prehypertension or hypertension) and which cutoff values are maximally predictive of it. Fifteen models, or trees, with different number and combination of predictors will be compared for each sex, in a training sample. Then, the best tree will be tested in a testing sample for cross validation.

2. Materials and Methods

2.1. Sample and Measures

The data was collected in a convenience sample composed of 400 undergraduate students (56.3% women) aged between 16 and 63 years old (mean = 23.14 and standard deviation = 6.03), from a private university of Vitória da Conquista, Bahia, Brazil. All participants signed an informed consent agreeing to participate in the research. Weight was measured using a digital scale (Model B530, Plebal Plenna Ltda., SP, Brazil), to the closest 0.1 Kg. Height was measured using a stiff tape placed vertically on a flat wall, on subjects standing erect and head in the Frankfurt plane [24]. BMI was calculated using these measurements. WC was measured at the midpoint between the lower border of the rib cage and the iliac crest, and HC was measured at the greater gluteal curvature, both using a 1.5 meters’ tape (ISP Eletromédica, Brazil), and recorded to the closest 0.1 cm. Blood pressure was measured using a manually inflatable blood pressure monitor (HEM-403INT, Omron Healthcare, Japan). All anthropometric measurements were repeated three times (the mean value was used in the data analysis) and were taken by previously trained research assistants.

2.2. Data Analysis

The systolic blood pressure was assessed and the subjects with increased blood pressure were identified. The data were first split into two subsets, one for each sex. Then, each subset was randomly split into two sets (training and testing) with almost the same number of people for cross-validation. The dataset is freely available in a web repository for reproducible purposes [25, 26]: (1) women’s dataset can be downloaded at http://dx.doi.org/10.6084/m9.figshare.845664; (2) men’s dataset can be downloaded at http://dx.doi.org/10.6084/m9.figshare.845665. All analyses were made using the tree package [27] from the R software. In the current study the tree classification procedure was fitted by binary recursive partitioning using as outcome the presence of increased blood pressure: at least prehypertension (systolic blood pressure > 120.0 mmHg) for women and hypertension (systolic blood pressure > 140.0 mmHg) for men. We are not investigating systolic hypertension in the weman sample because only 8% of them presented a systolic blood pressure equal to or greater than 140 mmHg. When the prevalence of one category of the outcome variable is very low, the classification tree fits a model that only predicts more abundant category. This problem is typical of the machine learning methods, which suffer in the presence of unbalanced datasets [28]. Geurts et al. [28] suggest to undersample the majority class in order to solve the problem, but we decided not to follow their advice, since our dataset contains only 18 women with systolic hypertension. To balance the data, by undersampling the majority class (no systolic hypertension), we would have created another issue: a very low sample size that would preclude the cross-validation. So, we decided to investigate prehypertension in the women sample, since 42% of them presented systolic blood pressure greater than 120 mmHg. The predictive variables included in the models were BMI, WC, HC, and WHR.

Fifteen random trees were calculated (grown) from the training set for each sex, in order to identify which variables, or which combination of variables, were suitable to predict the presence of increased blood pressure. Each random tree had one or more predictors, as can be seen in Table 2. The quality of each model or tree was verified using the misclassification error rate and deviance. A pseudo was calculated for each model, using the following formulae: where SSY represents the response sum of squares.

All the ethical principles contained in the Declaration of Helsinki were followed in the current study, as well as all the Brazilian specific laws.

3. Results and Discussion

None of the variables employed in the current study presented a normal distribution, as pointed by the Shapiro-Wilk’s test of normality (see Table 1). Men presented a higher value of systolic blood pressure (median = 130 mmHg), BMI (median = 24 kg/m2), WC (median = 84 cm), HC (median = 103 cm), and WHR (median = 0.83) than women. The latter showed the following medians: a SBP of 117 mmHg, a BMI of 22 kg/m2, a WC of 76 cm, a HC of 100 cm, and a WHR of 0.76.

Systolic blood pressure presented a moderate correlation with all the anthropometric variables. Only 10.89% of SBP’s variance was explained by BMI, 12.25% was explained by WC, 6.25% by HC, and 9.61% by WHR. Increased blood pressure was found in 42% of women (SBP > 120 mmHg) and in 47% of men (SBP > 140 mmHg). Table 2 shows the deviance, misclassification, and pseudo- for each of the fifteen models investigated in the training sample. Waist circumference alone was the worst predictor for the women sample (tree 2), since it presented a deviance of 149.30, a misclassification error rate of 0.40, and a pseudo- of only 0.03. Tree 13 presented the best model, with the lowest deviance (87.42), a misclassification error rate of 0.19, and a pseudo- of 0.43. Comparing the variables alone, body mass index was the best predictor, explaining 32% of the variance of increased systolic blood pressure for women, against only 3% for waist circumference and hip circumference and 9% of waist-hip ratio. When added to BMI as predictors, WC and HC worsen the prediction, decreasing the percentage of explained variance from 32% to 29% and the misclassification from 0.27 to 0.26 and increasing the deviance from 104.50 to 109.50 and 108.90, respectively. All combinations of three variables provided a better prediction than the variables alone or combined two by two. Tree 11, for example, had BMI, WC and HC as predictors of increased blood pressure and resulted in a better model then tree 1 (BMI alone), decreasing deviance from 104.50 to 94.24, misclassification from 0.26 to 0.22 and increasing the percentage of explained variance from 32% to 39%. So, WC and HC together with BMI have an incremental validity that adds 4% of explanation to the predictive model. However, the best model, represented by tree 13, showed that WC and WHR combined with BMI add 11% of variance explanation to the predictive model, compared to BMI alone (tree 1), decrease the percentage of misclassification from 26% to 19%, and decrease deviance from 104.50 to 87.42. So, WC and WHR have a considerable impact on the prediction of increased blood pressure in women when combined with BMI, presenting incremental validity over the latter.

Considering the men’s result, waist-hip ratio alone (tree 4) presented the worst prediction model, with deviance of 95.09, misclassification error rate of 0.29, and pseudo- of 0.11. Tree 15 presented the best model, with the lowest deviance (57.25), a misclassification error rate of 0.16, and a pseudo- of 0.46. Comparing the variables alone, body mass index was the best predictor, explaining 16% of the variance of increased systolic blood pressure for men, with a deviance of 89.35 and a misclassification of 0.26, a result slightly better than tree 3 in which HC alone explained the same amount of increased SBP’s variance with deviance of 89.59 and a misclassification of 0.26. When added to BMI as predictors, WC, HC, and WHR increase the percentage of variance explanation to 33%, 25%, and 25%, respectively, with deviance of 71.07, 80.17, and 79.90 and with misclassification error rate of 0.21, 0.25, and 0.23. All combinations of two variables lead to a better prediction than every variable alone. When added to BMI and WC, hip circumference worsens the prediction by decreasing the percentage of increased systolic blood pressure’s variance explanation from 33% (tree 5) to 32% (tree 11), increasing deviance from 71.07 to 72.66, and misclassification error rate from 0.21 to 0.23. However, when waist-hip ratio is added to BMI, WC, and HC as predictors, deviance, misclassification, and pseudo- are improved. If we compare tree 15 with tree 1 it is possible to argue that WC, HC, and WHR together present incremental validity in the prediction of increased systolic blood pressure in men, increasing 30% of its variance explanation, improving 10% of misclassification, and decreasing deviance from 89.35 to 57.25.

Figure 1 shows the tree that best predicts increased blood pressure for women (SBP > 120 mmHg) in the training sample. The predictors are distributed in several nodes and are always split in a specific cutoff value. The predictions made are at the bottom of the tree. For example, when BMI is smaller than 27.27 kg/m2 and WHR is smaller than .685 cm, the person is classified as having systolic pre-hypertension (classified as PRE). When BMI is higher than 27.27 kg/m2 and WHR is higher than 0.80, the person is also classified as having systolic pre-hypertension (classified as PRE). Averaging the percentage of women with increased blood pressure (or systolic pre-hypertension) classified as having pre-hypertension in each node results in a correct prediction of 80.86%; in other words this is the overall tree sensibility. In the same line of reasoning, averaging the percentage of women with regular blood pressure classified as having a regular pressure in each node results in a correct prediction of 81.22%; in other words this is the overall tree specificity. However, the cross-validation of tree 13 in women’s testing sample showed that the sensibility decreased to 45.65% and the specificity to 65.15%. The percentage of women with SBP greater than 120 mmHg in the training sample was 43.75% and in the testing sample was 41.07%.

Figure 2 shows the tree that best predicts increased blood pressure for men (SBP ≥ 140 mmHg) in the training sample. The interpretation of Figure 2 is the same as Figure 2. For example, when HC is higher than 110.5, WHR is higher than 0.865, and BMI is greater than 31.45, the person is classified as having systolic hypertension (HYPER). Actually, 67% of men with these characteristics have a systolic blood pressure greater than or equal to 140 mmHg. However, when HC is higher than 110.5, WHR is higher than 0.865, and BMI is smaller than 31.45, the person is classified as having regular systolic blood pressure (REGULAR). In fact, 80% of men with these characteristics have a systolic blood pressure lower than 140 mmHg. On one hand, averaging the percentage of men with increased blood pressure (or systolic hypertension) classified as having hypertension in each node results in a correct prediction of 72% (overall tree sensibility). On the other hand, averaging the percentage of men with regular blood pressure classified as having a regular pressure in each node results in a correct prediction of 86.25% (overall tree specificity). However, the cross-validation of tree 15 in men’s testing sample showed that the sensibility decreased to 52.38% and the specificity to 69.70%. The percentage of men with SBP greater than or equal to 140 mmHg in the training sample was 30% and in the testing sample was 24.13%.

Comparing the strength of the predictions made, it is clear that classification trees outperformed traditional logistic regression. The best predictive model for women generated using classification trees had a pseudo- of 0.43, with an overall tree sensibility of 80.86% and specificity of 81.22%, while the logistic model with higher pseudo- and AUC was the model 11, presenting 0.023 and 0.566, respectively (see Table 3). The best classification tree for men presented a pseudo- of 0.466 with an overall sensibility of 72% and specificity of 86.25%, while the logistic model with higher pseudo- and AUC was the model 12, presenting 0.13 and 0.68 respectively (see Table 4).

4. Conclusions

According to the Harvard Obesity Prevention Source [29], it is estimated that 500 million adults are obese and 1.5 billion are overweight or obese worldwide. Obesity is a public health problem that affects approximately 1.5 million people each year in Brazil [30] and is responsible for a huge amount of money, about U$ 240 million dollars in 2011 [31], to directly treat it or to treat several related diseases. This chronic noncommunicable disease had its prevalence increased in both developed and in development countries, affecting, for example, 35.5% of women and 32.2% of adult men in the USA [2] and 12.4% of men and 16.9% of women in Brazil [3]. At least three pathophysiological mechanisms are known to link obesity to increased blood pressure. The first one is related to visceral obesity, indicating that mesenteric and omental adipocytes are more active than the subcutaneous ones [32], contributing to endothelial dysfunction, which may contribute to increasing blood pressure in obese people. The other two mechanisms involve the sympathetic nervous system [33, 34] and the imbalance in the homeostasis of plasma sodium [3537] that are related to the extracellular volume increase and, thus, contribute to blood pressure elevation in people with obesity.

Anthropometric variables are among the most practical and low-cost obesity diagnostic methods [38], regarding their limitations and issues [38, 39]. World Health Organization 2008’s report [40] points that body mass index, waist circumference, and waist-hip ratio are related to risk of cardiovascular diseases, hypertension, overall mortality, and other health problems. The same report points that additional information can be provided by hip circumference in the diagnosis of obesity, since it is related to gluteofemoral muscle mass and bone structure. Previous studies have pointed to the cutoff values of the anthropometric variables that are related to blood pressure [9, 41]. The cut-off values are different across ethnicities [40, 42], samples, age, and risk factors investigated [43]. All the studies quoted above employed traditional data analysis procedures, such as linear or logistic regression and the ROC curve analysis to verify the predictive role for each variable and to discover the best cutoff values for them. The use of null-hypothesis significance testing ( value) requires caution to verify which variables better predict obesity. A smaller does not indicate a stronger relationship between independent and dependent variables, and statistical significance does not indicate practical importance [44]. The ROC curve analysis is highly recommended in epidemiological studies [45] because it can describe the accuracy of a variable to classify people into relevant clinical groups. However, the ROC curve methodology is not an informative technique to evaluate the contribution of an additional variable to the model [14], being limited to investigate the improvement in the prediction or in the amount of variance explained when an additional variable enters the model (incremental validity). In order to identify the role of BMI, WC, WHR, and HC together in the prediction of increased blood pressure it is necessary to employ a statistical method that can provide sensitive information about incremental validity.

A conjoint of techniques that can provide sensitive information about incremental validity is the classification and regression tree (CART) of the machine learning field. The CART techniques are of special interest for health studies to discover which variable, or combination of variables, better predicts a given outcome (e.g., presence of increased blood pressure) and to identify the cutoff values for each variable that maximally predicts the chosen outcome. Health studies have been employing machine learning methods in different applications that go from sustained weight loss investigation [46], obesity prediction [17], to genetic [21] and medical image data analysis [22].

In the current study, classification tree models were used to verify which combination of BMI, WC, WHR, and HC best predicted increased blood pressure for women and men. The best model for women showed that adding WC and WHR to BMI increased 11% of the variance explanation in the predictive model, decreased the percentage of misclassification from 26% to 19%, and decreased deviance from 104.50 to 87.42. As pointed before, WC and WHR have a considerable impact on the prediction of increased blood pressure in women when combined with BMI. The overall sensibility for the best model (tree no. 13) was 80.86% and the overall specificity was 81.22%. The complex model represented by tree 13 (see Figure 1) exceeded the sensitivity and specificity found in previous studies. Yong et al. [9] found sensibility and specificity of 60% and 67% for WC, 83% and 40% for WHR, and 75% and 59% for BMI in the women sample. A Brazilian study investigating the predictive role of BMI in hypertension in 1,298 people (52.5% of women) found an area under the ROC curve of 0.69 (95% C.I.: 0.64–0.74) for women [47].

The best model for men showed that WC, HC, WHR, and BMI together presented an incremental validity over BMI alone in the prediction of hypertension, increasing 30% of the variance explanation, improving 10% of misclassification, and decreasing deviance from 89.35 to 57.25. The overall sensibility and specificity for the best model (tree no. 15) was 72% and 86.25%. As happened with the women result, the complex model represented by tree 15 (see Figure 2) exceeded the sensitivity and specificity found in previous studies. Furthermore, compared to traditional logistic regression analysis, the classification trees produced a much better prediction, with higher pseudo-, sensibility, and specificity for both men and women.

In spite of the high sensibility and specificity of the best models for both men and women in the training sample, the cross validation applied in the test sample revealed a different scenario. The cross-validation of tree 13 in women’s testing sample showed that the sensibility decreased to 45.65% and the specificity to 65.15%, and the cross-validation of tree 15 in the men’s testing sample showed that sensibility decreased to 52.38% and the specificity decreased to 69.70%. The observed difference in sensibility and specificity between the modeled training set and the cross-validation in the test set is known in the machine learning literature as the variance issue [28]. It means that the algorithm learned too much from the observed data and is likely to make more errors in a different data set. So, we need to interpret the present result and the best model for both men and women with caution. The variance issue that emerged from our study can also emerge in studies using more traditional statistical methods, such as the ROC curve analysis. It is important to make subset of the sample gathered in order to apply cross-validation. The result found by Abolfotouh and colleagues [8], or by every other investigation made that did not use a cross-validation procedure, may be susceptible of the variance issue. However, overfitting is more usual in the machine learning techniques than in the traditional ones. In order to overcome overfitting in the classification and regression tree’s method, a bootstrap procedure named Random Forests [48] can be applied. It bootstraps samples and variables, grows multiple trees, enables greater accuracy, and avoids overfitting, being one of the best procedures for dealing with the variance issue [28]. Finally, we must address the limitations of the current study. Firstly, it did not employ a representative sample randomly chosen, relying on a convenience sample. It makes our inferences limited. Secondly, the number of women with hypertension was very low, obligating us to analyze increased blood pressure in them and hypertension in men, which compromised the comparison of the findings between sexes. Those issues should be solved in future researches. Finally, our results cannot be generalized to other ethnics, but the methodology adopted in the current paper could be used in data gathered in different countries to construct new predictive models of increased blood pressure.

Using machine learning techniques to discover new relations in data, to verify incremental validity of additional predictors, and to make accurate predictions for new data sets may help the health scientists to find new robust diagnostic parameters. The clinical usefulness of the present study relies on the possibility of using new algorithms to classify and predict increased blood pressure, with higher accuracy than usual cutoff points. Although most of the clinicians can measure both blood pressure and the anthropometric variables simultaneously, there are several parts of the world, such as many countries from Africa or several places in Latin America, where material resources are scarce. So, the application of complex algorithms, as the presented one in the current paper, can be a help for those professionals that can rely only on very simple and cheap instruments, such as a measure tape. Furthermore, the present study applied a new method for prediction of health outcomes, which in spite of being incipient in the literature, can provide new insights and discoveries since it outperforms traditional techniques (such as logistic and linear regression), making possible to compare the impact of new variables on the prediction of the chosen outcome (incremental validity). Traditional techniques are based on several assumptions, as the normality of the distribution, linear relationship between independent and dependent variables, homoscedasticity, and so on. The Machine learning techniques can handle any kind of variable (ordinal, continuous, dichotomous, and nominal), with no assumption about distribution, linearity, or homoscedasticity. Moreover, it can be used to extract useful information and to discover new relations in very huge data sets provided by some international databases, such as the World Health Organization Global database on noncommunicable diseases (see http://www.who.int/gho/ncd/en/index.html) [49]. As quoted in the introduction, the data deluge can transform the society, and machine learning will play a pivotal role in it. Future researches should overcome the limitations of the present study by employing a larger and representative sample, by using strategies to minimize the variance issue, especially the Random Forest [48] approach.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

The authors are thankful for the grant received by the Fundação de Amparo à Pesquisa do Estado da Bahia (FAPESB) and for the financial support of the Faculdade Independente do Nordeste.