Abstract

Background. Multiple weight loss failures among obese patients suggest the design of new therapeutic strategies. We investigated the role of 2-week course of enteral treatment with a very low-calorie protein-based formula in the management of severe obesity. Methods. We evaluated the feasibility, safety, and efficacy of 2-week continuous administration of a protein-based formula (1.2 g/kg of ideal body weight/day) by nasogastric tube in severely obese adults (body mass index (BMI) ≥ 40 kg/m2). Results. In total, 364 patients (59% women; BMI =  kg/m2) were recruited. The intervention was discontinued within 48 hours in 26 patients, due to nasogastric tube intolerance. No serious adverse events occurred. During the first and the second week, 65% and 80% patients, respectively, reported no side effects. All biochemical safety parameters were affected by the intervention, particularly uric acid (+45%) and aminotransferases (+48%). In the other cases the change was negligible. We observed significant weight loss (%) and improvement in blood pressure and glucose and lipid metabolism parameters (). Conclusions. A 2-week course of enteral treatment with a very low-calorie protein-based formula appeared a feasible, likely safe, and efficacious therapeutic option to be considered for inclusion into a composite weight loss program for the management of severe obesity. This trial is registered with ClinicalTrials.gov Identifier: NCT01965990.

1. Introduction

Excess body weight, from overweight to overt obesity, is associated with adverse health outcomes [1]. In view of the time-trends of the obesity epidemic [2] and the related cost burden [3], the search for effective strategies for weight reduction and long-term maintenance of weight loss (WL) is at the top of the agenda of public health systems.

The current first-line strategy includes several treatment options and dietary interventions to be implemented together with an exercise program [4]. Unfortunately, compliance with intervention in the long-term is difficult. It is not infrequent to observe people following one diet after another and experiencing multiple failures which, in turn, lead to higher body weight and adverse consequences on body composition and fat distribution [5]. The higher the number of attempts, the more difficult the adherence to further interventions. The use of antiobesity drugs could be considered, but many of them have recently been banned [6]. In the presence of severe (body mass index >40 kg/m2) or complicated obesity, bariatric surgery could be proposed. This therapeutic option is effective [7] but is not devoid of complications and may be irreversible [8]. Obesity-related complications, such as diabetes, hypertension, or sleep apnea, are likely to occur more frequently with increasing body mass index (BMI) and rapid and considerable WL is mandatory to curtail such risks.

In this scenario, alternative treatment options are warranted. About 40 years ago, after the introduction of protein-sparing modified fast (PSMF) achieved through the use of oral high-protein foods or liquid formula diets by Blackburn and Bistrian, several studies evaluated its effectiveness and safety [9, 10]. They showed that responsible and supervised very low-calorie diets (VLCDs) could be considered safe and appropriate therapy for obesity [11].

The purpose of the present study was to investigate the potential role of a 2-week course of enteral treatment with a very low-calorie protein-based formula in the management of severe obesity.

The rationale of this treatment option rests on the following considerations: (1) VLCDs appear to be able to reduce cardiovascular risk rapidly and effectively [9, 10, 12]; (2) VLCDs induce considerable short- and long-term WL [11]; (3) optimal compliance with the intervention, as active participation of the patient, is not required; (4) continuous administration of the intervention formula by enteral route enables the maintenance of the body amino acid pool.

Before being proposed for clinical use, a new WL program should be scientifically evaluated [13, 14]. Accordingly, in the present study, attention was focused not only on efficacy in terms of improving the cardiometabolic risk profile but also on the feasibility and safety of the procedure.

2. Materials and Methods

2.1. Design

This is an open-label interventional study in severely obese, adult out-patients.

2.2. Subjects

All subjects consecutively (from April 2010 to February 2013) attending the Clinical Nutrition Unit of our institution for a WL program were screened for inclusion into the study. Patients had to fulfill the following criteria to be eligible: age ≥ 18 years, severe obesity (body mass index (BMI) ≥ 40 kg/m2) [4], and history of multiple failures in WL programs. Exclusion criteria were age ≥ 70 years, type-2 diabetes mellitus on insulin, a psychiatric disorder, previous (<1 year since last chemo- or radiotherapy) or current neoplastic disease, established vascular disease, recent history of diet-induced or unintentional WL (within the previous 6 months), moderate-to-severe heart failure, arrhythmia, renal failure (creatinine > 1.5 mg/dL), current hepatitis, liver cirrhosis, any type of gastrointestinal disease, moderate-severe hypoalbuminemia (<3.0 g/dL), altered serum electrolytes, established gouty and any other contraindication to enteral nutrition, and refusal to give written informed consent.

2.3. Intervention

Patients were prescribed a homemade very low-calorie (~6 kcal/kg of ideal body weight/day) protein-based formula (2000 mL per day) by enteral route for 14 days. A polyurethane 8-French nasogastric tube was inserted on day 1 and removed at the end (day 15) of the cycle. The nutritional formula was administered continuously (24 hours a day) by means of a small, light, and rechargeable peristaltic feeding pump (Flocare Infinity, Nutricia, Italy) equipped with phthalates and latex-free infusion line. All patients received the enteral nutrition bags at home every day. The enteral nutrition bag and the pump were supplied in a backpack, thus enabling patients to continue to lead a normal life, pursuing their activities of daily living as usual.

The intervention formula was made up of a fixed amount of amino acids (arginine, ornithine-alpha-ketoglutarate, taurine, cysteine, tryptophan, hydroxyproline, and citrulline) and a variable quantity of high-quality (milk whey) proteins (Nepisond; Gefaldiet Service srl, Italy) in order to reach a total protein content of 1.2 g per kilogram of ideal body weight [9] calculated by Lorentz’s equations: Height − 100 − (Height − 150)/4, for men; Height − 100 − (Height − 150)/2.5, for women. Other components of the formula were prolipolytic substances (coenzyme Q10 and L-carnitine), linseed oil (10 grams per day), policosanol, fructooligosaccharides, potassium, sodium, and magnesium chloride. Details of the composition of the formula are provided in Table 1. The enteral nutritional treatment was also complemented by the daily oral administration of a complete (100% of recommended dietary allowances) multivitamin-multimineral supplement, alkalizing substances (calcium carbonate, 1500 mg daily; magnesium carbonate, 850 mg daily; potassium bicarbonate, 500 mg daily; sodium bicarbonate, 1500 mg daily; potassium citrate, 500 mg daily), and herbal remedies commonly marketed for their diuretic, antioxidant, antidiabetic, anti-inflammatory, hepatoprotective, and detoxifying properties (equisetum, nettle, hawthorn, silymarin, Orthosiphon, and fucoxanthin) [1520]. All patients were also prescribed treatment with a proton pump inhibitor and ursodeoxycholic acid: 900 mg daily and 450 mg daily for those with and without documented (by ultrasonography) cholestatic liver disease, respectively.

Patients were allowed to drink water or unsweetened drinks freely (not tea or coffee) during the day. A minimum intake of 2 liters daily was recommended. In patients with a history of kidney stones, the amount was increased to 3 liters.

Before the course, all treatments with hypoglycemic agents and diuretics were discontinued to avoid unintended hypoglycaemia and electrolyte imbalance. Other treatments with anti-hypertensive medications and uric acid and lipid-lowering drugs were left unchanged. Finally, a bowel preparation protocol was adopted for dinner two days before the start of intervention: on day 1, 500 mL of probiotic fermented skimmed milk + vegetable side dish seasoned with olive oil + herbal laxative syrup; on day 2, 500 mL of probiotic fermented skimmed milk + vegetable side dish seasoned with olive oil. During the intervention, no use of laxatives was allowed in order to avoid potassium and bicarbonate loss.

2.4. Assessments
2.4.1. Anthropometry

All the subjects had height (to the nearest 0.5 cm) and body weight (to the nearest 0.1 Kg) measured by the same calibrated flat scales equipped with a telescopic, vertical steel stadiometer according to standard procedures. The BMI was derived accordingly (weight [kg] and height [m] squared; kg/m2). Waist and hip circumferences (WC and HC, resp.) were assessed (to the nearest 0.5 cm) using a plastic flexible tape. Placing the tape perpendicular to the long axis of the body and parallel to the floor, WC and HC were measured at the midpoint between the lowest rib and the iliac crest and around the largest portion of the buttocks, respectively. The waist-hip ratio (WHR) was also calculated [4].

2.4.2. Hematology and Biochemistry

Venous blood samples were drawn after 8 to 12 hours of fasting and the following parameters were assessed on the same day by our institutional laboratory using conventional automated analyzers and commercial kits: hemoglobin, total lymphocyte count, blood urea nitrogen (BUN), creatinine, uric acid, glucose, insulin, C-peptide, glycated hemoglobin, growth hormone (GH), insulin-like growth factor 1 (IGF-1), total cholesterol, high-density and low-density lipoprotein cholesterol (HDL and LDL, resp.), triglycerides, apolipoproteins A-I and B (ApoA-I and ApoB, resp.), albumin, serum enzymes (cholinesterase, aspartate aminotransferase (AST), alanine aminotransferase (ALT), gamma glutamyl transferase (γ-GT), creatine phosphokinase (CPK), and lactate dehydrogenase (LDH)), and electrolytes (sodium, potassium, magnesium, calcium, and phosphorus). Insulin resistance was estimated by the homeostasis model assessment of insulin resistance (HOMA-IR) [21]. The triglyceride/HDL cholesterol ratio and ApoB/ApoA-I ratio were also considered [22, 23].

2.4.3. Blood Pressure

Systolic and diastolic blood pressure (SBP and DBP, resp.) were measured by appropriately sized standard sphygmomanometers after having the patient seated for at least 5 minutes in a chair, with feet on the floor and arm supported at heart level. The average of three measurements, obtained at 2-minute intervals, was used for the analysis [24]. Heart rate was also recorded.

2.4.4. Bile Duct Ultrasonography

Patients were also screened for the presence of cholestatic liver disease (overt cholelithiasis or biliary sludge).

Data on these parameters were collected at baseline (day 0; tube placement) and at the end (day 15; tube removal) of the intervention, before any pharmacological treatment was reintroduced. Patients were also asked to check their ketosis status daily by means of urine sample spot checks.

2.5. Study Outcomes
2.5.1. Feasibility

It was defined by the necessity to discontinue the intervention. The causes of the discontinuation were to be recorded.

2.5.2. Safety

Patients were asked to report the onset of any of the following side effects daily, using a self-administered questionnaire: asthenia, headache, dizziness, fainting, orthostatic hypotension, heartburn, nausea, vomiting, palpitations, muscle cramps, hunger, and constipation. Safety was also assessed by the evaluation of changes in the following hematological and biochemical parameters and, for those presenting with normal values, by the excursion outside of the reference ranges of our laboratory (new cases): hemoglobin, total lymphocyte count, BUN, creatinine, uric acid, albumin, serum enzymes (cholinesterase, AST, ALT, γ-GT, CPK, and LDH), and electrolytes (sodium, potassium, magnesium, calcium, and phosphorus).

2.5.3. Efficacy

It was defined by the changes (increase (HDL, ApoA-I, and GH) or more frequently the reduction (all the others)) in the following study parameters: body weight, BMI, WC, HC, WHR, uric acid, glucose, insulin, HOMA-IR, C-peptide, glycated hemoglobin, IGF-1, total cholesterol, HDL, LDL, triglycerides, triglyceride/HDL ratio, ApoB, ApoB/ApoA-I ratio, AST, ALT, and γ-GT.

2.6. Statistical Analysis

All statistical analyses were performed using the software MEDCALC for Windows, Version 11.3.0.0 (MedCalc Software, Mariakerke, Belgium). The level of significance was set at the two-tailed value <0.05.

Safety parameters were analyzed in and reported for the per-protocol (PP) population. However, the analysis of efficacy parameters was conducted according to the intention-to-treat (ITT) principle. Accordingly, all patients who had been assessed at baseline were included in the ITT population. The value observed at baseline was used in the analyses for dropouts.

Data were presented as mean and standard deviation (SD) or counts and percentage, as appropriate.

Group comparisons were performed using Fisher’s exact test (categorical variables) and Student’s -test or Wilcoxon’s test (continuous variables).

Changes in study parameters were investigated by Student’s -test or Wilcoxon’s test for paired data, while proportions were compared with Fisher’s exact test. A set of secondary analyses was also performed by building generalized linear regression models, including changes (difference = final − baseline) in study parameters as alternative dependent variables and age, gender, and diabetes as independent variables. Finally, logistic regression analysis of baseline features was considered to investigate the alterations (values below or above the lower and the upper limit of laboratory range, resp.) in safety parameters occurring in at least 10% of patients.

3. Results

In total, 364 patients (59% females; BMI (mean ± SD),  kg/m2) were recruited. Based on ideal body weight (mean ± SD,  kg) the mean (±SD) daily protein and calorie intake were  g/day and  kcal/day, respectively.

3.1. Feasibility

Overall, the intervention was well tolerated. Twenty-six patients (7%; 13 men and 13 women) had to discontinue the intervention within 48 hours. Discontinuation was only due to nasogastric tube intolerance (physical discomfort or social reasons). The features of dropouts were similar to those of completers (Supplementary Table 1, available online at http://dx.doi.org/10.1155/2015/723735). Finally, compliance was optimal in completers, as confirmed by the evaluation of urinary ketosis.

3.2. Safety

No serious adverse events occurred during the intervention. Throughout the intervention period, constipation was the most frequently reported side effect (8.6% and 10.9% during the first and the second week, resp.). Other frequent (>10%) side effects reported during the first week were headache and hunger. However, their frequency was significantly reduced during the second week of the study. The same applied to other symptoms, with the exception of muscle cramps. Nonetheless, prevalence was almost below 5%. The frequency of self-reported side effects throughout the study is reported in detail in Table 2. Overall, “no side effects” during the first and the second week was reported by 220 (65%) and 270 (80%) patients, respectively.

In respect to hematological and biochemical variables (Table 3), looking at mean values in the whole population, all safety parameters were affected by the intervention. An increase in the following values was observed: hemoglobin, creatinine, uric acid, albumin, AST, ALT, CPK, LDH, potassium, calcium, and phosphorus. However, also a reduction in the following was detected: total lymphocyte count, BUN, cholinesterase, γ-GT, sodium, and magnesium. The greatest changes were observed for uric acid (+45%), AST (+48%), and ALT (+47%) levels, although only a limited number of patients reported values slightly higher than two times the upper limit of normality (uric acid, ; AST, ; ALT, ). In the other cases the change was almost negligible, as most patients retained values within the normal ranges for our laboratory (as suggested also by 95% confidence intervals of the mean difference). Interestingly, according to regression analysis, the most frequent (frequency > 10%) alterations (increase above the upper limit of laboratory range) in biochemical parameters (uric acid, ALT, AST, and CPK) occurred in male subjects ( for all). Changes in uric acid were also more likely to occur in younger patients (). Finally, the increase in ALT was higher in those who had normal values at baseline (for ALT: +75% versus +37%, ).

3.3. Efficacy

Despite similar age (women, 40.1 [SD, 10.8] versus men, 41.1 [SD, 10.3]; ) and degree of obesity, as expected, male patients were characterized by more evident abdominal adiposity and abnormalities in cardiometabolic risk profile (blood pressure and both glucose and lipid metabolism parameters; Supplementary Table 2). However, the prevalence of diabetes was almost comparable between genders (): 18.6% and 26.8%, in women and men, respectively.

The intervention resulted in significant WL (ITT population, 5.7% [SD, 2.3]; PP population, 6.1% [SD, 1.8]; Table 4). This applied to both genders (ITT population: men, 5.9% [SD, 2.5] versus women, 5.5% [SD, 2.2]; ; Supplementary Table 2).

WL resulted in significant improvement in blood pressure, in all anthropometric variables and most hematological and biochemical parameters. As expected, uric acid and ApoB/ApoA-I ratio showed an increase, while HDL, ApoA-I, and IGF-1 were significantly decreased (Table 4). Results were confirmed by analyses in PP population. These findings were substantially confirmed by gender-specific analyses (Supplementary Table 2).

In secondary efficacy analyses (multivariable linear regression; Table 5), it was observed that the improvement in glucose control-related variables (glucose, insulin, HOMA-IR, C-peptide, glycated hemoglobin, triglycerides, and triglyceride/HDL ratio) and blood pressure (both systolic and diastolic) was even greater in diabetic patients.

In respect to the improvement of cardiometabolic profile, we report also that the diuretic therapy was no longer deemed necessary while oral hypoglycemic agents were reintroduced at half of the initial dose.

4. Discussion

The present study has shown that a 2-week course of PSMF, achieved through the administration of a very low-calorie protein-based formula by enteral route, is a feasible, safe, and effective procedure to be taken into due consideration for a composite weight loss program for the management of severe obesity.

The effectiveness of VLCD has been reported to rest on its appetite-suppressing ketogenic nature, which mimics the anorexia of starvation, and the satiating effect associated with its high-protein content [9, 10]. However, compared to previous studies in which the dietary regimen was achieved by pulsatile administration of low-calorie, low-carbohydrate, high-protein foods or liquid formula, the use of the enteral nutrition technique enabled around-the-clock administration. The main advantage of this approach is the possibility of keeping the patient in steady-state conditions, reducing the difficulties in complying with a formula-based therapeutic regimen mainly due to hunger or palatability/acceptability as much as possible [25]. In a state of complete absence of carbohydrates, which can be achieved only with the use of a specifically designed liquid formula, ketogenesis and enteral stimulation are constant. It could not be excluded that compliance with and acceptability of the intervention were also to be ascribed to the fact that a feeding tube is perceived as real medical therapy. Moreover, the presence of the tube may emphasize the social disruptiveness previously reported for VLCDs [25]. However, this approach can reasonably be proposed as a short-term intervention (2–4 weeks). Compared to the other VLC interventions [11] that commonly provide about 1000 kcal/day for up to 12 weeks, a PSMF approach provides about 400 kcal/day. Nonetheless, protein and micronutrients malnutrition is avoided with adequate protein administration and micronutrients supplementation. This is a relevant issue, as most prolonged low-calorie dietary interventions shift to intake associated with risk of micronutrients inadequacy [26].

In our study, discontinuation of therapy was unrelated to adverse effects and was driven only by intolerance to the tube, either for physical or social reasons. Self-reported side effects were few and mainly limited to the first days of the intervention. Previous studies have reported the occurrence or intensification of emotional disturbances, such as depression and anxiety during intensive WL [27, 28]. Patients with psychiatric disorders were excluded during the baseline assessments and these symptoms were not observed in our experience. As, in order to minimize adverse effects, it is not recommended to prescribe dietary regimens with calorie content lower than basal metabolic rate, we also investigated the safety of this experimental intervention. With exception of serum uric acid and aminotransferases, most changes in biochemical safety parameters still fell within the normal ranges. Ketogenic regimens are known to increase uric acid. This appears to generally occur during the first 6 weeks, with normalization during maintenance of a lower weight. No attack of acute gouty arthritis was observed, but an incidence of up to 1 percent of this disorder has been reported during longer VLCD programs [10]. The increase in aminotransferases is also consistent with the intense lipolytic activity and the intense flow of fatty acids to the liver [29]. Intense lipolysis is likely reflected also by restored growth hormone incretion after WL [30]. However, contrary to previous evidence, WL was associated with a reduction in circulating IGF-1, which is consistent with short-term starvation and the similar effect on the immune system [30, 31], as reflected by the subclinical reduction in lymphocyte count. It is reasonable to argue that most of these changes are transient, without relevant clinical implications, and can be normalized by returning to a balanced oral diet. Moreover, they were of limited entity and the consequence of an intervention of limited duration. Accordingly, the appropriate selection of the candidates performed is an important step.

The intervention investigated herein has also proved to be effective in reducing body weight and improving the cardiometabolic risk profile. This was particularly evident in diabetic patients, thus supporting the efficacy of VLCDs in rapidly modifying cardiovascular risk [9, 12]. However, it also appeared to induce a detrimental reduction in HDL and ApoA-I levels and an increase in ApoB/ApoA-I ratio, despite the significant decrease also in ApoB, which is secondary to the restriction of saturated fat and cholesterol [32].

Current guidelines [4] recommend, as initial goal, a WL of 10% from baseline, to be achieved approximately over 6 months. In the present experience of two-week PSMF by enteral route we observed a mean WL of ~6%. We could hypothesize that the repetition of 2 or 3 courses of this therapy could bring consistent benefits to the patient. However, despite optimal compliance and acceptability during enteral nutrition, the intervention lasts only 14 days and the patient still requires constant monitoring and follow-up evaluations. The present treatment procedure, alternated with periods of closely monitored oral diet, was designed to be included in a composite dietary rehabilitation program, with the gradual introduction of a balanced Mediterranean-like diet. In respect to this, an apparent advantage may be the transient postdiet hypophagia observed after switching from a ketogenic diet to ad libitum food [33]. Nonetheless, thinking about the overall management pathway of severe obesity, a potential preoperative application to reduce anesthetic risk could be hypothesized.

PSMF and more extensively prolonged VLCDs have raised concerns and criticisms because of the risk of complications, which may occur not only during the intervention but also during the “refeeding” phase and are mainly related to electrolyte disturbances. These include some major problems, such as nephrolithiasis or arrhythmias, and other minor issues (headache, nausea, occasional vomiting, bad breath, fatigue, muscle cramps, and constipation) [34]. However, our study shows that most complications can be easily prevented with the use of high-quality proteins and relevant electrolyte, vitamin, and mineral supplements [10, 34]. Indeed, responsible use of this therapeutic regimen for short-term periods and careful selection of the candidates are mandatory. In the first instance, our treatment protocol was investigated in severely obese patients with a history of multiple failures. Accordingly, it is not proposed as first-line therapy, but as an alternative therapy before more advanced approaches, such as surgery, in high-risk patients with serious difficulties in complying with further dietary regimens.

Finally, another concern with VLCDs is weight regain. On the one hand, initial WL appears to predict lower body weight at follow-up. On the other, rapid WL has been also associated with greater regain during the maintenance phase [11]. Indeed, the therapy does not engage the patient in life style and food choice changes necessary to be successful in long-term weight reduction. The long-term effects of the present treatment protocol, after inclusion into a composite weight management program, clearly need to be investigated and data collection is ongoing. Studies are also needed to measure changes in nutritional status, body composition, and energy expenditure, although evidence supports the beneficial effect of low-carbohydrate, high-protein diets and the use of milk whey proteins [35, 36].

The strengths of our study are the large study population, the rigorous selection of the patients, and the standardized and responsible approach.

However, also its limitations should be taken into account. First, this was an observational study and randomized trials including control groups—treated either with standard hypocaloric diet or oral VLCD—should be performed to achieve a more rigorous evaluation among the plethora of available WL interventions. Second, the present report focused only on data addressing a single enteral course of treatment; the impact of this intervention should be clearly evaluated within the broader context of a long-term composite weight management program. Particularly, in order to further support its use in clinical practice, postintervention normalization of safety parameters needs to be addressed. Finally, the evaluation of self-perceived outcome measures (e.g., hunger or wellbeing) by means of visual analogue scales would have been also informative.

In conclusion, a 14-day course of enteral treatment with a very low-calorie protein-based formula appears to be a feasible, likely safe, and efficacious therapeutic option to be taken into consideration for a composite weight loss program for the management of severe obesity.

Ethical Approval

The study was performed in adherence with the principles established by the Declaration of Helsinki. The study protocol was approved by the Ethics Committee of the A.O.R.N. “San Giuseppe Moscati” (Avellino, Italy).

Disclosure

Dr. G. Castaldo had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Disclaimer

The sponsor of this study had no role in the design and conduct of the study; in the collection, management, analysis, and interpretation of the data; or in the preparation, review, or approval of the paper.

Conflict of Interests

The authors certify that there are no affiliations with or involvement in any organization or entity with a direct financial interest in the subject matter or materials discussed in the paper and indicated no potential conflict of interests.

Authors’ Contribution

All authors approved the final version of the paper. G. Castaldo was responsible for study concept and design. G. Castaldo and L. Castaldo were responsible for acquisition of data. G. Castaldo was responsible for analysis and interpretation of data. G. Castaldo was responsible for drafting of the paper. G. Castaldo, L. Monaco, and P. Sorrentino were responsible for critical revision of the paper for important intellectual content. G. Castaldo was responsible for statistical analysis. G. Castaldo obtained funding. G. Castaldo, Monaco, and P. Sorrentino were responsible for administrative, technical, or material support. G. Castaldo was responsible for study supervision.

Acknowledgments

This work was supported by the A.O.R.N. “San Giuseppe Moscati” (Avellino, Italy) and by unrestricted grants of Nutricia Italia. The authors wish to thank Jennifer S. Hartwig, M.D., for assistance in editing the paper.

Supplementary Materials

Baseline features of the population by intervention status.

For Supplementary Table 2: "Changes in anthropometric, clinical and metabolic features after the intervention and according to gender."

  1. Supplementary Material