Artificial Intelligence in Medical ApplicationsView this Special Issue
Research Article | Open Access
Design of a Clinical Decision Support System for Fracture Prediction Using Imbalanced Dataset
More than 1 billion people suffer from chronic respiratory diseases worldwide, accounting for more than 4 million deaths annually. Inhaled corticosteroid is a popular medication for treating chronic respiratory diseases. Its side effects include decreased bone mineral density and osteoporosis. The aims of this study are to investigate the association of inhaled corticosteroids and fracture and to design a clinical support system for fracture prediction. The data of patients aged 20 years and older, who had visited healthcare centers and been prescribed with inhaled corticosteroids within 2002–2010, were retrieved from the National Health Insurance Research Database (NHIRD). After excluding patients diagnosed with hip fracture or vertebrate fractures before using inhaled corticosteroid, a total of 11645 patients receiving inhaled corticosteroid therapy were included for this study. Among them, 1134 (9.7%) were diagnosed with hip fracture or vertebrate fracture. The statistical results showed that demographic information, chronic respiratory diseases and comorbidities, and corticosteroid-related variables (cumulative dose, mean exposed daily dose, follow-up duration, and exposed duration) were significantly different between fracture and nonfracture patients. The clinical decision support systems (CDSSs) were designed with integrated genetic algorithm (GA) and support vector machine (SVM) by training and validating the models with balanced training sets obtained by random and cluster-based undersampling methods and testing with the imbalanced NHIRD dataset. Two different objective functions were adopted for obtaining optimal models with best predictive performance. The predictive performance of the CDSSs exhibits a sensitivity of 69.84–77.00% and an AUC of 0.7495–0.7590. It was concluded that long-term use of inhaled corticosteroids may induce osteoporosis and exhibit higher incidence of hip or vertebrate fractures. The accumulated dose of ICS and OCS therapies should be continuously monitored, especially for patients with older age and women after menopause, to prevent from exceeding the maximum dosage.
Chronic respiratory diseases, including chronic obstructive pulmonary disease (COPD), asthma, bronchiectasis, allergic rhinitis and sinusitis, obstructive sleep apnoea syndrome, pulmonary hypertension, and other occupational lung diseases, are caused by disorder of the airways and other structures of the lung . More than 1 billion people suffer from chronic lung diseases, accounting for more than 4 million deaths annually . Among them, more than 200 million people were afflicted by COPD causing 3 million deaths globally; more than 235 million people were affected by asthma resulting in 0.18 million deaths [3, 4] with over 80% of deaths found in countries with low- and lower-middle income ; and the incidence rate of bronchiectasis ranged from 4.2 per 100000 persons aged 18–34 years to 272 per 10000 persons aged 75 years and above in the US  with an increasing rate of 8.7%/year from 2001 to 2007 .
COPD is an inflammatory disease of the lung characterized by progressive airflow obstruction, systematic chronic inflammation, and recurrent acute exacerbation [8, 9]. WHO predicted that COPD will become the 3rd leading cause of death worldwide in 2030 . Bronchiectasis is characterized by abnormal bronchial dilation and bronchial wall thickness, chronic infection and inflammation, recurrent cough and sputum production, and bacterial colonization and airflow obstruction, resulting in a decline in respiratory function . Compared to other chronic diseases, asthma has a relatively lower fatality rate. Asthma is characterized by chronic airway inflammation with the history of respiratory symptoms like wheeze, shortness of breath, chest tightness, and cough accompanied with expiratory airflow limitation . Oral corticosteroids (OCS) and inhaled corticosteroids (ICS) are usually prescribed by physicians to improve symptom, lung function, and quality of life, as well as to reduce repeated exacerbations for patients with asthma, COPD, and bronchiectasis. However, it was reported that corticosteroid use may increase the risk of fracture [13–15].
Clinical decision support systems (CDSSs) provide useful information and expert knowledge to assist healthcare providers to improve diagnosis and treatment outcomes, disease managements, and healthcare quality for patients in both home and clinical settings and have been shown to be capable of improving healthcare outcomes in medical practice . CDSSs have been widely applied in disease diagnosis [17, 18], disease treatment and management [19–21], medical alerting or event reminding [22–24], and drug dosing or medication prescribing [25, 26].
1.1. Problems Encountered in CDSS Design with Imbalanced Datasets
Taiwanese National Health Insurance program is a single-payer, compulsory insurance system that was established in 1995 by the Bureau of National Health Insurance (NHI), Ministry of Health and Welfare. The insurance program provides healthcare to 99% of the 23.74 million citizens of Taiwan and maintains contracts with 97% of the nation’s healthcare institutions. The National Health Research Institute is authorized to establish the National Health Insurance Research Database (NHIRD), as well as to manage registration and claim data for the 23 million insured citizens. Most studies used a subset of the NHIRD that consisted of 1 million randomly sampled beneficiaries enrolled in the NHI program. According to a PubMed website search conducted in July 2016, around 4000 studies investigated using NHIRD have been published . The high accuracy and validity of ICD-9-CM diagnoses in the NHIRD have been described in previous studies . Recently, we have conducted several studies to discover the association between an individual disease with the risk of acquiring another diseases based on the data retrieved from the NHIRD, for example, the investigation of inhaled corticosteroids with pulmonary tuberculosis , sleep disorders with erectile dysfunction , gout with erectile dysfunction in men , and bronchiectasis with ischemic stroke . Because most of the datasets retrieved from the NHIRD for the above-mentioned studies are imbalanced with ratios of positive samples (minority) to negative samples (majority) ranging from 1 : 4 to 1 : 5, the decision hyperplane will bias toward the majority class when adopting the accuracy-driven algorithm to design the CDSS.
Minority cases refer to rare patterns or abnormal behaviors that are difficult to detect but are often important. In real application domains, such as oil spill detection in satellite radar images , text classification , financial fault detection [35, 36], customer identification , medical diagnosis [38, 39], and others, classification of imbalanced datasets incurs critical problems. One problem encountered in classifying unbalance datasets is that samples of one class (majority) outnumber the samples in another class (minority) that is of often more interest or importance, making the algorithms driven by accuracy bias toward the majority class . Generally, although the classification accuracies are satisfactory in the classifiers designed based on the accuracy-driven (treating accuracy as the fitness function) algorithms, their sensitivities are quite low. Hence, alternative fitness functions, such as area under ROC curve (AUC)  or weighted sum of accuracy, sensitivity, and specificity, are proposed to solve these problems.
1.2. State-of-the-Art Methods for CDSS Design
The classifiers built based on logistic regression, decision tree, standard neural network, and support vector machine are generally suitable for balanced data only. When dealing with imbalanced data, these classifiers often bias toward the majority cases while distorting the minority cases. To improve the predictive performance, the methods for modeling imbalanced datasets include data preprocessing, cost-sensitive learning, and kernel-based methods .
Resampling data in the sample space and selecting features in the feature space are commonly used preprocessing strategies for dealing with imbalanced datasets. There are 3 categories of resampling methods, including undersampling, oversampling, and hybrid sampling methods, applied for rebalancing the imbalanced datasets. Oversampling methods are used to deal with the minority samples by generating new minority samples, while undersampling strategies are applied to randomly discard the majority samples to balance the datasets. The hybrid sampling is a combination of both methods.
Undersampling includes random undersampling and informed undersampling . The major drawback of undersampling is that important information may be lost due to the removal of some data points. There is no specific mechanism under random undersampling, which only functions randomly. Other undersampling methods like one-sided selection , BalancedCascade, and EasyEnsemble  are called informed undersampling. One-sided selection obtains the balanced training set from an imbalanced one by keeping the minority samples untouched while selectively removing the borderline majority samples by applying Tomek link concept . It eliminates boundary samples and deals with only a subset of majority samples. Devi et al.  proposed a modified Tomek link-based undersampling scheme to eliminate, besides boundary samples, outlier and redundant samples to improve the one-sided selection method. In EasyEnsemble and BalancedCascade, several subsets of training data are sampled from the majority samples and each subset is combined with the minority samples for training a model. The generated models are then combined for making the final decision .
The simplest oversampling method is random oversampling, in which the minority samples are randomly duplicated. A critical problem of random oversampling is overfitting. Another major approach in oversampling is synthetic minority oversampling technique (SMOTE), which generates synthetic samples on the line segments connecting each minority sample to its k-nearest neighbors in minority class . A major problem of SMOTE is that it blindly generates synthetic samples without considering the majority data points located close to the minority samples, resulting in overlapping between classes. Later, several methods, such as Borderline-SMOTE , Safe-Level-SMOTE , and Cluster-SMOTE , extending the conventional SMOTE were proposed to improve the performance.
Cost-sensitive learning is useful for handling imbalanced healthcare data since classifying a minority (positive) sample to the majority (negative) class often costs more than classifying a majority sample to the minority class. There are 3 major categories generally found in cost-sensitive learning: approaches that assign different weights to samples, ensemble schemes that integrate with cost-sensitive methods, and methods that incorporate the misclassified costs directly into the classifiers . The first approach is motivated by the AdaBoost scheme which trains an initial model based on the original imbalanced dataset and identifies misclassified samples. More weight will be assigned to the misclassified samples in the following iterations until the classifier significantly improves. In the second scheme, boosting approach is generally used for improving the imbalanced data problem and multiple base learners are trained to solve the classification problem. Many types of ensemble learning methods like bagging, boosting, and stacking have been proposed to combine base learners according to different strategies. In the third method, by considering costs of misclassification differ among different classes, the classifier is designed by minimizing the total misclassification cost. In the current study, the strategy for designing the CDSSs is to weight more on sensitivity in the objective function or to maximize the AUC for achieving higher sensitivity in detecting more patients (minority cases) to increase their well-being.
Support vector machine (SVM) is mostly integrated in kernel-based methods for imbalanced data learning. In Farquad and Bose , oversampling of the minority class was achieved by training an SVM model with lower accuracy but higher sensitivity by increasing the value of SVM model parameter C to convert the misclassified majority samples into minority samples. The reconstructed more balanced training dataset was then applied for training the classification models with better predictive performance using different artificial techniques like multilayer perceptron (MLP), logistic regression (LR), and random forest (RF). In contrast, Jian et al.  applied the biased SVM to identify the support vectors and nonsupport vectors of the imbalanced training samples and then used SMOTE and random undersampling methods to resample the support vectors in the minority class and nonsupport vectors in the majority class, respectively. Recently, Piri et al.  proposed a new SMOTE algorithm by oversampling the informative minority samples near the SVM decision boundary. Additionally, they focused on misclassified informative minority samples by oversampling them with a higher degree than the correctly classified minority samples. The algorithm generates much less synthetic samples and is more efficient than SMOTE , Borderline-SMOTE , Safe-Level-SMOTE , and Cluster-SMOTE .
According to the aforementioned description, the datasets retrieved from the NHIRD for public health studies are mostly imbalanced with minority to majority sample ratios ranging from 1 : 4 to 1 : 5, and the decision hyperplane tends to bias toward the majority class when adopting the accuracy-driven algorithm to design the CDSS. The dataset adopted in this study is even more imbalanced with the minority to majority ratio approximates to 1 : 9. The objectives include the following: (1) investigate the association between corticosteroid use and fracture using NHIRD and (2) design the CDSSs to predict fracture occurrence for patients with chronic respiratory diseases prescribed with corticosteroids by dealing with the imbalanced dataset. The preliminary results were reported in .
2. Materials and Methods
2.1. Data Sources
Data of the patients who were 20 years old or older visiting healthcare centers (outpatients or inpatients) and had been prescribed with inhale corticosteroids because of diagnosed asthma (ICD-9-CM 493), chronic obstructive pulmonary disease (COPD) (ICD-9-CM 491, 492, and 496), or bronchiectasis (ICD-9-CM 494) within 2002–2010 were retrieved from the NHIRD for this investigation. Patients diagnosed with hip or vertebrate fractures before using inhaled corticosteroid were excluded. The outcome measure was hip fracture (ICD-9-CM 820) or vertebral fracture (ICD-9-CM 805 and 806). The data of 11645 patients, including 1134 patients with the fracture (614 men and 520 women) and 10511 patients without fracture (6211 men and 4300 women), were retrieved from the NHIRD within 2001–2013 and were used for statistical analysis and CDSS design. The patients were divided into 4 groups according to age: 20–40, 41–50, 51–64, and ≥65 years. The respiratory diseases included were asthma (ICD-9-CM codes 493), COPD (ICD-9-CM codes 491, 492, and 496), and bronchiectasis (ICD-9-CM codes 494). Other comorbidities included diabetes (ICD-9-CM codes 250), cancer (ICD-9-CM codes 140–208), liver cirrhosis (ICD-9-CM codes 571.2 and 571.5), end-stage renal disease (ICD-9-CM codes 585), and osteoporosis (ICD-9-CM codes 722.0).
SPSS 22.0 software (IBM.SPSS) was adopted for all statistical analyses. Difference in the proportional distribution of the demographic characteristics and comorbidities of the patients with fracture and those without fracture were compared and tested using the Chi-square test. The overall, age-specific, and comorbidity-specific incidences of fractures in both fracture and nonfracture groups were also compared. The cumulative dose, mean follow-up daily dose, and mean exposed daily dose of prescribed corticosteroid were also analyzed using unpaired Student’s t-test. The statistical significance was defined as .
2.2. Design of Clinical Decision Support Systems
As shown in Figure 1, a wrapper method integrating genetic algorithm (GA) and support vector machine (SVM) was used for designing the CDSSs with the former adopted for selecting salient features and adjusting the SVM parameters (cost value and kernel parameter) whereas the latter for classifying different classes and calculating fitness values based on the objective functions . For each iteration, the n chromosomes were updated by combining n/2 new chromosomes generated from crossover with the other n/2 chromosomes obtained from mutation. The parameters of the genetic algorithm were set as follows: number of initial chromosome population , maximum number of iterations with unimproved fitness value (MaxNotImproved) = 500, and maximum number of total iterations (MaxIteration) = 100000. When the current iteration (CurrentIteration) ≥ MaxIteration or the number of iterations with unimproved fitness (NumOfNotImproved) ≥ MaxNotImproved, the program terminated.
2.2.1. Data Preprocessing and Preparation
The data retrieved from the NHIRD were divided into training and testing datasets, each contains 50% of the samples in majority class and minority class, respectively, that is, 567 samples with fracture and 5255 samples without fracture. Random undersampling, cluster-based undersampling , and one-sided selection  methods were used to prepare the training datasets before designing the CDSSs. After random undersampling, the balanced training set consisted of 2m samples by including all the m minority samples and randomly selecting m-nonduplicated samples from the M (M > m) samples in the majority class. In contrast, in the cluster-based undersampling, the samples in the majority class were clustered into m clusters that each consisted of or samples. And then, the kNN algorithm was applied to select the sample which was nearest to the center of gravity in each cluster, resulting in a balanced training set containing 2m samples for cross-validation. After the CDSSs had been trained, the imbalanced testing dataset was used for testing the predictive performance of the models.
2.2.2. Model Training and Testing
Independent training and testing (ITT) was adopted for training and testing effectiveness of the CDSS  that 50% of the data were used for training and validating and the rest 50% for testing its predictive performance by calculating the accuracy, sensitivity, specificity, G-mean, and AUC. In the training phase, tenfold cross-validation was adopted for training and validating the models for obtaining a model with the best performance. For cross-validation, all the sample data in the training set were randomly divided into 10 clusters (folds), in which any combined nine folds were used for training while the remaining one for validating the CDSSs. The procedure was repeated for 10 times.
In the testing phase, the imbalanced testing dataset was applied for testing the designed CDSSs obtained in the testing phase. When designing the CDSSs, selection of the objective function is crucial in obtaining optimal CDSS models. In this study, the cost-sensitive objective functions, including AUC and combined accuracy, sensitivity, and specificity, were used to obtain the optimal CDSSs with imbalanced datasets. Equation (1) shows the objective function which combines the accuracy, sensitivity, and specificity. Equation (2) shows the AUC treated as the objective function.
In (1), we intended to maximize the value of the objective function by increasing the accuracy (AC) and decreasing the difference between the sensitivity (SE) and specificity (SP) at the same time to avoid the decision hyperplane to bias toward the majority class, whereas in (2), only AUC is maximized.
In order to verify the feasibility of the proposed method, a pilot study which used the CoIL challenge dataset  and WDBC dataset  was conducted and compared with the results obtained in previous studies  and one-sided selection , respectively. Table 1 shows the predictive performance of the CDSSs trained by using training datasets obtained by random undersampling. As shown in the table, the predictive performances of the 10 training subsets are very similar with an average predictive accuracy, sensitivity, specificity, G-mean, and AUC of 66.17%, 62.85%, 66.38%, 0.6439, and 0.7069, respectively.
Table 2 compares the predictive performance among CDSS models designed using different methods based on the CoIL challenge dataset. As shown in the table, unlike biases exhibited in models designed with accuracy-driven algorithms, the method proposed in this study presents higher AUC with more unbiased sensitivity and specificity than the methods proposed in , that is, SVM+ 100% oversampling, MLP + SMOTE, hybrid SVM-MLP + 100% oversampling, LR + SMOTE, and hybrid SVM-LR + 100% oversampling, as well as decision tree (J48) + cluster-based kNN undersampling and one-sided selection. Notice that the one-sided selection methods achieve 0% sensitivity and 100% specificity in the testing phase for its inability of obtaining a balanced training set after undersampling (5474 majority samples and 348 minority samples before and 5236 majority samples and 348 minority samples after one-sided selection).
Table 3 compares the predictive performance among the CDSS models designed based on our proposed methods and the one-sided selection methods using the WDBC dataset. As noted in the table, the predictive performance of the models designed with one-sided selection methods demonstrates similar performance with models built using our proposed methods. Compared with the one-sided selection methods, the results indicate that our proposed methods are more robust with the predictive performance less influenced by different datasets adopted for designing CDSSs.
3. Results and Discussions
3.1. Statistical Analysis
Comparisons of demographic characteristics, comorbid respiratory diseases, and other comorbidities between the patients with and without fracture are shown in Table 4. As shown in the table, age and gender distributions of the patients in fracture cohort and comparison cohort were significantly different (). The patients with fracture were older than those without fracture (). The mean ages of the patients with fracture were 70.5 ± 12.5 years, and those without fracture were 58.5 ± 18.1 years. The prevalence of respiratory diseases and other comorbidities, including COPD (64.7% versus 51.6%), DM (14.9% versus 12.4%), end-stage renal disease (2.8% versus 1.4%), and osteoporosis (7.1% versus 3.6%), was significantly higher in the fracture cohort than in the comparison cohort (), while the prevalence of asthma was significantly lower in the fracture cohort than in the comparison cohort (). On the other hand, bronchiectasis (5.8% versus 4.7%), liver cirrhosis (1.1% versus 0.8%), and cancer (4.7% versus 4.4%) were not significantly different between the 2 groups (Table 4).
Table 5 exhibits the association between prescribed oral or intravenous corticosteroid and fracture. The cumulative dose (2355.86 ± 4049.43 versus 1345.77 ± 2831.30) and mean exposed daily dose (94.04 ± 314.98 versus 67.65 ± 235.62) of patients with fracture were significantly higher than the nonfracture cohort (), while the mean follow-up daily dose (59.56 ± 285.58 versus 59.74 ± 218.39) did not reach significance (). Regarding the follow-up (999.65 ± 997.09 versus 706.77 ± 907.35 days) and exposed (154.04 ± 320.91 versus 90.11 ± 194.80 days) durations, the patients with fracture were significantly longer () than those without fracture.
Table 6 shows the association between prescribed inhaled corticosteroid and fracture. As indicated in the table, the cumulative dose (230.14 ± 442.76 versus 171.97 ± 318.13) of patients with fracture was significantly higher than the patients without fracture (), while the mean follow-up daily dose (0.44 ± 2.31 versus 1.00 ± 3.91) was significantly lower (). On the other hand, the mean exposed daily dose (0.51 ± 0.81 versus 0.55 ± 1.35) was not significantly different between patients with and without fracture (). With regard to the follow-up (1777.17 ± 1039.82 versus 1370.91 ± 1097.76 days) and exposed (453.79 ± 584.65 versus 342.35 ± 503.32 days) durations of inhaled corticosteroid, the patients with fracture were significantly longer () than those without fracture.
3.2. Clinical Decision Support System
Table 7 compares the predictive performance in both training and testing phases of the CDSSs designed using balanced training sets obtained from different undersampling methods. Table 8 shows the optimal SVM parameters and selected features for CDSS design.
Although allergic rhinitis and sinusitis are also a type of chronic respiratory diseases, they are not included for analysis in the current study for they are usually treated with intranasal corticosteroid  having lower concentration and smaller effect than oral or inhaled corticosteroids . Neither pulmonary hypertension nor occupational lung diseases are not treated with corticosteroid. It was observed that intranasal corticosteroid suppresses children’s growth in short-term study , but not affecting adult height for children in long-term treatment . Among the elderly people, administration of low-dose inhaled corticosteroids exhibited small but significant excess risk of cataracts but not observed in use of nasal corticosteroids . Patients with asthma who received the ICS were reported to have higher risk of contracting pneumonia or lower respiratory infection  and have effect on adult height in children . Similar to asthma, patients with COPD receiving ICS therapy also exhibited increased risk of pneumonia  and TB .
As shown in Table 4, the majority of patients with fractures in this study were men (54.1%) with mean age of 70.5 ± 12.5, which is similar to the results obtained from some previous studies, for example, 94% (mean age: 62.7 ± 12.4) reported in  and 60% (mean age: 61.2 ± 9.0) in , while contradicting to another study conducted by Pujades-Rodríguez et al.  with only 40% (mean age = 69.3 ± 10.03) were male in patients with COPD.
3.3.1. Effects of OCS and ICS on Fracture
OCS was reported to be associated with an increased dose-response risk of fracture or osteoporosis in patients with chronic respiratory disease  and patients with asthma . Long-term use of OCS may also induce other adverse effects; for example, it was reported that morbidity rates for patients with severe asthma comorbid with other diseases, such as type-2 diabetes, dyspeptic disorder, and cataract, prescribed with higher OCS dose were significantly higher than those with mild/moderate asthma. Glucocorticoid highly decreases bone formation by inhibiting cell differentiation, and increasing apoptosis might be the mechanism causing such an effect . Consistent to previous investigations, our study showed that the cumulative doses of OCS and ICS were significantly higher for patients with fracture than those without fracture, indicating the dose-response effects (Tables 5 and 6). Whether ICS use is associated with osteoporosis or fracture is still controversial. Some previous studies supported that ICS use increased the risk of fracture in patients with COPD [13–15] and patients with asthma , while others were against the above conclusion in COPD [65, 69] and asthma . Differences in study design, duration of ICS use and cumulative dose, and frequency of systemic OCS prescriptions might be the reason causing such controversy .
The effect of corticosteroid use remains controversial. It was reported that corticosteroid use may increase the risk of fracture for patients with COPD [13–15]. However, a recent study reported that COPD was an independent risk factor for osteoporosis and fracture regardless of ICS use . Moreover, cumulative ICS was reported not to increase the risk of fracture hospitalization . Surprisingly, one study even showed that female COPD patients with ICS therapy exhibited dose-response protective effect on osteoporosis . Similar controversy was also found in asthma. Monadi et al.  noted that the BMD in both the spinal cord and hip of asthma patients less than 50 years old under 6.5 years of treatment decreased significantly compared to the controls. On the other hand, Loke et al.  found that long-term use (≥12 months) of ICS in patients with asthma was not significantly associated with fracture and bone mineral density. Such controversies might be caused by differences in study design, duration of ICS use and cumulative dose, and frequency of systemic OCS prescriptions . Frequent OCS administration may significantly increase the risk of osteoporosis and fracture. Investigations of ICS administration and osteoporosis or fracture for patients with noncystic fibrosis bronchiectasis are scant. It was reported that osteoporosis and osteopenia were prevalent in patients with bronchiectasis [74–76], which might be attributed to the intakes of proton pump inhibitor or inhaled corticosteroids although it was also associated with increased age and female gender .
3.3.2. Prevalence of Fracture in Patients with Chronic Respiratory Disease Receiving OCS and ICS Therapy
Table 4 compares the prevalence of asthma (60.6% versus 68.2%, ), COPD (64.7% versus 51.6%, ), and bronchiectasis (5.8% versus 4.7%, ) for patients with and without fracture receiving OCS and ICS. It was noted that the prevalence of asthma in patients with fracture was significantly lower than those without fracture, while COPD was more prevalent in patients with fracture than those without fracture. With regard to bronchiectasis, although it was more prevalent in patients with fracture, but not reaching significance, the inconsistency might be caused by a difficulty in differentiating skeletal effects of corticosteroid medications and COPD itself  and symptoms of COPD overlapped with asthma [77, 78] or bronchiectasis [79, 80] for some patients. The mortality rate of bronchiectasis was reported to be as high as 20.4% and increased to 55% if comorbid with COPD .
3.3.3. Comorbidity of Patients with Chronic Respiratory Disease Receiving OCS and ICS Therapy
Diabetes (DM), end-stage renal disease (ESRD), and osteoporosis were shown to be comorbidities for patients with fracture who had been receiving OCS and ICS treatments. As presented in Table 4, the prevalence of DM (14.9% versus 12.4%, ), ESRD (2.8% versus 1.4%, ), and osteoporosis (7.1% versus 3.6%, ) for patients with fracture was significantly higher than those without fracture. Bountiful literatures have shown the associations between diabetes and bone fracture. Forsen et al.  reported that women aged 50–74 years with type 2 diabetes for more than 5 years exhibited higher risk of hip fracture. It was also shown that patients with diabetes presenting diabetic retinopathy, advanced cortical cataract, longer acquired duration, and insulin treatment had higher risk of fracture . Patients with ESRD were noted to have 4.4-fold risk of hip fracture than the general population . Stehman-Breen et al.  reported that age, female, BMI, and peripheral vascular disease were associated with independent factors associated with hip fracture for patients with ESRD. The reason might be that renal osteodystrophy, amyloid, aluminum intoxication, and acidosis commonly found in ESRD patients receiving dialysis increased the risk of bone loss, resulting in hip fracture .
3.3.4. Effectiveness of Clinical Decision Support Systems
Recently, we have conducted a prospective study to verify the effectiveness of a designed CDSS in ventilator weaning  and designed a predictive model for predicting erectile dysfunction using the Taiwan National Health Insurance Database . For predicting successful ventilator weaning, a predictive sensitivity of 87.7% has been achieved by using CDSS, which is significantly higher () than the weaning determined by physicians (sensitivity: 61.4%). Furthermore, the days using mechanical ventilator for the study group (38.41 ± 3.35) are significantly () shorter than the control group (43.69 ± 14.89), with a decrease of 5.2 days in average, resulting in a saving of healthcare cost of NT$45,000 (US$1500) per patient in the current Taiwanese National Health Insurance setting . The CDSS was demonstrated to be effective in identifying the earliest time of ventilator weaning for patients to resume and sustain spontaneous breathing, thereby avoiding unnecessary prolonged ventilator use and decreasing healthcare cost.
The CDSS for predicting ventilator weaning was designed based on the datasets collected in respiratory care centers which were more balanced; in contrast, the dataset adopted in this study was retrieved from NHIRD and was highly imbalanced. As shown in Table 2, although the CDSSs designed with our proposed method outperform the other methods , the performance is only fair with the accuracy, sensitivity, and specificity all lower than 70% and AUC smaller or a little greater than 0.7. As indicated in Table 7, CDSSs designed with integrated GA and SVM using different undersampling methods for obtaining balanced training sets and applying objective functions for tuning SVM parameters and selecting salient feature exhibit similar and satisfactory predictive performance with AUCs approximate to 0.75.
Although reaching statistically significant difference () between fracture and nonfracture groups (Table 4), the variables regarding respiratory diseases (asthma and COPD) and other comorbidities (DM, ESRD, and osteoporosis) were not selected for designing the CDSSs. Moreover, as shown in Table 8, OCS and ICS variables, such as ICS_followup_days and ICS_exposed_days, which are statistically dependent with each other were selected. As argued in , filter methods like statistical analysis, F score, and entropy were not good at selecting salient features for CDSS design. Additionally, variables which are highly correlated can be used together to enforce the predictive performance of the CDSS .
Patients who had been prescribed with ICS might also be prescribed with oral corticosteroid (OCS) because of intermittent exacerbations. OCS administrated for treating acute exacerbation may have stronger effect than ICS on osteoporosis and fracture. Moreover, previous studies mainly focused on the effects of ICS on osteoporosis or fracture for patients with asthma and COPD, respectively. The effect of ICS on osteoporosis or fracture for patients with asthma-COPD and bronchiectasis-COPD overlap syndromes should also be considered. Future works will account for the effect of accumulated OCS and ICS dose, not just OCS or ICS dose, on osteoporosis or fracture. Patients with asthma-COPD overlap syndrome and bronchiectasis-COPD overlap syndromes will be separately considered for investigating the effect of OCS and ICS on fracture.
Based on the analytical results, it was concluded that long-term use of inhaled corticosteroids may induce osteoporosis and exhibit higher incidence of hip or vertebrate fractures. The designed CDSSs exhibited satisfactory performance in the prediction of fractures for patients who were prescribed with corticosteroids. We suggested that the accumulated dose of ICS and OCS therapies should be continuously monitored to prevent from exceeding the maximum dosage, especially for patients with older age and women after menopause.
Conflicts of Interest
The authors declare that there is no competing interest.
Yung-Fu Chen and Chih-Sheng Lin contributed equally to this work.
This work was supported in part by the Fulbright Foundation for scholarly exchange (Program no. G-1-00005) and Ministry of Science and Technology, Taiwan (Grant nos. MOST 105-2410-H-166-006, MOST 106-2410-H-166-004, and MOST 107-2918-I-166-001) for Yung-Fu Chen.
- World Health Organization, “Chronic Respiratory Diseases,” August 2017, http://www.who.int/respiratory/en/.
- World Health Organization, “Global surveillance, prevention and control of chronic respiratory diseases: a comprehensive approach,” Tech. Rep., World Health Organization, Geneva, Switzerland, 2013.
- T. Ferkol and D. Schraufnagel, “The global burden of respiratory disease,” Annals of the American Thoracic Society, vol. 11, no. 3, pp. 404–406, 2014.
- R. Lozano, M. Naghavi, K. Foreman et al., “Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010,” The Lancet, vol. 380, no. 9859, pp. 2095–2128, 2012.
- World Health Organization, “Chronic respiratory diseases, asthma,” August 2017, http://www.who.int/respiratory/asthma/en/.
- D. Weycker, J. Edelsberg, G. Oster, and G. Tino, “Prevalence and economic burden of bronchiectasis,” Clinical Pulmonary Medicine, vol. 12, no. 4, pp. 205–209, 2005.
- A. E. Seitz, K. N. Olivier, J. Adjemian, S. M. Holland, and D. R. Prevots, “Trends in bronchiectasis among medicare beneficiaries in the United States, 2000 to 2007,” Chest, vol. 142, no. 2, pp. 432–439, 2012.
- S. P. Bhatt and M. T. Dransfield, “Chronic obstructive pulmonary disease and cardiovascular disease,” Translational Research, vol. 162, no. 4, pp. 237–251, 2013.
- N. A. Negewo, P. G. Gibson, and V. M. McDonald, “COPD and its comorbidities: impact, measurement and mechanisms,” Respirology, vol. 20, no. 8, pp. 1160–1171, 2015.
- World Health Organization, “Chronic respiratory diseases, chronic obstructive pulmonary disease (COPD),” August 2017, http://www.who.int/respiratory/copd/en/.
- R. J. Boyton, “Bronchiectasis,” Medicine, vol. 40, no. 5, pp. 267–272, 2012.
- Global Initiative for Asthma, “Global strategy for asthma management and prevention,” 2016, http://ginasthma.org/wp-content/uploads/2016/04/wms-GINA-2016-main-report-final.pdf.
- S.-W. Huang, W.-T. Wang, L.-C. Chou, H.-C. Chen, T.-H. Liou, and H.-W. Lin, “Chronic obstructive pulmonary disease increases the risk of hip fracture: a nationwide population-based cohort study,” Scientific Reports, vol. 6, no. 1, article 23360, 2016.
- Y. K. Loke, R. Cavallazzi, and S. Singh, “Risk of fractures with inhaled corticosteroids in COPD: systematic review and meta-analysis of randomised controlled trials and observational studies,” Thorax, vol. 66, no. 8, pp. 699–708, 2011.
- M. Pujades-Rodriguez, C. J. P. Smith, and R. B. Hubbard, “Inhaled corticosteroids and the risk of fracture in chronic obstructive pulmonary disease,” QJM, vol. 100, no. 8, pp. 509–517, 2007.
- A. X. Garg, N. K. J. Adhikari, H. McDonald et al., “Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review,” JAMA, vol. 293, no. 10, pp. 1223–1238, 2005.
- T. Porat, O. Kostopoulou, A. Woolley, and B. C. Delaney, “Eliciting user decision requirements for designing computerized diagnostic support for family physicians,” Journal of Cognitive Engineering and Decision Making, vol. 10, no. 1, pp. 57–73, 2016.
- S. Horng, D. A. Sontag, Y. Halpern, Y. Jernite, N. I. Shapiro, and L. A. Nathanson, “Creating an automated trigger for sepsis clinical decision support at emergency department triage using machine learning,” PLoS One, vol. 12, no. 4, article e0174708, 2017.
- J.-C. Hsu, Y.-F. Chen, W.-S. Chung, T.-H. Tan, T. Chen, and J. Y. Chiang, “Clinical verification of a clinical decision support system for ventilator weaning,” BioMedical Engineering Online, vol. 12, article S4, Supplement 1, 2013.
- G. Luo, F. L. Nkoy, P. H. Gesteland, T. S. Glasgow, and B. L. Stone, “A systematic review of predictive modeling for bronchiolitis,” International Journal of Medical Informatics, vol. 83, no. 10, pp. 691–714, 2014.
- K. Dunn Lopez, S. M. Gephart, R. Raszewski, V. Sousa, L. E. Shehorn, and J. Abraham, “Integrative review of clinical decision support for registered nurses in acute care settings,” Journal of the American Medical Informatics Association, vol. 24, no. 2, pp. 441–450, 2017.
- A.-M. J. Scheepers-Hoeks, R. J. Grouls, C. Neef, E. W. Ackerman, and E. H. Korsten, “Physicians’ responses to clinical decision support on an intensive care unit—comparison of four different alerting methods,” Artificial Intelligence in Medicine, vol. 59, no. 1, pp. 33–38, 2013.
- T. Oluoch, A. Katana, D. Kwaro et al., “Effect of a clinical decision support system on early action on immunological treatment failure in patients with HIV in Kenya: a cluster randomised controlled trial,” The Lancet HIV, vol. 3, no. 2, pp. e76–e84, 2016.
- A. K. Otto, A. A. Dyer, C. M. Warren, M. Walkner, B. M. Smith, and R. S. Gupta, “The development of a clinical decision support system for the management of pediatric food allergy,” Clinical Pediatrics, vol. 56, no. 6, pp. 571–578, 2017.
- E. Ammenwerth, P. Schnell-Inderst, C. Machan, and U. Siebert, “The effect of electronic prescribing on medication errors and adverse drug events: a systematic review,” Journal of the American Medical Informatics Association, vol. 15, no. 5, pp. 585–600, 2008.
- F. Baypinar, H. J. Kingma, R. T. M. van der Hoeven, and M. L. Becker, “Physicians’ compliance with a clinical decision support system alerting during the prescribing process,” Journal of Medical Systems, vol. 41, no. 6, p. 96, 2017.
- C. C. Chang, C. C. Liao, and T. L. Chen, “Perioperative medicine and Taiwan National Health Insurance Research Database,” Acta Anaesthesiologica Taiwanica, vol. 54, no. 3, pp. 93–96, 2016.
- C.-L. Cheng, Y.-H. Y. Kao, S.-J. Lin, C.-H. Lee, and M. L. Lai, “Validation of the National Health Insurance Research Database with ischemic stroke cases in Taiwan,” Pharmacoepidemiology & Drug Safety, vol. 20, no. 3, pp. 236–242, 2011.
- W.-S. Chung, Y.-F. Chen, J.-C. Hsu, W.-T. Yang, S.-C. Chen, and J. Y. Chiang, “Inhaled corticosteroids and the increased risk of pulmonary tuberculosis: a population-based case–control study,” International Journal of Clinical Practice, vol. 68, no. 10, pp. 1193–1199, 2014.
- H.-H. Lin, F.-M. Ho, Y.-F. Chen, C.-M. Tseng, C.-C. Ho, and W.-S. Chung, “Increased risk of erectile dysfunction among patients with sleep disorders: a nationwide population-based cohort study,” International Journal of Clinical Practice, vol. 69, no. 8, pp. 846–852, 2015.
- Y. F. Chen, H. H. Lin, C. C. Lu et al., “Gout and a subsequent increased risk of erectile dysfunction in men aged 64 and under: a nationwide cohort study in Taiwan,” The Journal of Rheumatology, vol. 42, no. 10, pp. 1898–1905, 2015.
- Y.-F. Chen, H.-H. Lin, C.-S. Lin, B. Turbat, K.-A. Wang, and W.-S. Chung, “Bronchiectasis and increased risk of ischemic stroke: a nationwide population-based cohort study,” International Journal of Chronic Obstructive Pulmonary Disease, vol. Volume 12, pp. 1375–1383, 2017.
- M. Kubat, R. C. Holte, and S. Matwin, “Machine learning for the detection of oil spills in satellite radar images,” Machine Learning, vol. 30, no. 2-3, pp. 195–215, 1998.
- F. Sebastiani, “Machine learning in automated text categorization,” ACM Computing Surveys, vol. 34, no. 1, pp. 1–47, 2002.
- J. Perols, “Financial statement fraud detection: an analysis of statistical and machine learning algorithms,” AUDITING: A Journal of Practice & Theory, vol. 30, no. 2, pp. 19–50, 2011.
- Y. J. Kim, B. Baik, and S. Cho, “Detecting financial misstatements with fraud intention using multi-class cost-sensitive learning,” Expert Systems with Applications, vol. 62, pp. 32–43, 2016.
- B. Zhu, Y. Niu, J. Xiao, and B. Baesens, “A new transferred feature selection algorithm for customer identification,” Neural Computing and Applications, vol. 28, no. 9, pp. 2593–2603, 2017.
- I. Kononenko, “Machine learning for medical diagnosis: history, state of the art and perspective,” Artificial Intelligence in Medicine, vol. 23, no. 1, pp. 89–109, 2001.
- P. H. Abreu, M. S. Santos, M. H. Abreu, B. Andrade, and D. C. Silva, “Predicting breast cancer recurrence using machine learning techniques: a systematic review,” ACM Computing Surveys, vol. 49, no. 3, pp. 1–40, 2016.
- M. A. H. Farquad and I. Bose, “Preprocessing unbalanced data using support vector machine,” Decision Support Systems, vol. 53, no. 1, pp. 226–233, 2012.
- J. Hu, H. Yang, M. R. Lyu, I. King, and A. M. C. So, “Online nonlinear AUC maximization for imbalanced data sets,” IEEE Transactions on Neural Networks and Learning Systems, vol. PP, no. 99, pp. 1–14, 2017.
- S. Piri, D. Delen, and T. Liu, “A synthetic informative minority over-sampling (SIMO) algorithm leveraging support vector machine to enhance learning from imbalanced datasets,” Decision Support Systems, vol. 106, pp. 15–29, 2018.
- M. Kubat and S. Matwin, “Addressing the curse of imbalanced training sets: one-sided selection,” In ICML, vol. 97, pp. 179–186, 1997.
- X. Y. Liu, J. Wu, and Z. H. Zhou, “Exploratory undersampling for class-imbalance learning,” IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 39, no. 2, pp. 539–550, 2009.
- D. Devi, S. Biswas, and B. Purkayastha, “Redundancy-driven modified Tomek-link based undersampling: a solution to class imbalance,” Pattern Recognition Letters, vol. 93, pp. 3–12, 2017.
- N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: synthetic minority over-sampling technique,” Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2002.
- H. Han, W. Y. Wang, and B. H. Mao, “Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning,” in Advances in Intelligent Computing, pp. 878–887, Springer, Berlin, Heidelberg, 2005.
- C. Bunkhumpornpat, K. Sinapiromsaran, and C. Lursinsap, “Safe-level-SMOTE: safe-level-synthetic minority over-sampling technique for handling the class imbalanced problem,” in Advances in Knowledge Discovery and Data Mining, T. Theeramunkong, B. Kijsirikul, N. Cercone, and T.-B. Ho, Eds., pp. 475–482, Springer, Berlin, Heidelberg, 2009.
- D. A. Cieslak, N. V. Chawla, and A. Striegel, “Combating imbalance in network intrusion datasets,” in 2006 IEEE International Conference on Granular Computing, pp. 732–737, Atlanta, GA, USA, 2006.
- C. Jian, J. Gao, and Y. Ao, “A new sampling method for classifying imbalanced data based on support vector machine ensemble,” Neurocomputing, vol. 193, pp. 115–122, 2016.
- K. A. Wang, Y. F. Chen, L. O. A. Rahman, H. H. Lin, and W. S. Chung, “Using Taiwan NHIRD for studying the effect of inhaled corticosteroids on fracture,” in 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 2667–2671, Banff, AB, Canada, October 2017.
- W.-C. Lin, C.-F. Tsai, Y.-H. Hu, and J.-S. Jhang, “Clustering-based undersampling in class-imbalanced data,” Information Sciences, vol. 409-410, pp. 17–26, 2017.
- Y.-F. Chen, P.-C. Huang, K.-C. Lin et al., “Semi-automatic segmentation and classification of pap smear cells,” IEEE Journal of Biomedical and Health Informatics, vol. 18, no. 1, pp. 94–108, 2014.
- “Breast Cancer Wisconsin (Diagnostic) Data Set,” https://archive.ics.uci.edu/ml/datasets/Breast+Cancer+Wisconsin+%28Diagnostic%29.
- C. Cingi, P. Gevaert, R. Mösges et al., “Multi-morbidities of allergic rhinitis in adults: European Academy of Allergy and Clinical Immunology task force report,” Clinical and Translational Allergy, vol. 7, no. 1, p. 17, 2017.
- P. Ernst, M. Baltzan, J. Deschênes, and S. Suissa, “Low-dose inhaled and nasal corticosteroid use and the risk of cataracts,” European Respiratory Journal, vol. 27, no. 6, pp. 1168–1174, 2006.
- D. P. Skoner, G. S. Rachelefsky, E. O. Meltzer et al., “Detection of growth suppression in children during treatment with intranasal beclomethasone dipropionate,” Pediatrics, vol. 105, no. 2, article e23, 2000.
- L. Agertoft and S. Pedersen, “Effect of long-term treatment with inhaled budesonide on adult height in children with asthma,” The New England Journal of Medicine, vol. 343, no. 15, pp. 1064–1069, 2000.
- T. McKeever, T. W. Harrison, R. Hubbard, and D. Shaw, “Inhaled corticosteroids and the risk of pneumonia in people with asthma: a case-control study,” Chest, vol. 144, no. 6, pp. 1788–1794, 2013.
- H. W. Kelly, A. L. Sternberg, R. Lescher et al., “Effect of inhaled glucocorticoids in childhood on adult height,” The New England Journal of Medicine, vol. 367, no. 10, pp. 904–912, 2012.
- K. M. Kew and A. Seniukovich, “Inhaled steroids and risk of pneumonia for chronic obstructive pulmonary disease,” Cochrane Database of Systematic Reviews, no. 3, article CD010115, 2014.
- Y.-H. Dong, C.-H. Chang, F.-L. L. Wu et al., “Use of inhaled corticosteroids in patients with COPD and the risk of TB and influenza: a systematic review and meta-analysis of randomized controlled trials,” Chest, vol. 145, no. 6, pp. 1286–1297, 2014.
- T. A. Lee and K. B. Weiss, “Fracture risk associated with inhaled corticosteroid use in chronic obstructive pulmonary disease,” American Journal of Respiratory and Critical Care Medicine, vol. 169, no. 7, pp. 855–859, 2004.
- J. D. Jaramillo, C. Wilson, D. S. Stinson et al., “Reduced bone density and vertebral fractures in smokers. Men and COPD patients at increased risk,” Annals of the American Thoracic Society, vol. 12, no. 5, pp. 648–656, 2015.
- P. Vestergaard, L. Rejnmark, and L. Mosekilde, “Fracture risk in patients with chronic lung diseases treated with bronchodilator drugs and inhaled and oral corticosteroids,” Chest, vol. 132, no. 5, pp. 1599–1607, 2007.
- P. Li, L. Ghazala, E. Wright, J. Beach, D. Morrish, and D. Vethanayagam, “Prevalence of osteopenia and osteoporosis in patients with moderate to severe asthma in western Canada,” Clinical and Investigative Medicine, vol. 38, no. 2, pp. E23–E30, 2015.
- S. A. Sutter and E. M. Stein, “The skeletal effects of inhaled glucocorticoids,” Current Osteoporosis Reports, vol. 14, no. 3, pp. 106–113, 2016.
- M. Monadi, Y. Javadian, M. Cheraghi, B. Heidari, and M. Amiri, “Impact of treatment with inhaled corticosteroids on bone mineral density of patients with asthma: related with age,” Osteoporosis International, vol. 26, no. 7, pp. 2013–2018, 2015.
- S.-F. Liu, H.-C. Kuo, G.-H. Liu et al., “Inhaled corticosteroids can reduce osteoporosis in female patients with COPD,” International Journal of Chronic Obstructive Pulmonary Disease, vol. 11, pp. 1607–1614, 2016.
- Y. K. Loke, D. Gilbert, M. Thavarajah, P. Blanco, and A. M. Wilson, “Bone mineral density and fracture risk with long-term use of inhaled corticosteroids in patients with asthma: systematic review and meta-analysis,” BMJ Open, vol. 5, no. 11, article e008554, 2015.
- S. A. Aljubran, G. J. Whelan, M. C. Glaum, and R. F. Lockey, “Osteoporosis in the at-risk asthmatic,” Allergy, vol. 69, no. 11, pp. 1429–1439, 2014.
- S. J. Chen, W. C. Liao, K. H. Huang et al., “Chronic obstructive pulmonary disease and allied conditions is a strong independent risk factor for osteoporosis and pathologic fractures: a population-based cohort study,” QJM, vol. 108, no. 8, pp. 633–640, 2015.
- R. W. Flynn, T. M. MacDonald, A. Hapca, I. S. MacKenzie, and S. Schembri, “Quantifying the real life risk profile of inhaled corticosteroids in COPD by record linkage analysis,” Respiratory Research, vol. 15, no. 1, p. 141, 2014.
- R. K. Dave, A. C. Arroliga, and M. Prince-Fiocco, “Osteoporosis and osteopenia in patients with non-cystic fibrosis (non-CF) bronchiectasis,” Chest, vol. 136, no. 4, p. 9S, 2009.
- S. S. Sunny, A. Burns, H. Jary, T. Aspray, and A. De Soyza, “P90 osteoporosis in non-cystic fibrosis bronchiectasis (NCFBr) adults,” Thorax, vol. 67, Supplement 2, pp. A102.3–A1A103, 2012.
- N. Diehl and M. M. Johnson, “Prevalence of osteopenia and osteoporosis in patients with noncystic fibrosis bronchiectasis,” Southern Medical Journal, vol. 109, no. 12, pp. 779–783, 2016.
- M. J. Abramson, J. L. Perret, S. C. Dharmage, V. M. McDonald, and C. F. McDonald, “Distinguishing adult-onset asthma from COPD: a review and a new approach,” International Journal of Chronic Obstructive Pulmonary Disease, vol. 9, pp. 945–962, 2014.
- D. S. Postma and K. F. Rabe, “The asthma–COPD overlap syndrome,” The New England Journal of Medicine, vol. 373, no. 13, pp. 1241–1249, 2015.
- J. R. Hurst, J. S. Elborn, A. de Soyza, and BRONCH-UK Consortium, “COPD–bronchiectasis overlap syndrome,” European Respiratory Journal, vol. 45, no. 2, pp. 310–313, 2015.
- M. Á. Martínez-Garcia, M. J. Selma-Ferrer, C. Navarro-Soriano, and A. Muñoz-Reina, “Bronchiectasis phenotype in COPD patients,” Clinical Pulmonary Medicine, vol. 22, no. 3, pp. 123–127, 2015.
- P. C. Goeminne, T. S. Nawrot, D. Ruttens, S. Seys, and L. J. Dupont, “Mortality in non-cystic fibrosis bronchiectasis: a prospective cohort analysis,” Respiratory Medicine, vol. 108, no. 2, pp. 287–296, 2014.
- L. Forsen, H. E. Meyer, K. Midthjell, and T. H. Edna, “Diabetes mellitus and the incidence of hip fracture: results from the Nord-Trøndelag Health Survey,” Diabetologia, vol. 42, no. 8, pp. 920–925, 1999.
- R. Q. Ivers, R. G. Cumming, P. Mitchell, A. J. Peduto, and Blue Mountains Eye Study, “Diabetes and risk of fracture: the Blue Mountains Eye Study,” Diabetes Care, vol. 24, no. 7, pp. 1198–1203, 2001.
- A. M. Alem, D. J. Sherrard, D. L. Gillen et al., “Increased risk of hip fracture among patients with end-stage renal disease,” Kidney International, vol. 58, no. 1, pp. 396–399, 2000.
- C. O. Stehman-Breen, D. J. Sherrard, A. M. Alem et al., “Risk factors for hip fracture among patients with end-stage renal disease,” Kidney International, vol. 58, no. 5, pp. 2200–2205, 2000.
- H. H. Lin, P. C. Chan, M. H. Lee et al., “Decision support systems for predicting erectile dysfunction,” in Proceedings of the International Conference on Computer Networks and Communication Technology (CNCT 2016), pp. 606–612, Xiamen, China, 2016.
Copyright © 2018 Yung-Fu Chen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.