- About this Journal
- Abstracting and Indexing
- Aims and Scope
- Annual Issues
- Article Processing Charges
- Articles in Press
- Author Guidelines
- Bibliographic Information
- Citations to this Journal
- Contact Information
- Editorial Board
- Editorial Workflow
- Free eTOC Alerts
- Publication Ethics
- Reviewers Acknowledgment
- Submit a Manuscript
- Subscription Information
- Table of Contents
The Scientific World Journal
Volume 2014 (2014), Article ID 327306, 14 pages
Rule-Based Knowledge Acquisition Method for Promoter Prediction in Human and Drosophila Species
1Department of Management Information System, Asia Pacific Institute of Creativity, Miaoli 351, Taiwan
2School of Pharmacy, College of Pharmacy, Kaohsiung Medical University, Kaohsiung 807, Taiwan
3Institute of Bioinformatics and Systems Biology, National Chiao Tung University, Hsinchu 300, Taiwan
4Department of Biological Science and Technology, National Chiao Tung University, Hsinchu 300, Taiwan
Received 31 August 2013; Accepted 10 October 2013; Published 29 January 2014
Academic Editors: L. Bao and J. Wang
Copyright © 2014 Wen-Lin Huang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
The rapid and reliable identification of promoter regions is important when the number of genomes to be sequenced is increasing very speedily. Various methods have been developed but few methods investigate the effectiveness of sequence-based features in promoter prediction. This study proposes a knowledge acquisition method (named PromHD) based on if-then rules for promoter prediction in human and Drosophila species. PromHD utilizes an effective feature-mining algorithm and a reference feature set of 167 DNA sequence descriptors (DNASDs), comprising three descriptors of physicochemical properties (absorption maxima, molecular weight, and molar absorption coefficient), 128 top-ranked descriptors of 4-mer motifs, and 36 global sequence descriptors. PromHD identifies two feature subsets with 99 and 74 DNASDs and yields test accuracies of 96.4% and 97.5% in human and Drosophila species, respectively. Based on the 99- and 74-dimensional feature vectors, PromHD generates several if-then rules by using the decision tree mechanism for promoter prediction. The top-ranked informative rules with high certainty grades reveal that the global sequence descriptor, the length of nucleotide A at the first position of the sequence, and two physicochemical properties, absorption maxima and molecular weight, are effective in distinguishing promoters from non-promoters in human and Drosophila species, respectively.
Gene expression is often regulated by the transcription rate, which is largely controlled by the binding of RNA polymerase II (Pol II) to the regulatory regions of DNA sequences in eukaryotic cells . The regulatory regions (called promoters) that contain a transcription factor binding site and a TATA box are immediately upstream of transcription start sites at which transcription factors and Pol II are accumulated to initiate the transcription (Figure 1) [2, 3]. Promoters are extremely diverse and difficult to identify experimentally using specific sequence patterns or motifs [3, 4]. Therefore, the identification of promoters is very challenging, especially in the sequencing of eukaryotic genomes. Some methods for predicting promoters have been developed, and these methods may be categorized into the following four classes according their types of sequence features (see Table 1).(1)Context-Feature Class. Context features are contents of the documents that are represented by basic unit DNA words called k-mer motifs (k-base-long nucleotide sequences) . Besides k-mer frequency, some features based on k-mer motifs are also used in promoter prediction including transition , distribution , entropy density profile (EPD) , codon-position-independent frequencies of mononucleotides [6, 7], digitized DNA sequence , position-specific propensity [9, 10], relative entropy , and flanking genomic sequence .(2)Signal-Feature Class. Powerful biological signals contain core-promoter elements , some short modular transcription factor binding sites , and CpG islands [13, 14]. The core-promoter elements that play important roles in the assembly of transcriptional machinery contain the TATA box, the exons region [15, 16], the intron region (initiator sequences), [15, 17–19], downstream promoter elements , a TFIIB recognition element , motif ten element , and CCAAT box [19, 22, 23]. The TATA box, initiator sequences, and consensus sequences for transcription factor binding sites are often used in various promoter recognition methods . However, these features have been confirmed to exist only in a small proportion of all human promoters [25, 26].(3)Structure-Feature Class. Many physical and structural properties of DNA sequences are estimated. They include DNA curvature , flexibility [22, 23], denaturation values [28, 29], base stacking energy [16, 28], stabilizing energy of Z-DNA , Z-DNA , and radical cleavage intensity [28, 32]. In particular, McPromoter  is a probabilistic promoter predictor that uses a neural network to combine the sequence features and structural profiles, such as those of DNA bend ability or GC structure, in promoter prediction.(4)Epigenetic-Feature Class. Few promoter prediction methods utilize epigenetic information [22, 33]. For example, HMM-SA is a supervised learning method for predicting promoters and enhancers from their unique chromatin modification signatures . Similarly, CoreBoost_HM systematically analyzes different chromatin features for promoter prediction .
Table 2 lists some representative methods that use the above four types of features in combination with effective classifiers to predict promoters. These classifiers involve Fisher's linear discriminant algorithm , the hidden Markov model [22, 23], the AdaBoost algorithm , decision trees , relevance vector machines , the expectation maximization algorithm [35, 36], artificial neural networks [12, 15, 17, 19, 29, 37], support vector machines (SVM) [38, 39], artificial immune recognition systems , and others. Recently, the use of ensemble classifiers has become popular in promoter prediction systems. For example, CoreBoost  and CoreBoost_HM  used ensemble classifiers to improve prediction performance. These methods apply boosting techniques with stumps to extract sequence features, including the core-promoter elements score, transcription factor binding site density, the DNA flexibility of promoter sequences, Markovian log-likelihood ratio scores, k-mer frequencies, and epigenetic features.
Even though many promoter prediction methods have been developed, the effectiveness of used features in identifying promoters still needs to be explored. However, accurate promoter prediction relies largely on feature extraction and model selection . Currently, Prom-Machine  simply selected 128 four-mer motifs and then utilized these motifs in conjunction with SVM to improve prediction sensitivity and specificity toward the DNA sequences of the five following species: plants, Drosophila, human, mouse, and rat. Additionally, one recently published method, FSPP , used both filter and wrapper algorithms to select effective feature subsets from 13 kinds of structural features, including DNA-bending stiffness, duplex free energy, and duplex disrupt energy to improve further the sensitivity and accuracy of promoter prediction. Our previous method, ProPolyII , selects a small number of sequence-based features to improve prediction performance in human species.
These methods motivate this work to focus on feature selection and effectiveness evaluation of the selected features in promoter prediction. This work presents a knowledge acquisition method (named PromHD) based on if-then rules for promoter prediction in human and Drosophila species. The knowledge can be revealed from three aspects: (1) identified informative DNA sequence descriptors (DNASDs), (2) rules of distinguishing promoter from nonpromoter, and (3) further analysis of distinguishable mechanism using DNASDs. PromHD utilizes a reference feature set of 167 DNASDs, comprising three descriptors of physicochemical properties (absorption maxima, molecular weight, and molar absorption coefficient) [43, 44] with 128 top-ranked frequency descriptors of 4-mer motifs and 36 global sequence descriptors. To the best of our knowledge, these three descriptors of physicochemical properties are used herein for the first time in identifying promoter DNA sequences and their sequence-based representation differs from the structural profiles of McPromoter . The 128 top-ranked frequency descriptors of 4-mer motifs are extracted from 256 4-mer combinations of nucleotides (4-base-long nucleotide sequences) according to the scores that equal the difference between the occurrence frequencies of the 4-mer motif in the positive and negative datasets [45, 46]. PromHD further utilizes an effective feature mining algorithm (called DNASDmining), which is based on an inheritable biobjective genetic algorithm [47, 48], to mine informative DNASDs.
A total of 1871 human and 1926 Drosophila promoter sequences were downloaded from the Eukaryotic Promoter Database , which is a database containing over 4800 promoters from various species. The same numbers of nonpromoters in human and Drosophila species were collected to evaluate the proposed PromHD method. Accordingly, PromHD identifies two subsets of 99 and 74 DNASDs and yields test accuracies of 96.4% and 97.5% in human and Drosophila species, respectively, which are better than those of SVM-4mer (91.0% and 94.6%) and SVM-GSD (93.6% and 89.2%), respectively. Based on each of the 99- and 74-dimensional feature vector, PromHD uses the decision tree method C5.0  to generate several if-then rules. The top-ranked rules reveal that the global sequence descriptor, the length of nucleotide A at the first position of the sequence, is efficient in distinguishing human promoters from nonpromoters, consistent with the findings of Wang et al. and Zhao et al. [22, 23]. Alternatively, the top-ranked rules in Drosophila species reveal that two physicochemical properties, absorption maxima and molecular weight, are effective in distinguishing promoters from nonpromoters. Further analysis of the two feature subsets shows that 32 features are common including three physicochemical properties, 14 descriptors of 4-mer motifs, and 15 global sequence descriptors. When the three descriptors of physicochemical properties are excluded, PromHD with the remaining and DNASD features yield test accuracies of 94.4% and 95.5% in human and Drosophila test datasets, respectively. The prediction accuracies fall by 2.0% and , reconfirming the three physicochemical properties are obviously effective in distinguishing promoters from nonpromoters in human and Drosophila species. The promoter prediction system by using the PromHD method has been implemented at http://iclab.life.nctu.edu.tw/promhd.
2. Materials and Methods
In this work, a block diagram is used to illustrate the main components of the proposed PromHD method. Figure 2 presents five main components, which are datasets, DNA sequence descriptors, DNASDmining algorithm, estimating appearance-frequency ratios, and the PromHD prediction system.
More than 4800 eukaryotic Pol II promoters from many species have been collected in the Eukaryotic Promoter Database (http://epd.vital-it.ch) in May 2013 , in which the transcription start site was determined experimentally and the numbers of promoters in the human and Drosophila species greatly exceed those in other species. Therefore, two datasets, HP (1871 human promoters and 1871 nonpromoters), and DP (1926 Drosophila promoters and 1926 nonpromoters), are established and used in this work to evaluate the proposed PromHD method. Segments of promoter sequences from −200 to relative to a transcription start site  are collected. The nonpromoter sequences are extracted from the EMBL CDS (coding sequences) database (ftp://ftp.ebi.ac.uk/pub/databases/embl/cds/), which is a database of nucleotide coding sequences.
Both of the HP and DP datasets are equally divided into two subsets—one for training (learning) (HPL and DPL) and the other for independent testing (HPT and DPT). The learning dataset is done with the purpose of identifying a small set of DNASDs and finding the best parameters of a SVM to train the complete dataset [57, 58] (see Evaluation Measures). The sequences in the training and test datasets are randomly and near-equally partitioned. The numbers of DNA sequences within promoter and nonpromoter classes are presented in Supplementary Table available online at http://dx.doi.org/10.1155/2014/327306.
2.2. DNA Sequence Descriptors
This work presents a reference feature set of 167 DNA sequence descriptors (DNASDs in Supplementary Material) that comprises three sequence descriptors of physicochemical properties, 128 top-ranked frequency descriptors of 4-mer motifs, and 36 global sequence descriptors. Therefore, a DNA sequence is represented as a 167-dimensional feature vector , where . All of the features of P are rescaled into the range and are employed to SVM (Figure 2). The following three sections describe three subsets of DNASDs with using the sequence CATAGCCATTGCATGACCCG of length 20 as an example (called S20).
2.2.1. Physicochemical Properties of Nucleotides
The physicochemical properties of the DNA structure of eukaryotic genomes are critical to promoter recognition. This study proposes a sequence-based set of three physicochemical properties of nucleotides (http://www.geneinfinity.org) for designing prediction features that are used to distinguish promoters from nonpromoters. The three DNA sequence descriptors, denoted as , , and , are derived from the three physicochemical properties—absorption maxima, molecular weight, and molar absorption coefficient, respectively—by averaging over a nucleotide sequence . The three descriptors are the attributes of the subvector in the reference set of 167 DNASDs.
The sequence S20 has five As, seven Cs, four Gs, and four Ts. With reference to Table 3, the values of the absorption maxima (determined at pH 7.0) for nucleotides A, C, G, and T are 259, 271, 253, and 267, respectively. Accordingly, the descriptor has a value . The other two descriptors and have values 484.95 and 11950, respectively.
2.2.2. Global Sequence Descriptors
The global description of promoter/nonpromoter sequences contains four parts, entropy density profile (EDP), composition, transition, and distribution of DNA nucleotides . The EDP model is a global statistical description for a DNA sequence, based on Shannon's artificial linguistic description for a DNA sequence of finite length . Let be the frequencies of occurrence of nucleotides in a promoter/nonpromoter sequence, where is the index that specifies the nucleotides (A, C, G, T). Six EDPs, , , , , , and , correspond to the six attributes of the subvector , defined as follows: where is the Shannon entropy and is a statistical quantity.
The composition is used to measure the frequency of occurrence of each kind of letters in the sequences, and thus herein it is the in (1). Additionally, the four frequencies are also called 1-mer motifs of the nucleotides (A, T, C, and G), denoted as (A), (T), (C), and (G), and correspond to the four attributes of .
The third part, transition , characterizes the percent frequency with which is followed by or is followed by . The six transition frequencies, (A, C), (A, G), (A, T),(C, G), (C, T), and (G, T), correspond to the six attributes of . For example, for the S20 sequence, there are four transitions of this type (A, C), CATAGCCATTGCATGACCCG in bold style; that is, the value of (A, C) is 21.0526 .
The fourth part of the global description, distribution, measures the chain length within which the first, 25%, 50%, 75%, and 100% of certain type of letters are located, respectively. For example, for the S20 sequence, the first, 25%, 50%, 75%, and 100% of the nucleotide A are located within the second, 4th, 8th, 13th, and 16th nucleotides, respectively. So, the five distributions of the nucleotide A, (A, 1st), (A, 25%), (A, 50%), (A, 75%), and (A, 100%), have values of 10 , 20 , 40 , 65 , and 80 , respectively. A total of 20 distributions corresponding to when four types of nucleotides are considered.
2.2.3. Frequency Descriptors of 4-Mer Motifs
The number of 4-mer combinations of nucleotides (4-base-long nucleotide sequences) is 256. Prom-Machine  uses top 128 of the 256 4-mer motifs to improve prediction sensitivity and specificity. Our earlier works estimated the scores of amino acids  and of GO terms  for predicting DNA-binding proteins and nonclassical secretory proteins, respectively. That motives this work, in which a score for each 4-mer motif is calculated and the 128 top-ranked 4-mer motifs based on those scores are identified. The score is the difference between the occurrence frequencies. A detailed description follows.
Step 1. The occurrence frequencies and are those of the th 4-mer motif in all training promoter (positive) and nonpromoter (negative) sequences, respectively, where . For example, TATA is the 199th 4-mer motif, that is, , and its occurrence frequencies in the positive and negative classes of the HPL dataset are and , respectively (see Table 4).
Step 2. Calculate the total numbers of occurrences of 256 4-mer motifs in the positive and negative classes, and . For example, the total numbers of occurrences of 256 4-mer motifs in the positive and negative classes of the HPL dataset are 29104 and 137017, respectively.
Step 3. The two proportional frequencies of occurrence in the positive and negative classes for each 4-mer motif are the values of and , respectively. For example, the proportional frequencies of occurrence of TATA are 0.002892 and 0.003309 in the positive and negative classes, respectively.
Step 4. The score for each 4-mer motif is the absolute value of the difference between the proportional frequencies of occurrence in the positive class and that in the negative class. For example, the score of TATA is 0.000417 .
Step 5. Normalize scores of all 256 4-mer motif into the range , and represent them as . The normalized score is also called the frequency descriptor of the 4-mer. For instance, the score of TATA motif is 111 (see Table 4).
Step 6. All 256 frequency descriptors are ranked in descending order. The top 128 motifs with descriptors are denoted as and they correspond to . For example, the descriptor of the well-known TATA box, as shown in Table 4, is (TATA) = 111 and corresponds to for the DPL dataset.
2.3. Proposed DNASDmining Algorithm
An efficient feature-mining algorithm, DNASDmining, for identifying a set of informative DNASDs is developed. The DNASDmining algorithm is an expansive version of an inheritable biobjective genetic algorithm, which is based on an intelligent genetic algorithm (called IGA) [47, 61], to identify a small number out of DNASDs. The feature selection is a combinatorial optimization problem Comb with a huge search space of size Comb. The IGA, based on an orthogonal experimental design using a divide-and-conquer strategy and systematic reasoning, can efficiently solve the large combinatorial optimization problem to obtain the solution to Comb. The mechanism can efficiently search for the next solution to Comb by inheriting the last solution . DNASDmining obtains all solutions from to one by one using IGA with the inheritable mechanism [47, 61].
2.3.1. Feature Selection
The input of the DNASDmining algorithm is a training set of DNA sequences that are categorized into two classes—promoter and nonpromoter sequences. The output comprises a set of informative DNASDs and the parameter settings of an SVM classifier. The SVM is a binary classifier of LIBSVM with a radial basis kernel function , where a kernel parameter and a cost parameter are tuned by IGA. In this study, and . The IGA-chromosome comprises binary IGA-genes for selecting informative features and two 4-bit IGA-genes for encoding and , where . The th DNASD feature is used in the SVM classifier if ; otherwise, is excluded . Figure 2 shows the sequence representation and the IGA-chromosome encoding method. Supplementary Table S2 lists the parameter settings of IGA, such as population size . In this algorithm DNASDmining, , , and based on former experience.
Step 1 (initiation). Randomly generate an initial population of individuals. All the binary genes in the individual have 1’s and 0’s where and gen = 0.
Step 2 (evaluation). Evaluate the fitness values fitness of all individuals. The fitness function of this training model is the prediction accuracy of 10-fold cross-validation (see Evaluation Measures) using the SVM classifier with the DNASDs, , and by decoding the IGA-chromosome.
Step 3 (selection). Use the simple ranking selection that replaces the worst individuals by the best individuals to form a new population where is the selection probability.
Step 5 (mutation). Apply the swap mutation operator to the randomly selected individuals in the new population where is the mutation probability. To prevent a decline in the best fitness value, mutation is not applied to the best individual.
Step 6 (termination test). If , then output the best individual as . Otherwise, increase the number gen by one, and go to Step 2.
Step 7 (inheritance). If , then randomly change one bit in the binary genes of each individual from 0 to 1; increase the number by one and let , and go to Step 2.
Step 8 (decoding chromosome). Let be the most accurate solution with selected DNASDs among all solutions Obtain the informative features and values of the parameters and .
2.3.2. Evaluation Measures
The independent dataset test, subsampling or -fold (e.g., 5- or 10-fold) cross-validation test, and the jackknife test are often used to examine the accuracy of a statistical prediction method . The jackknife test is deemed to be the least arbitrary method that can always yield a unique result for a given benchmark dataset . The -fold cross-validation test is used to estimate the error that is involved in the predictions and thus it is also used for model selection . In this work, 10-fold cross-validation scheme is used. Additionally, the independent dataset test is also used in this work to avoid overestimating the success rate of the training model.
Overall accuracy (ACC), sensitivity (SN), and specificity (SP) are three quality measures that are widely used to evaluate the performance of promoter prediction methods . This work also utilizes Matthews correlation coefficient (MCC) to measure the overall performance of the prediction models. It takes into account true and false positives and negatives and is generally regarded as a balanced measure which can be used even if the classes are of very different sizes . These measures are defined as below: TP, TN, FP, and FP stand for true positive, true negative, false positive, and false negative, respectively. The MCC returns a value in the range [−1, 1]. A value of 1 indicates a perfect prediction; 0 indicates a random prediction, and −1 indicates an inverse prediction.
2.4. Estimating the Appearance-Frequency Ratios
A total of experimental runs are executed to obtain the best solution in this work due to the system uncertainty of the IGA-based feature selection algorithm. That means that solutions are generated and each solution comprises a subset of selected DNASDs for . The best solution must have both high prediction accuracy and a high appearance-frequency value. The estimation procedure is further described below.
Step 1. Calculate the appearance-frequency according to (3) for each of DNASDs in all runs. For example, and the descriptor that is the 129th out of 167 DNASDs appears 19 times, so its appearance-frequency .
Step 2. Sum all appearance frequencies to obtain according to (4).
Step 3. Calculate the appearance-frequency for each run, using (5).
Step 4. Calculate the appearance-frequency ratio and the mean value . For instance, Figure 3 displays the mean for the HPL dataset.
Step 5. Select the candidate solutions from the runs whose appearance-frequency ratios are larger than the mean value . For instance, the appearance-frequency ratio for exceeds the mean 47.0%, as shown by Figure 3. Thus, these eight solutions are selected as the candidate solutions.
Step 6. The best solution is the candidate solutions with the highest prediction accuracy. For the above example, the 5th candidate solution having the highest accuracy 98.9% is selected as the best solution of the DNASDmining algorithm, where ,
2.5. PromHD Prediction System
The PromHD prediction system is implemented by using a SVM classifier with a subset of m DNASDs, where the parameter settings of SVM and the value of m are determined in the training phase. Figure 2 illustrates the prediction flowchart of PromHD. The input to this prediction system is a query DNA sequence P. The output is the predicted classpromoter or nonpromoter. The prediction procedure is described as follows.
Step 1. The query DNA sequence is represented as a 167-dimensional DNASD feature vector .
Step 2. The informative DNASDs are selected from P, where and 74 for human and Drosophila DNA sequences, respectively.
Step 3. The selected features are input to the trained SVM to classify P as a promoter or non-promoter.
3. Results and Discussion
3.1. Effectiveness of Informative DNASDs
DNA sequences in this work are represented using 167-dimensional vectors of DNASDs. This work uses an efficient feature selection algorithm not only to select a subset of size from the 167 DNASDs but also to design a SVM-based classifier simultaneously. To determine the candidate solution in the DNASDmining algorithm, the prediction accuracy of 10-CV is used as a fitness function of the IGA. Figure 4 shows the training accuracies of PromHD from to 100 when applied to the HPL dataset and processed the 5th experimental run. These accuracies exceed those of SVM-RBS using SVM with a number of selected informative DNASDs that are selected by the rank-based selection (RBS) method . The RBS method is described below.
Each of the DNASDs was ranked according to the accuracy of the SVM with the estimated single feature, where the best values of parameters were determined using a stepwise approach, where , and . The 100 top-rank features , , were then picked, and the 30 top-ranked features with were used as an initial feature set . Consequently, the feature set with size is incrementally created by adding the best feature (having the highest accuracy of SVM using 10-CV) from the remaining features into the current feature set.
3.2. Comparison of Prediction Performance between PromHD and Other SVM-Based Methods
Two additional SVM-based classifiers, SVM-4mer and SVM-GSD, are applied for comparisons with SVM-RBS. The SVM-4mer and SVM-GSD methods are implemented by using the 128 top-ranked descriptors of 4-mer motifs and 36 global sequence descriptors, respectively, as input features to the SVM classifier without feature selection, respectively. The best values of parameters and that are determined using a stepwise approach are used in the two SVM-based methods, where and .
Tables 5 and 6 compare the three SVM-based methods in terms of performance when applied to the HP and DP datasets, respectively. SVM-GSD obtains the highest testing accuracy of 93.6% for the human species; SVM-4mer performs the best in Drosophila species. However, these testing accuracies are lower than those of PromHD, 98.9% and 96.4%, where and 74 informative features are identified for human and Drosophila species, respectively. Additionally, the testing MCC values of PromHD are 0.927 and 0.949 for HPT and DPT, respectively, which exceed those of SVM-GSD (0.872 and 0.802), SVM-4-mer (0.823 and 0.830), and SVM-RBS (0.840 and 0.660), respectively. PromHD also yields high sensitivity (SN = 0.967 and 0.961) and specificity (SP = 0.960 and 0.988) performances when used with HPT and DPT datasets, respectively.
3.3. Rule-Based Knowledge
This work presents a knowledge acquisition method based on if-then rule for insight of promoter prediction mechanism. The knowledge can be revealed from three aspects: (1) identified informative DNASDs, (2) rules of distinguishing promoters from nonpromoters, and (3) further analysis of distinguishable mechanism using DNASDs. This rule-based knowledge acquisition method uses decision tree method C5.0  to develop if-then rules of the 99- and 74-dimensional DNASD feature vectors in human and Drosophila species. Each if-then rule has two types, one for promoter (Ri-p) and the other for nonpromoter (Ri-n) prediction, where is the rule number index. The selected DNASDs are (A, 1st) (the length of nucleotide A at the first position of the sequence), (C, 100%) (the length of nucleotide C at the last position of the sequence), (GCTC) (the frequency descriptor of 4-mer GCTC), and (the physicochemical property of molecular weight) in human species. Table 7 shows the interpretable rules as follows.
Rules in human species:R1-p:if (A, 1st) 0.0177542, then promoter prediction with CF = 0.928;R2-n:if (A, 1st) 0.0177542, then nonpromoter prediction with CF = 0.999;R3-n:if > 0.284657, (A, 1st) 0.0950018 and (C, 100%) 0.929016, then nonpromoter prediction with CF 0.999;R4-n:if (GCTC) 0.0634629, 0.284657 and (A, 1st) 0.0950018, then nonpromoter prediction with .
The CF is a certainty grade of this rule in the unit interval . The R1-p rule has a certainty grade of 0.928 to predict 935 human promoters by using the (A, 1st) feature. With the same (A, 1st) feature, the second rule, R2-n, with a certainty grade of 0.999 can identify 864 nonpromoters. When applying these two rules, the rule-based classifier yields a prediction accuracy of 96.2%, reconfirming that the global sequence descriptor, the length of nucleotide A at the first position of the sequence, is an efficient feature in distinguishing human promoters from nonpromoters. When adding the third rule, PromHD further enhances the prediction accuracy up to 99.5%. For example, a query sequence P has normalized values of 0.0179, 0.9218, 0.2499, and 0.2823 for (A, 1st), (C, 100%), (GCTC), and , respectively. The classification procedure using the third rule R1-p (0.0179 0.0177542) predicts this query sequence to be a promoter.
Alternatively, the selected DNASDs are (the physicochemical property of molecular weight) and (the physicochemical property of absorption maxima) in Drosophila species. The interpretable rules, as shown in Table 7, are as follows.
Rules in Drosophila species:R1-p:if 0.280113 and > 0.27604, then promoter prediction with CF = 0.997;R2-n:if 0.27604, then nonpromoter prediction with CF = 0.999;R3-n:if 0.280113, then nonpromoter prediction with CF = 0.997.
The rule-based classifier uses the first rule to predict 961 Drosophila promoters. The first two rules make the rule-based classifier have a prediction accuracy of 84.7% in Drosophila species. For example, a query sequence has normalized values of and , 0.4 and 0.3, respectively. The classification procedure using the third rule R3-n 0.280113 predicts this query DNA sequence to be a nonpromoter.
3.4. Top 20 Descriptors of 4-Mer Motifs
Table 4 lists that the (TGAA) and (AAAG) descriptors have the maximum scores when applied to the HPL and DPL datasets, respectively. A comparison between the two sets of the top 20 descriptors of 4-mer motifs reveals two common 4-mer motifs. One is TGAA, which has scores of 1000 and 732; the other is TGAT, at ranks of 2 and 12 when used with HPL and DPL datasets, respectively. The descriptors of the well-known TATA motif are ranked at the 199th and 98th when applied for the HPL and DPL datasets, respectively.
The former descriptor (TATA) ranking at the 199th is excluded out of the reference feature set due to the fact that only 128 top-ranked descriptors of 4-mer motifs are allowed to be included. This agrees closely with the findings of Gershenzon and Ioshikhes , who found that the TATA motif exists only in a small proportion of all human promoters. Additionally, only nine descriptors are included in each of the two feature subsets of and 74 DNASD feature, which are marked with “+” Table 4. This main reason is that the DNASDmining feature selection algorithm considers a set of informative DNASDs at once, rather than individual DNASDs.
3.5. Analysis of the Identified DNASDs
The orthogonal experimental design with orthogonal array and factor analysis is an efficient method for simultaneously examining the individual effect of several factors on the evaluative function [47, 48]. In this study, the two levels of a factor represent its inclusion and exclusion of the feature in the feature selection using IGA [47, 48]. The factor analysis can quantify the effects of individual factors on the evaluation function, rank the most effective factors, and determine the best level for each factor for optimization of the evaluation function. The most effective factor has the largest main effect difference (MED) amongst the levels of a single factor.
Figure 5 displays top 20 DNASDs when ranked in order of decreasing MED value. The MED values of the first two and four features exceed 30 when applied to the HPL and DPL datasets, respectively. The two features with the maximum MED values are (A, 1st) and (T, 1st), which are two distributions of the global description, respectively (Supplementary Table ). Specifically, the (A, 1st) has the highest MED value of 93.1, meaning that the length of nucleotide A at the first position of the sequences can be used to distinguish promoters from nonpromoters in the human species. This result is consistent with the first if-then rule, R1-p (Table 7).
As for the four features with the MED values exceeding 30, they are the descriptors of the physicochemical properties (, , and ) and (AAGT), revealing that the three physicochemical properties of absorption maxima, molecular weight, and molar absorption coefficient can be used to distinguish promoters from nonpromoters in the Drosophila specie. The (AAGT), a descriptor of the AAGT motif, has the fourth highest MED value of 31.5; however, it only has a score of 73 and a rank of 41, as shown in Table 4, revealing that DNASDmining can consider the internal correlation within relevant features rather than individual features using an efficient global optimization . The transition descriptor (C, G) of the occurrence frequency of CG or GC has the fifth highest MED value of 26.6. This analytical result agrees with those obtained in other studies in [4, 19, 22, 23], which have found that GC content is effective in identifying promoter regions.
Supplementary Table ranks all of the informative DNASDs by MED value. They consist of three descriptors of physicochemical properties, four EDP descriptors, two composition descriptors, three transition descriptors, 14 distribution descriptors, and 73 4-mer frequency descriptors, denoted as 3(), 4(), 2(), 3(), 14(), and 73(), respectively, (see Table 8), where the abbreviations , , , , , and represent the descriptors of the physicochemical property of nucleotides, the 1-mer motif, the 4-mer motif, EDP, distribution, and transition, respectively. On the other hand, the subset of DNASDs comprises 3(), 2(), 2(), 3(), 15(), and 49(), shown in Table 7. Supplementary Table S4 ranks all of the 74 informative DNASDs by MED value.
3.6. Common DNASDs in Human and Drosophila Species
The percentages of common DNASDs in the two identified feature subsets are 32% and 43% (). The 32 common DNASDs, as shown in Table 8, comprise three descriptors of physicochemical properties, one EDP descriptor, two composition descriptors, one transition descriptor, 11 distribution descriptors, and 14 descriptors of 4-mer motifs, denoted as 3(), 1(), 2(), 1(), 11(), and 14(), respectively
All of the three descriptors of physicochemical properties, , , and , are ranked the first, second, and third for DPL and ranked the 5th, 6th, and 10th for HPL, respectively, consistent with the interpretation of if-then rules in Table 7. When the three descriptors of physicochemical properties are excluded, PromHD with the remaining 96 and 71 DNASD features yields test accuracies of 94.4% and 95.5% in human and Drosophila test datasets, respectively. The prediction accuracies fall by 2.0% and , reconfirming the three physicochemical properties are obviously effective in distinguishing promoters from nonpromoters in human and Drosophila species.
The one EDP descriptor is ranked the 13th and 32th for DPL and HPL, respectively, as shown in Supplementary Tables and . The two compositions that are related to nucleotide A and G, denoted as (A) and (G), clearly contribute to promoter prediction, consistent with the findings of Wang et al. and Zhao et al. [22, 23]. The one transition descriptor (G, T) that characterizes the frequency of occurrence of two nucleotides GT or TG is ranked the 84th and 23th for human and Drosophila species, respectively. Among the 11 common distribution descriptors, (A, 1st), (T, 1st), and (G, 1st) are ranked the first, second, and third for the human species but the 46th, 20th, and 27th for Drosophila species, respectively. Two of the 14 common descriptors of 4-mer motifs, (GAGC) and (GAAG), not only have high scores of 592 and 699, respectively, but are also identified by PromHD to be informative DNASDs as can be seen by comparing Tables 4,, and . Although the ranks of these common 32 DNASDs largely differ between human and Drosophila species, they form the six clusters of , , , , , and . The scenarios reveal that the six clusters are all useful for distinguishing promoters from nonpromoters in human and Drosophila species.
Promoter prediction is an important problem in elucidating the regulation of gene expression. Therefore, the development of a well-characterized promoter system is vital for synthetic biology applications. This proposed PromHD method presents a reference feature set of 167 DNASDs, utilizes a feature mining algorithm to select a feature subset of informative DNASDs, and acquires rule-based knowledge based on the selected feature subset. The mining algorithm using an optimization approach to feature selection identifies the most informative and discriminating DNASDs among human and Drosophila species. The top-ranked rules reveal that the global sequence descriptor, the length of nucleotide A at the first position of the sequence, and two physicochemical properties, absorption maxima and molecular weight, are efficient in distinguishing promoters from nonpromoters in human and Drosophila species, respectively. Additionally, this work analyzes the contributions of a feature set of DNA sequence descriptors to the promoter prediction using the MED values. The three physicochemical properties of absorption maxima, molecular weight, and molar absorption coefficient have high MED values, meaning the three properties are clearly useful in distinguishing promoters from nonpromoters in human and Drosophila species. Future work on PromHD will develop a well-characterized promoter system for synthetic biology applications. Moreover, we believe that this proposed method will also be effective in designing prediction methods for other DNA sequence-based applications. The promoter prediction system by using PromHD has been implemented at http://iclab.life.nctu.edu.tw/promhd. All used datasets were given in the website.
Conflict of Interests
The authors declare no conflict of interests.
Wen-Lin Huang (WLH) designed the system and carried out the detail study. Chun-Wei Tung and Chyn Liaw designed the system and implemented programs. Hui-Ling Huang carried out the detail study. WLH and Shinn-Ying Ho (SYH) conceived the idea of this study and wrote the paper. In addition, SYH supervised the whole project. All authors have read and approved the final paper.
This work was supported by the National Science Council of Taiwan under the Contract no. NSC-102-2627-B-009-003, NSC-102-2221-E-243-002 and “Center for Bioinformatics Research of Aiming for the Top University Program" of the National Chiao Tung University and Ministry of Education, Taiwan, for the Project 102W962. This work was also supported in part by the UST-UCSD International Center of Excellence in Advanced Bioengineering sponsored by the Taiwan National Science Council I-RiCE Program under Grant no.: NSC-101-2911-I-009-101.
- J. Bradley, D. Johnson, and D. Rubenstein, Lecture Notes on Molecular Medicine, Blackwell Science, London, UK, 2005.
- M. M. Yin and J. T. L. Wang, “GeneScout: a data mining system for predicting vertebrate genes in genomic DNA sequences,” Information Sciences, vol. 163, no. 1–3, pp. 201–218, 2004.
- J. Zeng, S. Zhu, and H. Yan, “Towards accurate human promoter recognition: a review of currently used sequence features and classification methods,” Briefings in Bioinformatics, vol. 10, pp. 498–508, 2009.
- V. Rangannan and M. Bansal, “High-quality annotation of promoter regions for 913 bacterial genomes,” Bioinformatics, vol. 26, no. 24, pp. 3043–3050, 2010.
- M. Scherf, A. Klingenhoff, and T. Werner, “Highly specific localization of promoter regions in large genomic sequences by PromoterInspector: a novel context analysis approach,” Journal of Molecular Biology, vol. 297, no. 3, pp. 599–606, 2000.
- J.-Y. Yang, Y. Zhou, Z.-G. Yu, V. Anh, and L.-Q. Zhou, “Human Pol II promoter recognition based on primary sequences and free energy of dinucleotides,” BMC Bioinformatics, vol. 9, article 113, 2008.
- K. Song, “Recognition of prokaryotic promoters based on a novel variable-window Z-curve method,” Nucleic Acids Research, vol. 40, no. 3, pp. 963–971, 2012.
- X. Xie, S. Wu, K.-M. Lam, and H. Yan, “PromoterExplorer: an effective promoter identification method based on the AdaBoost algorithm,” Bioinformatics, vol. 22, no. 22, pp. 2722–2728, 2006.
- J. Wang and S. Hannenhalli, “A mammalian promoter model links cis elements to genetic networks,” Biochemical and Biophysical Research Communications, vol. 347, no. 1, pp. 166–177, 2006.
- S. Wu, X. Xie, A. W.-C. Liew, and H. Yan, “Eukaryotic promoter prediction based on relative entropy and positional information,” Physical Review E, vol. 75, no. 4, Article ID 041908, 2007.
- N. I. Gershenzon and I. P. Ioshikhes, “Synergy of human Pol II core promoter elements revealed by statistical sequence analysis,” Bioinformatics, vol. 21, no. 8, pp. 1295–1300, 2005.
- V. B. Bajic and V. Brusic, “Computational detection of vertebrate RNA polymerase II promoters,” in Rna Polymerases and Associated Factors, pp. 237–250, Academic Press, San Diego, Calif, USA, 2003.
- M. Hackenberg, C. Previti, P. L. Luque-Escamilla, P. Carpena, J. Martínez-Aroza, and J. L. Oliver, “CpGcluster: a distance-based algorithm for CpG-island detection,” BMC Bioinformatics, vol. 7, article 446, 2006.
- L. Ponger and D. Mouchiroud, “CpGProD: identifying CpG islands associated with transcription start sites in large genomic mammalian sequences,” Bioinformatics, vol. 18, no. 4, pp. 631–633, 2002.
- V. B. Bajic, S. H. Seah, A. Chong, G. Zhang, J. L. Y. Koh, and V. Brusic, “Dragon promoter finder: recognition of vertebrate RNA polymerase II promoters,” Bioinformatics, vol. 18, no. 1, pp. 198–199, 2002.
- S. Sonnenburg, A. Zien, and G. Rätsch, “ARTS: accurate recognition of transcription starts in human,” Bioinformatics, vol. 22, no. 14, pp. e472–e480, 2006.
- NNP 2.2, http://www.fruitfly.org/seq_tools/promoter.html.
- R. V. Davuluri, I. Grosse, and M. Q. Zhang, “Computational identification of promoters and first exons in the human genome,” Nature Genetics, vol. 29, no. 3, pp. 412–417, 2002.
- S. Knudsen, “Promoter2.0: for the recognition of PolII promoter sequences,” Bioinformatics, vol. 15, no. 5, pp. 356–361, 1999.
- M. Q. Zhang, “Identification of human gene core promoters in silico,” Genome Research, vol. 8, no. 3, pp. 319–326, 1998.
- C. Y. Lim, B. Santoso, T. Boulay, E. Dong, U. Ohler, and J. T. Kadonaga, “The MTE, a new core promoter element for transcription by RNA poymerase II,” Genes and Development, vol. 18, no. 13, pp. 1606–1617, 2004.
- X. Wang, Z. Xuan, X. Zhao, Y. Li, and M. Q. Zhang, “High-resolution human core-promoter prediction with CoreBoost-HM,” Genome Research, vol. 19, no. 2, pp. 266–275, 2009.
- X. Zhao, Z. Xuan, and M. Q. Zhang, “Boosting with stumps for predicting transcription start sites,” Genome Biology, vol. 8, no. 2, article R17, 2007.
- J. W. Fickett and A. G. Hatzigeorgiou, “Eukaryotic promoter recognition,” Genome Research, vol. 7, no. 9, pp. 861–878, 1997.
- W. Deng and S. G. E. Roberts, “A core promoter element downstream of the TATA box that is recognized by TFIIB,” Genes and Development, vol. 19, no. 20, pp. 2418–2423, 2005.
- K. Florquin, Y. Saeys, S. Degroeve, P. Rouzé, and Y. van de Peer, “Large-scale structural analysis of the core promoter in mammalian and plant genomes,” Nucleic Acids Research, vol. 33, no. 13, pp. 4255–4264, 2005.
- S. P. Pandey and A. Krishnamachari, “Computational analysis of plant RNA Pol-II promoters,” BioSystems, vol. 83, no. 1, pp. 38–50, 2006.
- T. Abeel, Y. Saeys, E. Bonnet, P. Rouzé, and Y. van de Peer, “Generic eukaryotic core promoter prediction using structural features of DNA,” Genome Research, vol. 18, no. 2, pp. 310–323, 2008.
- U. Ohler, H. Niemann, G.-C. Liao, and G. M. Rubin, “Joint modeling of DNA sequence and physical properties to improve eukaryotic promoter recognition,” Bioinformatics, vol. 17, no. 1, pp. S199–S206, 2001.
- T. Abeel, Y. Saeys, P. Rouzé, and Y. van de Peer, “ProSOM: core promoter prediction based on unsupervised clustering of DNA physical profiles,” Bioinformatics, vol. 24, no. 13, pp. i24–i31, 2008.
- P. S. Ho, G. Zhou, and L. B. Clark, “Polarized electronic spectra of Z-DNA single crystals,” Biopolymers, vol. 30, no. 1-2, pp. 151–163, 1990.
- J. A. Greenbaum, B. Pang, and T. D. Tullius, “Construction of a genome-scale structural map at single-nucleotide resolution,” Genome Research, vol. 17, no. 6, pp. 947–953, 2007.
- K.-J. Won, I. Chepelev, B. Ren, and W. Wang, “Prediction of regulatory elements in mammalian genomes using chromatin signatures,” BMC Bioinformatics, vol. 9, article 547, 2008.
- T. A. Down and T. J. P. Hubbard, “Computational detection and location of transcription start sites in mammalian genomic DNA,” Genome Research, vol. 12, no. 3, pp. 458–461, 2002.
- I. A. Shahmuradov, V. V. Solovyev, and A. J. Gammerman, “Plant promoter prediction with confidence estimation,” Nucleic Acids Research, vol. 33, no. 3, pp. 1069–1076, 2005.
- L. R. Cardon and G. D. Stormo, “Expectation maximization algorithm for identifying protein-binding sites with variable lengths from unaligned DNA fragments,” Journal of Molecular Biology, vol. 223, no. 1, pp. 159–170, 1992.
- M. G. Reese, “Application of a time-delay neural network to promoter annotation in the Drosophila melanogaster genome,” Computers and Chemistry, vol. 26, no. 1, pp. 51–56, 2001.
- R. Gangal and P. Sharma, “Human pol II promoter prediction: time series descriptors and machine learning,” Nucleic Acids Research, vol. 33, no. 4, pp. 1332–1336, 2005.
- F. Anwar, S. M. Baker, T. Jabid et al., “Pol II promoter prediction using characteristic 4-mer motifs: a machine learning approach,” BMC Bioinformatics, vol. 9, article 414, 2008.
- K. Polat and S. Güneş, “A new method to forecast of Escherichia coli promoter gene sequences: Integrating feature selection and Fuzzy-AIRS classifier system,” Expert Systems with Applications, vol. 36, no. 1, pp. 57–64, 2009.
- Y. Gan, J. Guan, and S. Zhou, “A comparison study on feature selection of DNA structural properties for promoter prediction,” BMC Bioinformatics, vol. 13, no. 1, article 4, 2012.
- W.-L. Huang, C.-W. Tung, and S.-Y. Ho, “Human Pol II promoter prediction by using nucleotide property composition features,” in Proceedings of the International Symposium on Biocomputing (ISB '10), ACM, New York, NY, USA, Kerala, India, February 2010.
- Nucleotide properties, http://www.geneinfinity.org/sp/sp_dnaprop.html.
- D. Onidas, D. Markovitsi, S. Marguet, A. Sharonov, and T. Gustavsson, “Fluorescence properties of DNA nucleosides and nucleotides: a refined steady-state and femtosecond investigation,” The Journal of Physical Chemistry B, vol. 106, no. 43, pp. 11367–11374, 2002.
- H.-L. Huang, I.-C. Lin, Y.-F. Liou et al., “Predicting and analyzing DNA-binding domains using a systematic approach to identifying a set of informative physicochemical and biochemical properties,” BMC Bioinformatics, vol. 12, no. 1, article S47, 2011.
- W. L. Huang, “Ranking gene ontology terms for predicting non-classical secretory proteins in eukaryotes and prokaryotes,” Journal of Theoretical Biology, vol. 312, pp. 105–113, 2012.
- S.-Y. Ho, J.-H. Chen, and M.-H. Huang, “Inheritable genetic algorithm for biobjective 0/1 combinatorial optimization problems and its applications,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 34, no. 1, pp. 609–620, 2004.
- W.-L. Huang, C.-W. Tung, S.-W. Ho, S.-F. Hwang, and S.-Y. Ho, “ProLoc-GO: utilizing informative gene ontology terms for sequence-based prediction of protein subcellular localization,” BMC Bioinformatics, vol. 9, article 80, 2008.
- R. Dreos, G. Ambrosini, R. Cavin Périer, and P. Bucher, “EPD and EPD new, high-quality promoter resources in the next-generation sequencing era,” Nucleic Acids Research, vol. 41, pp. D157–D164, 2013.
- J. R. Quinlan, “C5.0 online tutorial,” 2003, http://www.rulequest.com.
- U. Ohler, H. Niemann, G.-C. Liao, and G. M. Rubin, “Joint modeling of DNA sequence and physical properties to improve eukaryotic promoter recognition,” Bioinformatics, vol. 17, no. 1, pp. S199–S206, 2001.
- S. S. Gross and M. R. Brent, “Using multiple alignments to improve gene prediction,” in Proceedings of the 9th Annual International Conference on Research in Computational Molecular Biology (RECOMB '05), pp. 379–393, Mary Ann Liebert, Cambridge, Mass, USA, 2005.
- V. Rangannan and M. Bansal, “High-quality annotation of promoter regions for 913 bacterial genomes,” Bioinformatics, vol. 26, no. 24, pp. 3043–3050, 2010.
- M. Scherf, A. Klingenhoff, K. Frech et al., “First pass annotation of promoters on human chromosome 22,” Genome Research, vol. 11, no. 3, pp. 333–340, 2001.
- D. S. Prestridge, “Predicting Pol II promoter sequences using transcription factor binding sites,” Journal of Molecular Biology, vol. 249, no. 5, pp. 923–932, 1995.
- TSSW, http://linux1.softberry.com/berry.phtml.
- S. Varma and R. Simon, “Bias in error estimation when using cross-validation for model selection,” BMC Bioinformatics, vol. 7, article 91, 2006.
- D. Restrepo-Montoya, C. Pino, L. F. Nino, M. E. Patarroyo, and M. A. Patarroyo, “NClassG+: a classifier for non-classically secreted Gram-positive bacterial proteins,” BMC Bioinformatics, vol. 12, article 21, 2011.
- W.-L. Huang, C.-W. Tung, H.-L. Huang, S.-F. Hwang, and S.-Y. Ho, “ProLoc: prediction of protein subnuclear localization using SVM with automatic selection from physicochemical composition features,” BioSystems, vol. 90, no. 2, pp. 573–581, 2007.
- Z. Zhang, S. Kochhar, and M. G. Grigorov, “Descriptor-based protein remote homology identification,” Protein Science, vol. 14, no. 2, pp. 431–444, 2005.
- S.-Y. Ho, L.-S. Shu, and J.-H. Chen, “Intelligent evolutionary algorithms for large parameter optimization problems,” IEEE Transactions on Evolutionary Computation, vol. 8, no. 6, pp. 522–541, 2004.
- C. C. Chang and C. J. Lin, “LIBSVM : a library for support vector machines,” 2001, http://www.csie.ntu.edu.tw/~cjlin/libsvm.
- K.-C. Chou and C.-T. Zhang, “Prediction of protein structural classes,” Critical Reviews in Biochemistry and Molecular Biology, vol. 30, no. 4, pp. 275–349, 1995.
- K.-C. Chou, “Some remarks on protein attribute prediction and pseudo amino acid composition,” Journal of Theoretical Biology, vol. 273, no. 1, pp. 236–247, 2011.
- C.-H. Su, N. R. Pal, K.-L. Lin, and I.-F. Chung, “Identification of amino acid propensities that are strong determinants of linear B-cell epitope using neural networks,” PLoS ONE, vol. 7, no. 2, Article ID e30617, 2012.
- V. B. Bajic, L. T. Sin, Y. Suzuki, and S. Sugano, “Promoter prediction analysis on the whole human genome,” Nature Biotechnology, vol. 22, no. 11, pp. 1467–1473, 2004.
- B. W. Matthews, “Comparison of the predicted and observed secondary structure of T4 phage lysozyme,” Biochimica et Biophysica Acta, vol. 405, no. 2, pp. 442–451, 1975.
- T. Li, C. Zhang, and M. Ogihara, “A comparative study of feature selection and multiclass classfication methods for tissue classification based on gene expression,” Bioinformatics, vol. 20, no. 15, pp. 2429–2437, 2004.