Integration Strategy Is a Key Step in Network-Based Analysis and Dramatically Affects Network Topological Properties and Inferring Outcomes

Jin, Nana; Wu, Deng; Gong, Yonghui; Bi, Xiaoman; Jiang, Hong; Li, Kongning; Wang, Qianghu

doi:https://doi.org/10.1155/2014/296349

BioMed Research International

On this page

Abstract Introduction Materials and Methods Results Discussion Acknowledgments Supplementary Materials References Copyright Related Articles

Special Issue

Advances in Computational Genomics

View this Special Issue

Research Article | Open Access

Volume 2014 | Article ID 296349 | https://doi.org/10.1155/2014/296349

Integration Strategy Is a Key Step in Network-Based Analysis and Dramatically Affects Network Topological Properties and Inferring Outcomes

Nana Jin,^1,2Deng Wu,²Yonghui Gong,²Xiaoman Bi,²Hong Jiang,¹Kongning Li,²and Qianghu Wang^1,2

Academic Editor: Siyuan Zheng

Received22 May 2014

Revised14 Jul 2014

Accepted17 Jul 2014

Published27 Aug 2014

Abstract

An increasing number of experiments have been designed to detect intracellular and intercellular molecular interactions. Based on these molecular interactions (especially protein interactions), molecular networks have been built for using in several typical applications, such as the discovery of new disease genes and the identification of drug targets and molecular complexes. Because the data are incomplete and a considerable number of false-positive interactions exist, protein interactions from different sources are commonly integrated in network analyses to build a stable molecular network. Although various types of integration strategies are being applied in current studies, the topological properties of the networks from these different integration strategies, especially typical applications based on these network integration strategies, have not been rigorously evaluated. In this paper, systematic analyses were performed to evaluate 11 frequently used methods using two types of integration strategies: empirical and machine learning methods. The topological properties of the networks of these different integration strategies were found to significantly differ. Moreover, these networks were found to dramatically affect the outcomes of typical applications, such as disease gene predictions, drug target detections, and molecular complex identifications. The analysis presented in this paper could provide an important basis for future network-based biological researches.

1. Introduction

Molecular interactions, such as protein-DNA interactions [1], protein-RNA interactions [2], DNA-DNA interactions [3], RNA-RNA interactions [4], and protein-protein interactions [5], facilitate various organismal functions, including the process of transcription [6], multiple long-range interactions between promoters and distal elements [7], and the regulation of gene expression [8]. Therefore, many experiments have been designed to detect intercellular and intracellular molecular interactions [9, 10]. Of these molecular interactions, protein-protein interactions have especially been found to play a crucial role in defining most of the molecular functions [11].

Consequently, molecular networks based on these interactions have been built to elucidate their underlying roles in biology [12]. Interactions have been utilised to build many protein-protein interaction network databases, such as DIP [13], HPRD [14], BIND [15], BioGRID [16], IntAct [17], and MINT [18], yielding more than 150,000 binary interactions. Researchers have used the interaction network of these databases to perform many studies and applications [11, 19, 20]. The interactions reported in these databases are derived from sources including yeast two-hybrid, anti-tag coimmunoprecipitation, mass-spectrometric, and literature mining experiments.

Traditional protein-protein interactions have been detected in a high-quality manner based on top-down- and hypothesis-based methods supported by experimental data [11]. Further, recent protein-protein interaction data have been generated in large numbers based on high-throughput methods, thus reconfiguring the biological network from a different point of view. However, two major shortages cannot be ignored. The coverage of current protein-protein interaction networks is less than 50%, and the accuracy of these data ranges from 10% to 50% [21–23]. Consider an example in which, by utilising various methodologies, researchers identify 80,000 protein interaction pairs in yeast; however, they only confirm interactions for approximately 2,400 pairs using more than two methods [22]. Several reasons can cause this situation. First, some data sources are not completely annotated. Second, each method has its own bias, meaning that each method can identify a subset of specific interactions. Third, large portions of the resulting dataset suffer from a high false-positive rate [22, 24, 25].

Comprehensive consideration of these data sources by the use of integration algorithms can solve the data bias inherently when using only a single data source and can also effectively increase the coverage of the interactome and decrease the false-positive rate [26]. Therefore, the development of new statistics and computational methods for integrating data from different databases is urgently needed and is a subject of concern in the present study [27]. Previous studies have directly utilised integration strategies that have not been properly evaluated, such as the intersection set of different networks (Intersection), the union set of different networks (Union), voting (which is a choice made by a network, Vote) [26], and the integration strategies based on Naive Bayes [28], Bayesian Networks [29], Logistic Regression [30], SVM [21], and decision trees, including Random Trees [31], Random Forest, and J48 [24]. For example, Lin and Chen applied a tree-augmented naive Bayesian (TAN) classifier to integrate heterogeneous data sources and generated fair results [28]; Wu et al. used SVM and Bayesian classifiers to detect whether a protein-protein interaction was reliable [21]; Gerstein et al. considered that voting did not take full advantage of the data source information in the process, and therefore, cannot generally obtain good results [32]; Ben-Hur and Noble deemed that SVM adopted different kernel functions depending on different integration tasks [33]; Jansen et al. and Rhodes et al. regarded that the premise of Naive Bayes was that the conditional probability of each attribute was independent [29, 34]; Sprinzak et al. thought that Logistic Regression actually was a generalised linear statistical model [30]; Chen and Liu believed that Random Forest combined many decision trees to enhance the correct rate of classification [35]; and by evaluating the precision, recall and area under the curve (AUC) scores of Support Vector Machine (SVM), Naive Bayes, Logistic Regression, Decision Tree, and Random Forest when predicting interactions, Qi et al. determined that Random Forest ranked as the top classifier for integration [24].

Although various types of integration strategies have been applied to the current research, the method of choice has not been considered. Although some researchers have simply evaluated some integration results, the comprehensive topological properties of the networks for different integration strategies and the impact of the outcomes of the typical applications based on these networks have not been rigorously evaluated.

In this paper, we combined 37 features representing 10 distinct groups of biological data sources based on former studies [24, 36, 37], including gene expression, physical interactions, domain interactions, HMS_PCI mass, TAP mass, yeast two-hybrid, genetic interactions, gene ontology (GO) annotations, and gene context analysis, to predict the more reliable protein-protein interactions. Our method utilised gold standard data sets and 11 commonly used methods (Union, Intersection, 2-Vote, 3-Vote, Naive Bayes, Bayesian Networks, Logistic Regression, SVM, Random Tree, Random Forest, and J48) from two types of integration strategies (empirical and machine learning) to integrate all of the interactions in previously mentioned databases; 2-Vote and 3-Vote indicate interactions that were supported by two and three databases, respectively. For seven machine-learning methods, we systematically evaluated the accuracy of correct classification, the area under the receiver operating characteristic (ROC) curve, the precision rate, recall rate, and the true-positive to false-positive ratio. To gain a more detailed understanding of the differences between these 11 new networks, we also compared the differences among their topological properties. For these integration strategies, topological properties, such as the number of proteins and interactions, the clustering coefficient, network density, average degree, and average path length, differed significantly between the different networks. Moreover, by analysing the ranks when predicting disease genes, searching for differences in detecting drug targets, and researching the modules for identifying molecular complexes, we found that the networks dramatically affected the outcomes of these typical applications. For example, when using phenotype similarity to detect disease genes, we obtained four different genes that were ranked as the top candidate in each of the 11 integration strategies. Compared to previous studies, the present study focuses more on the influence of different network integration strategies on typical biological applications, providing a novel perspective from which protein networks are studied from different viewpoints and an important basis for future network-based biological research.

2. Materials and Methods

2.1. DIP Database

DIP records experimentally detected protein interactions. Because the CORE set in the DIP database had been widely used to develop the prediction methods by the high-quality, high-throughput protein interaction data of it, and to study the properties of protein interaction networks, we selected the CORE set as the positive set for a gold standard database.

2.2. NEGATOME Database

The NEGATOME collects proteins that are experimentally supported noninteracting protein pairs via manual literature mining and analysing protein complexes from the RCSB Protein Data Bank (PDB). Because the manual dataset in the NEGATOME database does not contain high-throughput data and describes the unlikely direct physical interactions circumscribed only to mammalian proteins, most of which in this database are Homo sapiens, we selected the manual dataset as the negative set for a gold standard database.

2.3. Testing Datasets

We used five sources (HPRD, BIND, MINT, IntAct, and BioGRID) for protein-protein interaction data, representing most of the authoritative databases. These databases contain data derived almost from high-throughput experiments based on literature mining, yeast two-hybrid, mass spectrometric, and anti-tag coimmunoprecipitation experiments. However, approximately half of the interactions obtained from high-throughput experiments may represent false-positives as estimated by Von Mering et al. Therefore, it is critical to determine whether the interactions are authentic or pseudo.

2.4. Gene Expression

Genes that are mRNA coexpressed typically indicate protein interactions [38]. We collected 28 gene expression profiles, including more than 5000 samples of different tissues from the Gene Expression Omnibus (GEO) (http://www.ncbi.nlm.nih.gov/geo/), as previously described by Xu et al. [36]. Each gene containing a missing value was deleted, and all of the expression values were log-2 transformed. We combined any probes containing the same Gene Identifier. We then calculated the Pearson correlation coefficient (PCC) between each pair of genes to obtain a correlation coefficient matrix.

2.5. Domain-Domain Interactions

A domain is a structural or functional protein subunit, and the interaction between two proteins often involves binding between pairs of their constituent domains. Therefore, the selection of domains as characteristics is credible. We obtained domain information from the PFAM database, which is a large collection of protein families and is authoritative about domains. Additionally, domain-domain interaction information was obtained from the DOMINE database, which is a database of known and predicted protein domain (domain-domain) interactions. The database contains interactions inferred from PDB entries and those that were predicted by 13 different computational approaches using PFAM domain definitions. It contains 26,219 domain-domain interactions among 5,410 domains.

2.6. Physical Protein-Protein Interactions

We collected all of the interactions from the BioGRID, BIND, IntAct, HPRD, and MINT databases. All of the interactions that were not mapped to homologous human interaction proteins by HomoloGene (http://www.ncbi.nlm.nih.gov/homologene) in NCBI [39] were deleted. The physical protein-protein interaction scores ranged from 0 to 5; 0 meant that the interaction was from none of these databases, while 5 meant that the interaction was supported by each of these databases.

2.7. High-Throughput Direct PPI Dataset

The high-throughput direct PPI dataset contains two types: (1) derived from mass spectrometry and (2) derived from Y2H. In the mass spectrometry dataset, two subdatasets, TAP [40] and HMS-PCI [41], utilised two different protocols for this technique. We used the high-throughput PPI dataset provided by Qi et al. [24].

2.8. Human Phenotype

Function deletion in interactions or functionally related proteins frequently resulted in similar phenotypes [41–43]. We mapped the interactions that Han et al. attributed to homologous human interactions to obtain more accurate results.

2.9. Genetic Interactions

A synthetic genetic analysis (SGA) was used to reveal genetic interactions in Saccharomyces cerevisiae [44, 45]. Some reports have demonstrated a significant overlap between protein-protein interactions and genetic interactions [46]. Therefore, most neighbours of genetic interaction genes can be used to predict protein-protein interactions [45].

2.10. Biological Functional Annotation

Compared to interactions of different biological functions, protein-protein interactions are more likely to occur in proteins with similar biological functions. Moreover, proteins sharing a more specific annotation tend to interact with each other compared to those that share a more common annotation.

2.11. Gene Context Analysis

The gene context is based on genome sequences to infer in silico protein-protein interactions [22]. The gene context includes three types: gene fusion, gene cooccurrence, and gene neighbourhood.

Human phenotype, genetic interaction, biological functional annotation, and gene context analyses have been previously performed by Xia et al. [37] to predict interactions from model organisms.

To avoid the impact of human factors on the results analysis, we constructed all the machine learning integration strategies with a unified software platform, WEKA (Waikato Environment for Knowledge Analysis), which is widely used in classification. WEKA, a public data-mining platform, collects a large number of machine learning algorithms that are used to undertake the task of data mining, including preprocessing, classifying, clustering, associating, attribute selecting, and visualising.

2.12. Seven Machine Learning Classifiers Constructed by Using the Gold Standard Datasets

All of the protein data that we obtained were derived from different databases, and each database has its own presentation pattern, such as Gene Identifier, Gene Symbol, Accession Number, and UniProtKB Number. To unify the data, we converted all of the protein presentation patterns into Gene Identifiers. Then, we deleted any interactions that were not mapped to the Gene Identifiers or homologous human interactions by NCBI HomoloGene. After obtaining the gold standard protein networks, we constructed seven different machine learning classifiers using seven integration strategies (Naive Bayes, Bayesian Networks, Logistic Regression, SVM, Random Tree, Random Forest, and J48) (Figure 1).

3. Results

In this study, we used four empirical integration strategies and seven machine learning classifiers constructed by the reliable positive and negative gold standard sets from DIP and NEGATOME, respectively, to integrate the protein-protein interaction networks. Some indicators, such as the accuracy of those correctly classified, the area under the ROC curve, and the precision and recall rates, are typically used to evaluate a supervised machine learning method; therefore, we initially evaluated the performance of these seven machine-learning classifiers in these ways.

3.1. Performance of the Classifiers Constructed by Seven Machine Learning Integration Strategies

From the seven different integration strategies, the seven classifiers showed quite different classification results. The ACC score, AUC score, precision and recall rates, and TP/FP score of each integration strategy were significantly distinct (Figure 2, Table 1). For example, the ACC score ranged from 0.5391 in Naive Bayes to 0.7196 in Random Forest, and the area under the ROC curve ranged from 0.62 in Naive Bayes to 0.787 in Random Forest. Therefore, different integration strategies affect the outcome of the classification.

Figure 2

ROC curves for seven machine learning integration strategies using 10-fold cross-validation against the gold standard datasets. Each point on the ROC curves of the seven integration strategies is created by the unique sensitivity and specificity against a specific likelihood ratio cut-off. Each name of the curve derived from the different integration strategies is shown in the legend. The different colours stand for the different curves for the different strategies. The area under the curve is also presented in the figure. Sensitivity and specificity are calculated during the 10-fold cross-validations.

3.2. Eleven New Networks Built by Empirical and Machine Learning Integration Strategies

After inputting 145,534 interaction pairs from the five databases into these funnel-like classifiers, we obtained 11 different new networks (Figure 3). As shown in Table 2, the 11 new networks are significantly different from each other. Although the input network was constant, the ratio of the number of predicted protein pairs to the originally considered protein pairs was remarkably discrepant. It is clear that the differences between the seven machine learning networks are not significant; in other words, the machine learning strategies are somewhat stable. For example, the coverage of each network range from 0.7874 (Random Tree) to 0.9773 (SVM); however, most of the coverage in the machine learning strategies were approximately 95%. However, a remarkable distinction was present in four empirical strategies. For example, Intersection considered only 0.34% of the interactions to be true interactions, 2-Vote considered 28.01% of the interactions to be true interactions, and Union considered all of the interactions to be true interactions.

Seven machine learning networks in Table 3 show that although a certain ratio of repeats was observed, the interactions in each machine learning network were not the same. For example, compared with the original network, the number of interactions that did not appear in any of the machine learning classifier outputs was 1,808 (1.24% of the total), while the number of interactions in all of the classifiers’ output was 89,740 (61.66% of the total). As indicated in all 11 integration networks in Table 3, in all of the networks, including empirical and machine learning strategies, the number of interactions varies among 11 networks generated by different integration strategies. For example, the number of interactions that appeared in eight networks was 71,478 (49.11%), and the number of interactions that appeared in 11 networks was 312 (only 0.22%).

3.3. Topological Properties of the 11 Empirical and Machine Learning Networks

We first analysed the network topological properties of each integration network; the two most critical attributes in the network are the distance and the number of connections [47]. Almost all of the other topological properties are based on these two properties. We calculated the number of proteins and interactions, network diameter, average degree, network density, average path length, and global clustering coefficient for each network (Table 4).

The network diameter is the maximum eccentricity of any point in the protein network. It represents the greatest distance between protein pairs. The density of a protein network is the total number of interactions divided by the total number of possible interactions. The average path length represents the average distance of the shortest path between all of the node pairs. Additionally, it provides the overall efficiency of information or mass transport in a network. The global clustering coefficient represents the degree to which the proteins in a protein network tend to cluster together.

Tremendous differences were found between the 11 networks of empirical and machine learning strategies. For example, the number of proteins in the networks integrated by machine learning strategies ranged from 507 to more than 14,000, and the average degree ranged from 1.96 to more than 15. Additionally, the average path length and clustering coefficient were dramatically varied.

If we account only for the networks that were integrated by the empirical strategies, almost all of the properties were dramatically varied; for example, the range of changes in the number of proteins and the interactions were especially large. Dramatic variation was also observed in the remaining properties, such as the network diameter, average degree, network density, average path length, and clustering coefficient.

Considering only the networks integrated by the machine learning strategies, although some properties, such as the number of proteins, the network diameter, the network density and the shortest path length, did not vary, other properties varied dramatically. For example, the number of interactions ranged from 114,598 in the Random Tree to 142,226 in the SVM network; the average degree of the networks ranged from 15.82 in the Random Tree network to 19.10 in the SVM network; and the clustering coefficient ranged from 0.0156 in the Random Tree network to 0.0204 in the Bayesian Networks network and the SVM network.

Therefore, the alteration in the topological properties reveals that the different integration strategies dramatically affect the outcomes. These integration strategies affect the number of proteins and interactions in the networks, consequently affecting the network aggregation, mass transport, and connectivity.

3.4. Detection of Disease Genes Using Phenotype Similarity Based on Networks

Protein interaction data are ultimately integrated to facilitate actual applications. The advancement of biotechnology enables the proteome scope of protein interaction networks, making the networks become more and more attractive to researchers studying systems biology [48]. Typically, researchers tend to use protein interaction networks to identify disease candidate genes [49, 50], drug targets [51, 52], and functional modules [53].

The prediction of disease genes based on a protein network is an important typical application of biological networks [54] and is also vital to the development of physianthropy [20]. To detect disease genes, we utilised the method of Lage et al. [54], which is based on phenotype similarity. In this method, disease gene prediction is accomplished based on the assumption that proteins that are directly connected to disease proteins tend to have the same disease phenotype as the disease protein [55–58].

We used epithelial ovarian cancer (EOC) as a specific case. After downloading all 301 genes in the linkage interval on 3p25-22 [59] from GENE of NCBI [60], we identified the subnetworks of these 301 genes in the 11 networks obtained from the 11 integration strategies. Then, a score was obtained for every interaction that was an edge in the subnetworks via Kasper’s scoring rules. Next, according to the method described by van Driel et al. [61], which is based on OMIM [62] and MeSH [63], we calculated the similarity between each phenotype and EOC as the score of the protein that was the node in the subnetworks [64]. According to the following formula, we obtained the final score for each candidate gene: where is the number of partners connected to the candidate gene, is the interaction score, and is the protein score.

Finally, we sorted the entire candidate genes to identify the one that had the highest score. Table 5 lists the highest scoring candidate genes for each integration network.

These findings clearly revealed that four different genes, ATP2B2, MYD88, TGFBR2, and GRM7, were ranked as the top genes in each of 11 integration strategies. This finding indicates that the empirical and machine learning strategies dramatically affected the overall outcomes. Separately, seven machine learning strategies mainly identified ATP2B2 as the top gene; however, Random Tree identified GRM7 as the top gene; overall, this result was relatively stable. However, four empirical strategies yielded three different top genes, indicating that the empirical strategy was quite unstable and seriously impacted the reliability of the results.

3.5. Detection of Disease Genes Using a Network-Based Random Walk with Restart (RWR)

Based on an early disease-gene screening method based on phenotype similarity or network topological properties and the advances of genome sequencing, gene expression analysis and other parallel technologies, it is clear that new disease-gene screening methods are emerging [54, 65, 66]. Well-known studies have demonstrated that the RWR method is superior to other methods, such as methods based on clustering or based on neighbouring nodes [66]. Therefore, we used the RWR method to screen for causative disease genes.

RWR refers to a process in which a given node in a network is used as a starting point upon which iterations are performed; at each iteration, the current node is used as a starting point for a transfer to a randomly selected adjacent node as follows: where is a vector that represents the probability of a certain node being the random walk node at time in the network, represents the probability of the random walk node returning to the starting node at any moment, and represents the adjacency matrix after the column standardisation of the network.

We selected 29 disease genes of brain tumours, including neurofibroma, glioma, glioblastoma, and astrocytoma, from the Cancer Gene Census (CGC) [67, 68]. One gene was randomly selected to verify the prediction efficiency, and the remaining genes were used as seeds for the RWR algorithm. The number of repetitions depended on the number of remaining genes. We considered whether the integration strategy was outstanding based on the ratio of the average position of a nonseed gene in these repeated experiments to the total number of nodes (Table 6, Figure 4).

By comparing the rank ratios in Table 6 and Figure 4, it is clear that (A) the average rank of the remaining (single) disease gene was approximately 14% of the total number of nodes, indicating a satisfactory performance at discovering disease genes by the RWR method, and (B) although some of the machine learning strategies were stable in the rank ratio (e.g., the rank ratio of Naïve Bayes, Logistic Regression, SVM, Random Forest, and Bayesian Networks were approximately 0.14), the rank ratios of the other two machine learning strategies were 0.1627 in J48 and 0.1862 in Random Tree; these values were significantly different from the former five strategies. Furthermore, the rank ratios of four empirical strategies were remarkably distinct from the machine learning strategies; for example, the ratio of 3-Vote, 2-Vote and Intersection were approximately 0.24. Therefore, the different strategies greatly impacted the rank of the nonseed gene by the RWR method.

We next selected all of the disease genes as seeds to obtain the top 10 genes for all of the generated networks except for the seeds (Table 7). Table 7 indicates that the gene lists discovered by the empirical methods are significantly different from the gene lists discovered by the machine learning methods. For example, the genes identified by empirical strategies, such as YWHAB, RAD50, YWHAZ, YWHAE, ERBB2, and RB1, were not identified by any of the machine learning strategies. The top 10 genes detected by the four empirical strategies were also remarkably distinct; for example, UBC, TAF1, MYC, and HNF4A were identified by Union but were not identified by any of the other empirical strategies. Although the genes that were identified by the machine learning methods shared some overlap, different methods also identified different genes; for example, DTNBP1 was only identified by J48. Therefore, the different strategies dramatically impacted the top 10 genes identified by the RWR method.

3.6. The Approach of Discovering Drug Targets Based on Network Topology Properties

As mentioned above, the identification of drug targets is one typical use of a protein interaction network. Similar to Zhu et al. [69], we applied the original protein network topology-based approach to identify drug targets.

Previous studies have shown that compared to general network proteins, drug target proteins are significantly different with respect to their topological properties. For example, the degree of a drug target is larger [70], the average distance and the shortest length between two drug targets are shorter than between a drug target and a general protein, the proportion of the target proteins in the neighbouring nodes of a target protein is significantly higher than the proportion of the target proteins in the neighbouring nodes of a general protein, and the clustering coefficient of a drug target is significantly lower than for a general protein [69].

We obtained the drug target information from DrugBank [71] on March 16, 2013; we then mapped these target genes to each protein interaction network. We next selected five measures to identify drug target proteins; these measures included the degree, 1N index, clustering coefficient, and the average distance and shortest path length between a protein and a drug target protein. The 1N index was the proportion of target proteins in the neighbouring nodes of a protein. We ranked each protein based on these five measures in each of the networks. We then determined the number of drug targets that were included in the top 100 proteins of each network (1N) and the proportion of target proteins in all of the proteins (Table 8).

Due to the characteristics of the drug targets, based on the machine learning strategies, the proportion of drug target proteins in the top-ranked 100 proteins was approximately 83%, and the target ratio was approximately 0.13. Additionally, there was only a small change between the different machine learning strategies; for example, Random Tree and J48 each identified 81 targets, while Logistic Regression identified 85 targets. However, the results obtained from the different empirical integration strategies were significantly different. For example, Union identified 82 drug targets in the top 100 proteins from a network containing 1,984 drug targets, while Intersection identified 40 drug targets in the top 100 proteins from a network containing 133 drug targets.

As shown in Table 9, the numbers of targets were different. For example, 58 drug targets were uniquely detected by one integration strategy, accounting for 33.91% of the 171 targets that appear in the top 100 of each network; however, only four drug targets were simultaneously detected by four integration strategies, accounting for 2.34% of the 171 targets that appear in the top 100 of each network. Therefore, the outcomes of the drug target discovery process were dramatically affected by the different strategies.

3.7. Identification of Molecular Complexes Based on the MCODE Clustering Algorithm

Molecular complexes are key elements in molecular function. Human disease is closely correlated with human molecular complexes, and molecular complexes are widely applied in molecular functional annotation and disease prediction. Therefore, it is critical to identify molecular complexes [72]. Because the protein interaction network contains functional annotation data, it is important to identify molecular complexes from protein interaction networks. Because a subunit of the protein exercises a biological function, the prediction of the function of unknown proteins has been demonstrated to be of great significance [73].

The identification of molecular complexes is an important application in biological networks. For example, Wu et al. compiled the redundant human complexes to build a comprehensive catalogue and then investigated the relationship between protein complexes and drug-related systems [72]. Song and Singh analysed proteins, complexes, and processes and considered physical interactions within and across complexes and biological processes to understand the protein essentiality [74]. Zhang and Shen analysed functional modules based on a protein-protein network analysis in ankylosing spondylitis [75].

In this paper, we utilised a Cytoscape [76] plug-in called MCODE, which is based on the MCODE [73] clustering algorithm; this plug-in mines tightly connected regions in protein interaction networks that represent molecular complexes. Cytoscape is free software program that graphically displays, edits, and analyses networks. It supports a variety of network description formats, and the user can add rich annotation information to the networks. a large number of functional plug-ins that were developed by developers and third parties can be used for in-depth analysis of network problems. We analysed the topological properties of each single top molecular complex in each network and compared their intersections (Table 10).

Table 10 reveals that the different networks obtained from different integration strategies affected the finding on the effect of molecular complexes. Overall, even though the diameters of the networks and the clustering coefficient were nearly identical, the number of proteins and interactions differed greatly in both the empirical and machine learning strategies. For example, only five proteins and nine interactions were identified in the molecular complexes mined by Intersection, and only 40 proteins and 702 interactions were identified by Random Tree; however, Union identified 63 proteins and 1,721 interactions, and Bayesian Networks identified 65 proteins and 1,787 interactions when identifying molecular complexes. Additionally, the average degree of each network ranged from 3.6 in the Intersection network to 54.127 in the Union network and from 35.1 in the Random Tree network to 54.985 in the Bayesian Network. The network density and average path length also varied in both the empirical and machine learning strategies.

Table 11 lists the proteins that displayed the largest degree in each molecular complex of each network. It is clear that every molecular complex is different from the others because the proteins with the largest degree are different (Table 11).

The proteins displaying the smallest degree (4) were IRAK1, IRAK2, and IRAK3 (based on Intersection) in the molecular complex identification, while the proteins with the largest degree (64) were RPL5 and UBC by Union in molecular complex finding by empirical strategies. Additionally, Logistic Regression revealed that RPL5 had the largest degree (65), while Naive Bayes revealed that MED26 and MED29 displayed the smallest degree (27) by machine learning strategies. Therefore, large distinctions exist between the empirical and machine learning strategies when identifying molecular complexes.

4. Discussion

Protein-protein interaction studies act as new method for improving our understanding of molecular physiological processes. With the growing number of in-depth studies on protein-protein interaction networks, scientists are gaining knowledge of the interactions from various methods. Therefore, the key to network analyses is determining which integration strategy should be implemented. In this study, we analysed and evaluated the networks integrated by 11 commonly used strategies of two types of integration strategies, empirical and machine learning, including Union, Intersection, 2-Vote, 3-Vote, Bayesian Network, Support Vector Machine, Naive Bayes, Random Tree, J48, Logistic Regression, and Random Forest. By comparing the scores and the ranks, these strategies detected disease genes based on phenotype similarity and the RWR algorithm. Based on rank, the networks identified drug targets based on five measures, including average degree, 1N index, clustering coefficient, average path length, and shortest path; the topological properties of the molecular complexes that were identified were based on a Cytoscape plug-in called MCODE. Thus, we conclude that different integration strategies can obtain extremely different outcomes for these typical applications.

Most of the methods of the existing studies are to evaluate the character of the network itself. For example, Qi et al. found that Random Forest performed best of the six methods that they analysed [24]. Although Random Forest performed better based on ACC and AUC, with scores of 0.7196 and 0.787, respectively, subsequent evaluations confirmed that it is insufficient to determine the best integration strategy based solely on accuracy. Ultimately, one must also consider the comprehensive applications. Nevertheless, we did not only analyse the quality of the networks based simply on the integration of a wide range of data. In other words, although we analysed the AUC, accuracy, and topological properties, we also focused on typical practical applications, such as disease gene discovery, drug target detection, and molecular complex identification. We then compared the differences between the various networks in these applications. Therefore, this study is more biologically significant than previous studies, and it provides a novel perspective from which scholars can study protein networks.

It should be emphasised that a substantial amount of in-depth exploration of this topic remains. First, the integration strategies can be combined with other methods for further improvement. For example, the Naive Bayesian method used by Lin and Chen [28] is a tree-like Naive Bayesian method. Alternatively, a variety of integration strategies may be combined in a manner that emphasises the advantages of each integration strategy to improve the results of the integration. Second, because some features, such as phenotype similarity, genetic interaction, and shared GO annotation, which were utilised in IntNetDB described by Xia et al. [37], and TAP, HMS-PCI, and Y2H, which were utilised by Qi et al. [24], do not consider current data, deviations may exist in the results. However, our results are reliable because the same input data were used for all of the integration strategies; therefore, these deviations were not significant.

Although the processes of disease gene discovery and drug target detection revealed the stability of the seven machine learning strategies, these supervised machine learning strategies should have been similar; any difference between them warrants further examination. However, some properties used to identify molecular complexes have revealed the instability of several machine learning strategies. Almost all of the typical applications indicate that empirical strategies are quite unstable; however, these empirical strategies are applied in a substantial number of studies. Consequently, if these strategies are not evaluated, the resulting data will be unreliable, strongly influencing the studies.

Integration strategies are the key step in the network analysis, and they severely affect the outcomes of the various applications. Therefore, because technological advancement dictates the subsequent update of data and the integration strategies, the integration of the updated data becomes even more important. Software and websites that can rapidly integrate these updated data should be developed so that researchers can gain access to more reliable data and complete protein-protein interaction networks.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China (Grant no. 31100948), the Natural Science Foundation of Jiangsu Province (Grant no. BK20131385), and the Natural Science Foundation of Heilongjiang Province (Grant no. D201114).

Supplementary Materials

OMIM descriptions of the top 10 disease genes that were detected by RWR on eleven integrated networks, seed genes for RWR algorithms were excluded.

Supplementary Material

References

A. S. Coates, E. K. A. Millar, S. A. O'Toole et al., “Prognostic interaction between expression of p53 and estrogen receptor in patients with node-negative breast cancer: results from IBCSG Trials VIII and IX,” Breast Cancer Research, vol. 14, article R143, no. 6, 2012.
View at: Publisher Site | Google Scholar
C. Wostenberg, J. W. Lary, D. Sahu et al., “The role of human Dicer-dsRBD in processing small regulatory RNAs,” PLoS ONE, vol. 7, no. 12, Article ID e51829, 2012.
View at: Publisher Site | Google Scholar
S. Lee, M. Kwon, J. M. Oh, and T. Park, “Gene-gene interaction analysis for the survival phenotype based on the cox model,” Bioinformatics, vol. 28, no. 18, pp. i582–i588, 2012.
View at: Publisher Site | Google Scholar
S. W. Chi, G. J. Hannon, and R. B. Darnell, “An alternative mode of microRNA target recognition,” Nature Structural and Molecular Biology, vol. 19, no. 3, pp. 321–327, 2012.
View at: Publisher Site | Google Scholar
P. Braun, A. R. Carvunis, B. Charloteaux et al., “Evidence for network evolution in an Arabidopsis interactome map,” Science, vol. 333, no. 6042, pp. 601–607, 2011.
View at: Publisher Site | Google Scholar
M. Li, X. Xu, and Y. Liu, “The set2-RPB1 interaction domain of human RECQ5 is important for transcription-associated genome stability,” Molecular and Cellular Biology, vol. 31, no. 10, pp. 2090–2099, 2011.
View at: Publisher Site | Google Scholar
A. Sanyal, B. R. Lajoie, G. Jain, and J. Dekker, “The long-range interaction landscape of gene promoters,” Nature, vol. 489, no. 7414, pp. 109–113, 2012.
View at: Publisher Site | Google Scholar
K. Dahlman-Wright, Y. Qiao, P. Jonsson, J. Gustafsson, C. Williams, and C. Zhao, “Interplay between AP-1 and estrogen receptor α in regulating gene expression and proliferation networks in breast cancer cells,” Carcinogenesis, vol. 33, no. 9, pp. 1684–1691, 2012.
View at: Publisher Site | Google Scholar
S. Lalonde, D. W. Ehrhardt, D. Loqué, J. Chen, S. Y. Rhee, and W. B. Frommer, “Molecular and cellular approaches for the detection of protein-protein interactions: latest techniques and current limitations,” Plant Journal, vol. 53, no. 4, pp. 610–635, 2008.
View at: Publisher Site | Google Scholar
P. Ulrichts, I. Lemmens, D. Lavens, R. Beyaert, and J. Tavernier, “MAPPIT (Mammalian protein-protein interaction trap) analysis of early steps in toll-like receptor signalling,” Methods in Molecular Biology, vol. 517, pp. 133–144, 2009.
View at: Publisher Site | Google Scholar
D. Li, W. Liu, Z. Liu et al., “PRINCESS, a protein interaction confidence evaluation system with multiple data sources,” Molecular and Cellular Proteomics, vol. 7, no. 6, pp. 1043–1052, 2008.
View at: Publisher Site | Google Scholar
E. E. Schadt, “Molecular networks as sensors and drivers of common human diseases,” Nature, vol. 461, no. 7261, pp. 218–223, 2009.
View at: Publisher Site | Google Scholar
L. Salwinski, C. S. Miller, A. J. Smith, F. K. Pettit, J. U. Bowie, and D. Eisenberg, “The database of interacting proteins: 2004 update,” Nucleic Acids Research, vol. 32, pp. D449–D451, 2004.
View at: Publisher Site | Google Scholar
T. S. Keshava Prasad, R. Goel, K. Kandasamy et al., “Human protein reference database—2009 update,” Nucleic Acids Research, vol. 37, no. 1, pp. D767–D772, 2009.
View at: Publisher Site | Google Scholar
C. Alfarano, C. E. Andrade, K. Anthony et al., “The Biomolecular Interaction Network Database and related tools 2005 update,” Nucleic Acids Research, vol. 33, pp. D418–D424, 2005.
View at: Publisher Site | Google Scholar
C. Stark, B. J. Breitkreutz, A. Chatr-Aryamontri et al., “The BioGRID interaction database: 2011 update,” Nucleic Acids Research, vol. 39, pp. D698–D704, 2011.
View at: Publisher Site | Google Scholar
S. Kerrien, B. Aranda, L. Breuza et al., “The IntAct molecular interaction database in 2012,” Nucleic Acids Research, vol. 40, no. 1, pp. D841–D846, 2012.
View at: Publisher Site | Google Scholar
L. Licata, L. Briganti, D. Peluso et al., “MINT, the molecular interaction database: 2012 update,” Nucleic Acids Research, vol. 40, no. 1, pp. D857–D861, 2012.
View at: Publisher Site | Google Scholar
R. Goel, H. C. Harsha, A. Pandey, and T. S. K. Prasad, “Human protein reference database and human proteinpedia as resources for phosphoproteome analysis,” Molecular BioSystems, vol. 8, no. 2, pp. 453–463, 2012.
View at: Publisher Site | Google Scholar
A. Barabási, N. Gulbahce, and J. Loscalzo, “Network medicine: a network-based approach to human disease,” Nature Reviews Genetics, vol. 12, no. 1, pp. 56–68, 2011.
View at: Publisher Site | Google Scholar
M. Wu, X. Li, H. N. Chua, C. Kwoh, and S. Ng, “Integrating diverse biological and computational sources for reliable protein-protein interactions,” BMC Bioinformatics, vol. 11, article S8, no. 7, 2010.
View at: Publisher Site | Google Scholar
C. Von Mering, R. Krause, B. Snel et al., “Comparative assessment of large-scale data sets of protein-protein interactions,” Nature, vol. 417, no. 6887, pp. 399–403, 2002.
View at: Google Scholar
R. Gentleman and W. Huber, “Making the most of high-throughput protein-interaction data,” Genome Biology, vol. 8, no. 10, article 112, 2007.
View at: Publisher Site | Google Scholar
Y. Qi, Z. Bar-Joseph, and J. Klein-Seetharaman, “Evaluation of different biological data and computational classification methods for use in protein interaction prediction,” Proteins, vol. 63, no. 3, pp. 490–500, 2006.
View at: Publisher Site | Google Scholar
K. Tarassov, V. Messier, C. R. Landry et al., “An in vivo map of the yeast protein interactome,” Science, vol. 320, no. 5882, pp. 1465–1470, 2008.
View at: Publisher Site | Google Scholar
L. J. Lu, Y. Xia, A. Paccanaro, H. Yu, and M. Gerstein, “Assessing the limits of genomic data integration for predicting protein networks,” Genome Research, vol. 15, no. 7, pp. 945–953, 2005.
View at: Publisher Site | Google Scholar
P. Kirk, J. E. Griffin, R. S. Savage, Z. Ghahramani, and D. L. Wild, “Bayesian correlated clustering to integrate multiple datasets,” Bioinformatics, vol. 28, no. 24, pp. 3290–3297, 2012.
View at: Publisher Site | Google Scholar
X. Lin and X. W. Chen, “Heterogeneous data integration by tree-augmented naïve Bayes for protein-protein interactions prediction,” Proteomics, vol. 13, no. 2, pp. 261–268, 2013.
View at: Publisher Site | Google Scholar
R. Jansen, H. Yu, D. Greenbaum et al., “A Bayesian networks approach for predicting protein-protein interactions from genomic data,” Science, vol. 302, no. 5644, pp. 449–453, 2003.
View at: Publisher Site | Google Scholar
E. Sprinzak, Y. Altuvia, and H. Margalit, “Characterization and prediction of protein-protein interactions within and between complexes,” Proceedings of the National Academy of Sciences of the United States of America, vol. 103, no. 40, pp. 14718–14723, 2006.
View at: Publisher Site | Google Scholar
L. V. Zhang, S. L. Wong, O. D. King, and F. P. Roth, “Predicting co-complexed protein pairs using genomic and proteomic data integration,” BMC Bioinformatics, vol. 5, article 38, 2004.
View at: Publisher Site | Google Scholar
M. Gerstein, N. Lan, and R. Jansen, “Proteomics. Integrating interactomes,” Science, vol. 295, no. 5553, pp. 284–287, 2002.
View at: Google Scholar
A. Ben-Hur and W. S. Noble, “Kernel methods for predicting protein-protein interactions,” Bioinformatics, vol. 21, no. 1, pp. i38–i46, 2005.
View at: Publisher Site | Google Scholar
D. R. Rhodes, S. A. Tomlins, S. Varambally et al., “Probabilistic model of the human protein-protein interaction network,” Nature Biotechnology, vol. 23, no. 8, pp. 951–959, 2005.
View at: Publisher Site | Google Scholar
X. W. Chen and M. Liu, “Prediction of protein-protein interactions using random decision forest framework,” Bioinformatics, vol. 21, no. 24, pp. 4394–4400, 2005.
View at: Publisher Site | Google Scholar
Y. Xu, W. Hu, Z. Chang et al., “Prediction of human protein-protein interaction by a mixed Bayesian model and its application to exploring underlying cancer-related pathway crosstalk,” Journal of the Royal Society Interface, vol. 8, no. 57, pp. 555–567, 2011.
View at: Publisher Site | Google Scholar
K. Xia, D. Dong, and J. J. Han, “IntNetDB v1.0: an integrated protein-protein interaction network database generated by a probabilistic model,” BMC Bioinformatics, vol. 7, article 508, 2006.
View at: Publisher Site | Google Scholar
H. Ge, Z. Liu, G. M. Church, and M. Vidal, “Correlation between transcriptome and interactome mapping data from Saccharomyces cerevisiae,” Nature Genetics, vol. 29, no. 4, pp. 482–486, 2001.
View at: Publisher Site | Google Scholar
A. Acland, R. Agarwala, T. Barrett et al., “Database resources of the National Center for Biotechnology Information,” Nucleic Acids Research, vol. 42, no. D1, pp. D7–D17, 2014.
View at: Google Scholar
A. Gavin, M. Bösche, R. Krause et al., “Functional organization of the yeast proteome by systematic analysis of protein complexes,” Nature, vol. 415, no. 6868, pp. 141–147, 2002.
View at: Publisher Site | Google Scholar
Y. Ho, A. Gruhler, and A. Heilbut, “Systematic identification of protein complexes in Saccharomyces cerevisiae by mass spectrometry,” Nature, vol. 415, no. 6868, pp. 180–183, 2002.
View at: Google Scholar
J. A. Brown, G. Sherlock, C. L. Myers et al., “Global analysis of gene function in yeast by quantitative phenotypic profiling,” Molecular Systems Biology, vol. 2, p. 2006.0001, 2006.
View at: Publisher Site | Google Scholar
A. M. Dudley, D. M. Janse, A. Tanay, R. Shamir, and G. M. Church, “A global view of pleiotropy and phenotypically derived gene function in yeast.,” Molecular Systems Biology, vol. 1, p. 2005.0001, 2005.
View at: Google Scholar
A. H. Y. Tong, M. Evangelista, A. B. Parsons et al., “Systematic genetic analysis with ordered arrays of yeast deletion mutants,” Science, vol. 294, no. 5550, pp. 2364–2368, 2001.
View at: Publisher Site | Google Scholar
A. H. Tong, G. Lesage, G. D. Bader et al., “Global mapping of the yeast genetic interaction network,” Science, vol. 303, no. 5659, pp. 808–813, 2004.
View at: Google Scholar
T. Shlomi, D. Segal, E. Ruppin, and R. Sharan, “QPath: a method for querying pathways in a protein-protein interaction network,” BMC Bioinformatics, vol. 7, article 199, 2006.
View at: Publisher Site | Google Scholar
A. Barabási and Z. N. Oltvai, “Network biology: understanding the cell's functional organization,” Nature Reviews Genetics, vol. 5, no. 2, pp. 101–113, 2004.
View at: Publisher Site | Google Scholar
J. Chen, B. J. Aronow, and A. G. Jegga, “Disease candidate gene identification and prioritization using protein interaction networks,” BMC Bioinformatics, vol. 10, article 73, 2009.
View at: Google Scholar
L. Sam, Y. Liu, J. Li, C. Friedman, and Y. A. Lussier, “Discovery of protein interaction networks shared by diseases,” in Proceedings of the Pacific Symposium on Biocomputing (PSB '07), pp. 76–87, January 2007.
View at: Google Scholar
H. Goehler, M. Lalowski, U. Stelzl et al., “A protein interaction network links GIT1, an enhancer of huntingtin aggregation, to Huntington's disease,” Molecular Cell, vol. 15, no. 6, pp. 853–865, 2004.
View at: Publisher Site | Google Scholar
H. Ruffner, A. Bauer, and T. Bouwmeester, “Human protein-protein interaction networks and the value for drug discovery,” Drug Discovery Today, vol. 12, no. 17-18, pp. 709–716, 2007.
View at: Publisher Site | Google Scholar
V. Neduva, R. Linding, I. Su-Angrand et al., “Systematic discovery of new recognition peptides mediating protein interaction networks,” PLoS Biology, vol. 3, no. 12, article e405, 2005.
View at: Publisher Site | Google Scholar
Z. Lubovac, J. Gamalielsson, and B. Olsson, “Combining functional and topological properties to identify core modules in protein interaction networks,” Proteins: Structure, Function and Genetics, vol. 64, no. 4, pp. 948–959, 2006.
View at: Publisher Site | Google Scholar
K. Lage, E. O. Karlberg, Z. M. Størling et al., “A human phenome-interactome network of protein complexes implicated in genetic disorders,” Nature Biotechnology, vol. 25, no. 3, pp. 309–316, 2007.
View at: Publisher Site | Google Scholar
M. Oti, B. Snel, M. A. Huynen, and H. G. Brunner, “Predicting disease genes using protein-protein interactions,” Journal of Medical Genetics, vol. 43, no. 8, pp. 691–698, 2006.
View at: Publisher Site | Google Scholar
M. Krauthammer, C. A. Kaufmann, T. C. Gilliam, and A. Rzhetsky, “Molecular triangulation: bridging linkage and molecular-network information for identifying candidate genes in Alzheimer's desease,” Proceedings of the National Academy of Sciences of the United States of America, vol. 101, no. 42, pp. 15148–15153, 2004.
View at: Publisher Site | Google Scholar
L. Franke, H. van Bakel, L. Fokkens, E. D. de Jong, M. Egmont-Petersen, and C. Wijmenga, “Reconstruction of a functional human gene network, with an application for prioritizing positional candidate genes,” The American Journal of Human Genetics, vol. 78, no. 6, pp. 1011–1025, 2006.
View at: Publisher Site | Google Scholar
I. Iossifov, T. Zheng, M. Baron, T. C. Gilliam, and A. Rzhetsky, “Genetic-linkage mapping of complex hereditary disorders to a whole-genome molecular-interaction network,” Genome Research, vol. 18, no. 7, pp. 1150–1162, 2008.
View at: Publisher Site | Google Scholar
M. Sekine, H. Nagata, S. Tsuji et al., “Localization of a novel susceptibility gene for familial ovarian cancer to chromosome 3p22-p25,” Human Molecular Genetics, vol. 10, no. 13, pp. 1421–1429, 2001.
View at: Google Scholar
D. Maglott, J. Ostell, K. D. Pruitt, and T. Tatusova, “Entrez Gene: gene-centered information at NCBI,” Nucleic Acids Research, vol. 39, no. 1, pp. D52–D57, 2011.
View at: Publisher Site | Google Scholar
M. A. van Driel, J. Bruggeman, G. Vriend, H. G. Brunner, and J. A. M. Leunissen, “A text-mining analysis of the human phenome,” European Journal of Human Genetics, vol. 14, no. 5, pp. 535–542, 2006.
View at: Publisher Site | Google Scholar
A. Hamosh, A. F. Scott, J. S. Amberger, C. A. Bocchini, and V. A. McKusick, “Online Mendelian Inheritance in Man (OMIM), a knowledgebase of human genes and genetic disorders,” Nucleic Acids Research, vol. 33, pp. D514–D517, 2005.
View at: Publisher Site | Google Scholar
C. E. Lipscomb, “Medical Subject Headings (MeSH),” Bulletin of the Medical Library Association, vol. 88, no. 3, pp. 265–266, 2000.
View at: Google Scholar
S. Zhang, Z. Chang, Z. Li et al., “Calculating phenotypic similarity between genes using hierarchical structure data based on semantic similarity,” Gene, vol. 497, no. 1, pp. 58–65, 2012.
View at: Publisher Site | Google Scholar
J. Xu and Y. Li, “Discovering disease-genes by topological features in human protein-protein interaction network,” Bioinformatics, vol. 22, no. 22, pp. 2800–2805, 2006.
View at: Publisher Site | Google Scholar
S. Navlakha and C. Kingsford, “The power of protein interaction networks for associating genes with diseases,” Bioinformatics, vol. 26, no. 8, pp. 1057–1063, 2010.
View at: Publisher Site | Google Scholar
P. A. Futreal, L. Coin, M. Marshall et al., “A census of human cancer genes,” Nature Reviews Cancer, vol. 4, no. 3, pp. 177–183, 2004.
View at: Publisher Site | Google Scholar
T. Santarius, J. Shipley, D. Brewer, M. R. Stratton, and C. S. Cooper, “A census of amplified and overexpressed human cancer genes,” Nature Reviews Cancer, vol. 10, no. 1, pp. 59–64, 2010.
View at: Publisher Site | Google Scholar
M. Zhu, L. Gao, X. Li et al., “The analysis of the drug-targets based on the topological properties in the human protein-protein interaction network,” Journal of Drug Targeting, vol. 17, no. 7, pp. 524–532, 2009.
View at: Publisher Site | Google Scholar
M. A. Yildirim, K. I. Goh, M. E. Cusick, A. L. Barabási, and M. Vidal, “Drug-target network,” Nature Biotechnology, vol. 25, no. 10, pp. 1119–1126, 2007.
View at: Google Scholar
C. Knox, V. Law, T. Jewison et al., “DrugBank 3.0: a comprehensive resource for “Omics” research on drugs,” Nucleic Acids Research, vol. 39, no. 1, pp. D1035–D1041, 2011.
View at: Publisher Site | Google Scholar
M. Wu, Q. Yu, X. Li, J. Zheng, J. Huang, and C. Kwoh, “Benchmarking human protein complexes to investigate drug-related systems and evaluate predicted protein complexes,” PLoS ONE, vol. 8, no. 2, Article ID e53197, 2013.
View at: Publisher Site | Google Scholar
G. D. Bader and C. W. V. Hogue, “An automated method for finding molecular complexes in large protein interaction networks.,” BMC Bioinformatics, vol. 4, no. 1, article 2, 2003.
View at: Google Scholar
J. Song and M. Singh, “From hub proteins to hub modules: the relationship between essentiality and centrality in the yeast interactome at different scales of organization,” PLoS Computational Biology, vol. 9, no. 2, Article ID e1002910, 2013.
View at: Publisher Site | Google Scholar
C. Zhang and L. Shen, “Functional modules analysis based on protein-protein network analysis in ankylosing spondylitis,” European Review for Medical and Pharmacological Sciences, vol. 16, no. 13, pp. 1821–1827, 2012.
View at: Google Scholar
P. Shannon, A. Markiel, O. Ozier et al., “Cytoscape: a software Environment for integrated models of biomolecular interaction networks,” Genome Research, vol. 13, no. 11, pp. 2498–2504, 2003.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2014 Nana Jin et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2098

Downloads

1098

Citations