 Proceedings
 Open Access
 Published:
Sensitive detection of pathway perturbations in cancers
BMC Bioinformatics volume 13, Article number: S9 (2012)
Abstract
Background
The normal functioning of a living cell is characterized by complex interaction networks involving many different types of molecules. Associations detected between diseases and perturbations in welldefined pathways within such interaction networks have the potential to illuminate the molecular mechanisms underlying disease progression and response to treatment.
Results
In this paper, we present a computational method that compares expression profiles of genes in cancer samples to samples from normal tissues in order to detect perturbations of predefined pathways in the cancer. In contrast to many previous methods, our scoring function approach explicitly takes into account the interactions between the gene products in a pathway. Moreover, we compute the subpathway that has the highest score, as opposed to merely computing the score for the entire pathway. We use a permutation test to assess the statistical significance of the most perturbed subpathway. We apply our method to 20 pathways in the Netpath database and to the Global Cancer Map of gene expression in 18 cancers. We demonstrate that our method yields more sensitive results than alternatives that do not consider interactions or measure the perturbation of a pathway as a whole. We perform a sensitivity analysis to show that our approach is robust to modest changes in the input data. Our method confirms numerous wellknown connections between pathways and cancers.
Conclusions
Our results indicate that integrating differential gene expression with the interaction structure in a pathway is a powerful approach for detecting links between a cancer and the pathways perturbed in it. Our results also suggest that even wellstudied pathways may be perturbed only partially in any given cancer. Further analysis of cancerspecific subpathways may shed new light on the similarities and differences between cancers.
Introduction
Complex diseases such as cancer are associated with the alteration or disregulation of multiple pathways and processes in the cell. Discovering and cataloging which pathways are perturbed in each type of cancer is important for improving our understanding of the mechanisms underlying these diseases. In particular, such studies can pinpoint pathways that may be uniquely perturbed in one or a small number of related cancers, thus providing potential targets for therapeutic studies.
Many methods have been developed to study the activation of predefined gene sets in human diseases and tissues [1–7]. In this context, a "gene set" is usually taken to be a collection of genes that share a common attribute, e.g., Gene Ontology annotation or membership in a pathway. For instance, Subramanian et al. [3] developed "Gene Set Enrichment Analysis" to test if a gene set is differentially expressed in two phenotypes by ranking all genes by some measure (say, the t statistic) and using a modified KolmogorovSmirnov statistic to decide whether the genes in the set have surprisingly high or low ranks. Segal et al. [8] used a hierarchical clustering algorithm to combine predefined gene sets into modules. They characterized geneexpression profiles in specific (sets of) tumors as a combination of activated and deactivated modules.
These methods ignore physical or functional interactions between the genes (or their products) in a gene set. Analysis of gene expression measurements in the context of the interaction structure inherent in a pathway can take into account both perturbations in gene expression and the topological properties of the network. More recent methods have sought to capture information about the activation of a pathway from the perspective of the interactions in it. A number of these techniques, reviewed by [9], have been developed for casecontrol data, for which we can compute pvalues reflecting the statistical significance of the differential expression of each gene between the samples in the treatment and those in the control [10–14]. Draghici et al. [10] combined a term that captured the significance of the genes in a pathway with an additional weighted term that measured how well the data matches the expected pattern of induction and repression, as encoded by the interactions in the pathway. Efroni et al. [11] used pathway perturbation measurements to predict prognosis and tumor grade. Both approaches measure the perturbation of a pathway in its entirety. Thus, they may not be sensitive to situations when only a subpathway is highly perturbed.
Related techniques analyze gene expression measurements made under an experimental condition in the context of a largescale proteinprotein interaction network (often integrated from multiple sources) in order to determine the subnetwork of interactions that respond to the experimental condition [15–19]. These approaches have primarily been used for determining the global response network perturbed in the cell in a particular condition, especially since most experimentallydetermined protein interactions have not yet been explicitly associated with pathways.
Our contributions
In this paper, we develop a systematic methodology to detect which pathways are perturbed in a disease. Here, we use the term pathway to refer to a network of physical interactions between genes and gene products that together perform a specific biological function. Given the interactions in a pathway (e.g., the TNF alpha pathway) and genomewide casecontrol gene expression data, i.e., measurements for a disease phenotype (e.g., melanoma) and a control phenotype (e.g., normal skin cells), our method computes the subpathway that is most perturbed in the disease (when compared to the control). Thus, our method combines the features of the two classes of methods discussed above: (i) it treats a pathway as a network of interconnected molecules rather than merely as a set of genes and gene products; (ii) it is sensitive to the possibility that the pathway is not perturbed in its entirety but that only some portion of it is significantly perturbed; and (iii) it can be applied to specific, welldefined pathways that a scientist may be interested in studying.
Our algorithm takes the interactions in a pathway P and casecontrol gene expression measurements as input. We first assess the differential expression of each gene in P. We develop a statistic based on the LiptakStouffer zscore that measures the combined perturbation of the genes in P. This statistic takes into account both the interactions in P and the differential expression of each gene. We use this statistic to compute which subpathway of P is maximally perturbed. Finally, we use a permutationbased test to assess the statistical significance of the maximallyperturbed subpathway.
Our results
We applied this approach to 20 cancer and immune signaling pathways in the Netpath database [20]. We used gene expression measurements in the Global Cancer Map (GCM) [21]. The GCM dataset spans 18 cancers and 13 normal tissues. First, we showed that the scores of perturbed subpathways computed by our method are much more statistically significant than the scores of the complete pathways. Second, we compared our results to those obtained by applying three techniques that analyze casecontrol gene expression data: ActiveModules [16], Gene Set Enrichment Analysis (GSEA) [3], and SubGSE [7]. ActiveModules integrates the gene expression data with protein interaction networks in order to find highly perturbed subnetworks. GSEA and SubGSE are networkfree approaches that find gene sets that are highly perturbed in the gene expression data. Our method showed much better sensitivity than both ActiveModules and GSEA in detecting perturbed subpathways. The comparison between our approach and SubGSE was mixed. Third, our method was robust to missing data, specifically to the removal of gene expression samples from the input. Finally, we found ample literature support for a number of pathwaycancer associations detected by our approach. Taken together, these results underscore the importance of carefully incorporating pathway structure into the analysis of gene expression data. We considered other recent approaches for comparison, which use mutual information to score individual genes [15], measure the synergistic relationship among a set of genes [22], or use biclustering to account for phenotypic variation among individuals [23, 24]. However, the number of samples per cancer in the GCM dataset is not sufficient to support robust computation of mutual information. These counts may not large enough to yield informative biclusters either. Therefore, we decided not to compare these methods with our approach in this paper.
Algorithms
We describe our approach in three stages. First, we formalize a measure of how perturbed a subnetwork of a pathway is in a casecontrol gene expression data set. Next, we describe how to compute a subnetwork that maximizes this measure. Finally, we discuss how we measure the statistical significance of the most perturbed subnetwork.
Conditionspecific pathway activation
We define a pathway P = (G, I) to be a graph composed of a set G of genes and a set I of physical or functional interactions between the genes in G or their gene products. Typically, P may be composed of multiple connected components. Given genomewide gene expression measurements in multiple patients diagnosed with a disease in a tissue and from normal samples of that tissue, our goal is to determine whether the pathway P = (G, I) is perturbed in the disease (when compared to normal tissue) and to compute the subgraph of P that is most perturbed in the disease.
For each gene g ∈ G, let p(g) denote the pvalue of its differential expression in the disease (when compared to normal tissue). We computed p(g) as the pvalue of the twosided ttest under the null hypothesis that the distributions of the expression values of g in the disease samples and in the normal samples have identical means (but may have different variances). We note that our pathway perturbation algorithm can take as input any gene expression preprocessing method that computes pvalues for differential gene expression. We converted the pvalue into a zscore z(g) = N^{}^{1}(1  p(g)), where N^{}^{1} is the inverse of the normal cumulative distribution function [16]. At this stage, we did not impose a cutoff on z(g). Instead, we included all genes in subsequent analysis. The rationale for this choice was that while individual genes may not be differentially expressed to a statisticallysignificant extent, significant perturbations may be noticeable at the level of sets of genes [25].
The method we developed takes the interaction structure of P into account. Let Q = (G', I') be a subgraph of P. We define the degree d_{ Q }(g) of a gene g ∈ I' to be the number of interactions in I' that are incident on g. We define the perturbation of a subgraph Q(G', I') of P to be the weighted LiptakStouffer zscore [26]
The numerator of z(Q) is the weighted sum of the zscores of all genes that appear in Q, where each gene is weighted by the number of interactions in Q that are incident on it. Dividing by the square root of the sum of squared gene degrees ensures that z(Q) is normally distributed with mean 0 and standard deviation 1, under the assumption that the zscores for the individual genes arise from a normal distribution. Thus, this formulation of perturbation combines pvalues over multiple genes in a statisticallysound way [27]. Each gene in Q contributes both its zscore and its degree in Q to z(Q). Thus, z(Q) incorporates both the differential expression of the genes in Q as well as the network of interactions between them.
Computing the subpathway that is most perturbed
Among all subgraphs of P, let $\widehat{P}$ be the one with maximum value of perturbation. Since $\widehat{P}$ is the most differentiallyperturbed subgraph of P, we use its perturbation to assess the overall perturbation of P. Thus, our formulation does not require that every gene in P be differentially expressed in order for us to declare that P itself is perturbed in the disease. We now describe how we compute $\widehat{P}$. Note that we do not require that $\widehat{P}$ be connected, since P itself may not be connected. Ideker et al. demonstrated that a similar problem is $\mathcal{N}\mathcal{P}$complete [16]. Hence, we use a heuristic approach based on simulated annealing. Although simulated annealing is a very well known technique, we describe it below and sketch it in Algorithm 1 for the sake of completeness. To initialize $\widehat{P}$, we include each interaction in P with a uniform probability of 0.5.
We perform the following series of operations for 100I iterations. (Recall that I is the set of interactions in P.) We select a node or an edge uniformly at random from P. Let the selected element be a. If a is already in $\widehat{P}$, we delete it from $\widehat{P}$; if a is a node, we also delete all edges that are incident on a from $\widehat{P}$. If a is not a member of $\widehat{P}$, we add it to $\widehat{P}$; if a is a node, we insert into $\widehat{P}$ all edges that were incident on a in P. Let ${\widehat{P}}^{\prime}$ be the resulting subgraph. We compute z(${\widehat{P}}^{\prime}$) and compare it to z($\widehat{P}$). If z(${\widehat{P}}^{\prime}$) is larger, we accept the modification, since we have increased the zscore. Otherwise, we accept the modification with a probability of ${e}^{\left(z{\left(\widehat{P}\right)}^{\prime}z\left(\widehat{P}\right)\right)/T}$, where T is the temperature in the current iteration. Over the iterations, we decrease the temperature T geometrically from T_{ s } = 100 to T_{ e } = 10^{5}. We output the final value of $\widehat{P}$.
Algorithm 1 Compute $\widehat{P}$, the subgraph of P with the maximum perturbation.
Initialize $\widehat{P}$ by including each interaction in P with probability 0.5.
T ← T_{ s }
for i = 1 .. . 100I do
${\widehat{P}}^{\prime}\leftarrow \widehat{P}$
Select a node or an edge a ∈ P uniformly at random.
if a is in $\widehat{P}$ then
Delete a from ${\widehat{P}}^{\prime}$.
else
Insert a into ${\widehat{P}}^{\prime}$.
end if
if z(${\widehat{P}}^{\prime}$) > z($\widehat{P}$) then
Set $\widehat{P}$ to be ${\widehat{P}}^{\prime}$
else
Set $\widehat{P}$ to be ${\widehat{P}}^{\prime}$ with probability ${e}^{\left(z\left({\widehat{P}}^{\prime}\right)z\left(\widehat{P}\right)\right)/T}$
end if
$T\leftarrow T\times {e}^{\frac{\text{log}\left(\frac{{T}_{e}}{{T}_{s}}\right)}{100\leftI\right}}$
end for
Remarks
We experimented with other options within this framework such as starting with an empty subgraph and performing more than 100I iterations. We did not find a significant benefit from either of these choices, i.e., the score of most perturbed subpathway did not increase substantially (data not shown). We also found that including the addition and deletion of nodes (along with their incident edges) yielded subgraphs with much larger scores than those obtained by addition and deletion of edges alone.
Estimating the statistical significance of perturbed pathways
A potential drawback of our definition of z($\widehat{P}$) is that it assumes that the zscores of the individual genes are independent. To ensure that z($\widehat{P}$) was not an over estimate of the significance of a perturbed pathway as a result of this assumption, we performed a permutationbased test to compute an empirical estimate of statistical significance. To build a null distribution for a disease and pathway P, we repeated the following procedure k times, where k varies depending on the analysis performed (see "Results" for the values we used):

(i)
We permuted node labels (and associated gene expression data) in the pathway. Let k be the number of genes in P. We replaced these k genes with k other genes, selected uniformly at random from a universe of genes (defined below). Let $\stackrel{\u0303}{P}$ be the new pathway. Note that $\stackrel{\u0303}{P}$ and P are isomorphic to each other, i.e., they have identical interaction structures.

(ii)
We obtained the zscores of the genes in $\stackrel{\u0303}{P}$ from the gene expression data set for the disease.

(iii)
We used the simulated annealing algorithm to compute z($\stackrel{\u0303}{P}$).
In the first step, we defined the universe to be the intersection of the set of all genes measured in the gene expression data set for the disease and the set of genes whose products were present in a protein interaction network containing 9352 proteins and 39890 interactions (assembled from multiple sources [28–31]). We used these two sets so that every gene in $\stackrel{\u0303}{P}$ (i) would have gene expression values and (ii) had a protein product that was known to participate in at least one interaction.
We computed the pvalue for z($\widehat{P}$) as the fraction of random trials where z($\stackrel{\u0303}{P}$) > z($\widehat{P}$). Since we tested multiple pathwaydisease pairs, we controlled the false discovery rate using the method of Benjamini and Hochberg [32]. We used the adjusted pvalue in all of the subsequent analysis.
Results
After describing the pathway and gene expression datasets we used, we present our results in five stages. First, we evaluate whether the mostperturbed pathway we computed were more statistically significantly that the entire pathway. Second, we compare the significance of the mostperturbed pathways computed by our algorithm to those found by the ActiveModules approach [16]. Third, we compare our results to GSEA [3], a purely geneset based approach. Fourth, we assess the robustness of our results to the removal of gene expression samples from the input. Finally, we present data in the literature that supports the pathwaycancer connections unearthed by our approach. At this stage, we also compare our results SubGSE [7], another geneset based approach.
Datasets
We obtained 20 curated pathways from the Netpath database [20]. These pathways include 10 signaling pathways associated with proliferation (Androgen receptor, Alpha6 Beta4 integrin, EGFR1, Hedgehog, ID, Kit receptor, Notch, TGF beta receptor, TNF alpha/NFkB, and Wnt) and 10 immune response signaling pathways (B cell receptor, T cell receptor, IL1 IL2 IL3 IL4 IL5 IL6 IL7 and IL9). We used gene expression measurements in the Global Cancer Map (GCM) [21]. The GCM dataset contains 190 samples spanning 18 cancers (adenocarcinomas of the breast, colon, lung, ovary, pancreas, prostate, and uterus; follicular and large Bcell lymphomas; melanoma; bladder; acute lymphoblastic leukemias of the B cell and T cell; acute myeloid leukemia; renal carcinoma; mesothelioma; and glioblastoma and medulloblastoma, which are two cancers of the central nervous system) and 90 samples from 13 normal tissues (bladder, breast, cerebellum, colon, germinal center, lung, kidney, ovary, pancreas, peripheral blood, prostate, uterus, and whole brain). We compared the samples for each cancer in the dataset to the samples from the corresponding normal tissue (e.g., prostate cancer and normal prostate) using the t test. We applied our algorithm to 360 cancerpathway pairs (18 cancers times 20 pathways). Note that if we performed k iterations of permutation testing followed by BenjaminiHochberg FDR correction, the smallest pvalue we would obtain would be 360/k.
Significance of partial pathway perturbation
When a signaling pathway is perturbed, not all components of the pathway will undergo transcriptional perturbation, because many changes occur at the posttranscriptional or past translational level. Thus when only transcriptional data are available, many pathways may appear to be partially perturbed. An important innovation in our approach is the ability to sensitively detect partial pathway perturbation. To assess the degree that pathways are partially perturbed, for each pathwaycancer pair, we computed the statistical significance of the perturbation score of the most perturbed pathway as well as for the complete pathway. We used 360,000 iterations of the permutation test, thus potentially obtaining pvalues as low as 0.001. We observed that for 153 pathwaycancer pairs, the most perturbed subpathway was significant at the 0.01 level, whereas only 17 pairs were significant at the 0.01 level for complete pathways. In Figure 1, for each of the 360 pathwaycancer pairs, we plot the pvalue measuring the perturbation of the entire pathway in the cancer (yaxis) against the pvalue of the mostperturbed subpathway in that cancer (xaxis). Figure 1(a) shows the data for all pathwaycancer pairs, while Figure 1(b) restricts the comparison to those pairs where the most perturbed pathway has a pvalue at most 0.01. Nearly all points in the plot lie above the green x = y line. This feature is especially pronounced in Figure 1(b), where x = y line is just visible above the xaxis. Note that the two x axes in this figure have ranges differing by two orders of magnitude. For all the pathwaycancer pairs plotted in Figure 1(b), we computed the ratio of the pvalue of the full pathway to the pvalue of the mostperturbed pathway. The median value in the distribution of these ratios was 47. Taken together, these results clearly demonstrate that calculating perturbation at the subpathway level is substantially more sensitive than calculating it at the whole pathway level.
The pathways in Netpath are carefully curated and we consider them canonical for the purposes of this study. Given the results just presented, a natural question that arises is whether the mostperturbed subpathway of a pathway P contains a significant fraction of the interactions in P. For each pathway, we counted how many interactions appeared to be perturbed in at least one cancer (considering only pvalues at most 0.01). In other words, for each pathway, we computed the union of its mostperturbed subpathways over all the cancers and counted the number of interactions in this union. Table 1 shows that in all but four pathways, fewer than 70% of the interactions in a pathway are perturbed. These data suggest that even such wellstudied pathways are perturbed only partially in cancers, at least when taking only gene expression data as an indicator of perturbation. Note that six pathways do not appear in this table because they were not perturbed in any of the cancers. We return to these perturbation results in the section "GCMNetpath Pathway Perturbations".
Comparison to ActiveModules
Methods that identify networks that are significantly perturbed in response to a single condition have been developed by multiple groups [16, 33, 19, 18]. Among the approaches that estimate the pvalue of the differential expression of each gene and use the pvalues as node weights in a protein interaction network, the ActiveModules algorithm developed by Ideker et al. [16] is widely used and readily available as a plugin for the Cytoscape software package [34]. ActiveModules operates on the same types of data as our approach. ActiveModules defines the score of a subnetwork Q(G', I') as:
Note that the set of interactions I' does not play a role in the definition of z_{ AM } (Q). ActiveModules utilizes the interactions in the network during the search for a subgraph Q with the highest value of z_{ AM } (Q), by ensuring that Q is connected. Thus, interactions play an indirect role in this approach. In contrast, our approach directly incorporates interaction structure into the scoring function.
We compared the significance of the subpathways found using our approach to those found using ActiveModules. To estimate pvalues, we executed both methods on 36,000 randomized pathway datasets. Note that ActiveModules can be computationally intensive to run since it includes an expensive check for subnetwork connectivity. Therefore, we performed only 36,000 runs of permutation testing, as opposed to the 360,000 iterations we executed in the section "Significance of Partial Pathway Perturbation". Thus, the smallest pvalue we could obtain was 0.01. We compared the pvalues produced by the two algorithms using a method similar to the earlier comparison of mostperturbed pathways to full pathways. In Figure 2(a), each point represents a pathwaycancer pair: the xaxis is the pvalue computed using our approach and the yaxis is the pvalue of the network computed using ActiveModules, with smaller pvalues indicating greater sensitivity. In Figure 2(b), we only plot these points when our algorithm yields a pvalue at most 0.05. Note that we used a cutoff of 0.05 instead of 0.01 because the smallest pvalue we could have obtained in this analysis was 0.01. We chose 0.05 so that we could visualize the range of pvalues between 0.01 and 0.05. Our algorithm produces a pvalue less than or equal to ActiveModules for all but 7 of the 232 pathwaycancer pairs that meet this cutoff. Note that in Figure 2(b), the range of pvalues produced by our algorithm is between 0 and 0.05 whereas the pvalues computed by ActiveModules span a much wider range. For each pathwaycancer pair in Figure 2(b), we computed the ratio of the pvalue computed by ActiveModules to the pvalue estimated by our algorithm. The median value in the distribution of these ratios was 16.5, implying that our algorithm yields pvalues that are an order of magnitude smaller than ActiveModules, on average. Taken together, these results demonstrate the superior sensitivity of explicitly incorporating interaction structure into scoring subpathways.
Comparison to GSEA
Our approach explicitly uses the interaction structure of pathways to calculate their perturbation. To assess the advantages of this approach, we compared our method to the geneoriented method GSEA [3]. GSEA compares two phenotypes of interest by sorting all the genes based on the difference in their expression profiles in the two phenotypes, e.g., by using the t statistic. Given a gene set of interest, GSEA uses a modified KolmogorovSmirnov statistic to test whether the genes in the gene set are ranked toward the top or the bottom of the sorted list. GSEA measures the statistical significance of an observed score by repeatedly permuting the phenotype labels of the samples.
We converted each Netpath pathway into the set of genes that are members of the pathway. We tested each of the 360 pathwaycancer using GSEA, ranking genes by the t statistic and generating 100,000 random permutations to assess the statistical significance of the computed scores. GSEA identified no Netpath gene set as significant in any cancer, even with an FDRadjusted pvalue less than 0.1. We had observed that perturbed pathways computed by our method may contain both up and downregulated genes. We reasoned that GSEA may not detect corresponding gene sets as significantly differentially expressed since these gene sets contain both genes with low ranks (large positive t statistics) and with high ranks (large negative t statistics). Therefore, we repeated the analysis using GSEA's option to rank genes by the absolute value of the t statistic. Even with this option, GSEA identified no pathwaycancer pairs as significant, even at the 0.1 level.
GSEA uses the null hypothesis that the distribution of the perturbation of the genes in a particular gene set is the same as the distribution of the rest of the genes measured in the transcriptional data set. Our approach uses the null hypothesis that the distribution of the perturbation of the genes in a particular pathway P is the same as the distribution of an equal number of randomlyselected genes, where the interactions between the randomlyselected genes are isomorphic to the interactions in P. To test the possibility that the stricter null hypothesis of GSEA prevents it from finding significant perturbations detected by our method, we used our results to construct a new gene set for each cancer. Each new gene set was composed of only those genes that participate in at least one of the mostperturbed subpathways in that cancer as determined by our method. We applied GSEA to these new gene sets, ranking genes by the absolute value of the t statistic. For 13 out of the 18 cancers, GSEA found that the combined gene set constructed based on our results was more significant than the gene set for any individual pathway. Yet, only two of these combined gene sets had an FDRcorrected pvalue less than 0.1. From this comparison with GSEA, we conclude that incorporating interaction structure is an important aspect of determining pathway perturbation.
Robustness of our approach to missing data
We evaluated the robustness of our approach to missing data. The GCM data contains multiple samples for each cancer. For each pathwaycancer pair, we removed each sample for that cancer from the input and recomputed the most perturbed subpathway and its statistical significance. This process was computationally intensive since we had to compute the statistical significance for each pathwaycancer about 15 times (depending on the number of samples in each cancer). Therefore, we ran 36,000 iterations of permutation testing, yielding pvalues at least as large as 0.01. For each pathwaycancer pair, we counted how many leaveoneout datasets yielded results that were similar to results obtained with the complete dataset. Specifically, if the pair was statistically significant, i.e., had a pvalue at most 0.05 in the full dataset, we counted the fraction of leaveoneout datasets for which the mostperturbed subpathway also had a pvalue at most 0.05. Conversely, for pathwaycancer pairs that were not statistically significant, i.e., had a pvalue greater than 0.05, we counted the fraction of leaveoneout datasets for which the most perturbed subpathway also had a pvalue greater than 0.05. We expected all these fractions to be close to 1, i.e., the significance for the full dataset would hold in the leaveoneout dataset as well.
Of the 360 cancerpathway pairs, 238 pairs were significant, i.e., they had a pvalue at most 0.05 with the full dataset, leaving 122 pairs with a pvalue greater than 0.05. As shown in Figure 3, of the 238 significant cancerpathway pairs, 58% of pairs (138 pairs) had a robustness of 1, i.e., every time we removed one of the samples for that cancer, the cancerpathway pair had a pvalue at most 0.05 with the remaining samples. Only 32% of the 258 pairs failed the significance test for more than half the samples. For the 122 pairs that were insignificant, as many as 96% (117 pairs) had a robustness of 1, i.e., the removal of every sample kept the perturbation pvalue larger than 0.05. We obtained very similar trends if we performed this analysis with a pvalue threshold of 0.01. These results suggest that our method is highly robust to modest changes in the input gene expression data.
GCMNetpath pathway perturbations
We assembled the results obtained in the section "Significance of partial pathway perturbation" on the differential perturbation of each Netpath pathway in each cancer in the GCM into the matrix shown in Figure 4(a). Of the 360 pathwaycancer pairs we analyzed, 35 pairs had FDRcorrected pvalues equal to 0.001, 118 pairs had pvalues greater than 0.001 and at most 0.01 and 78 pairs had pvalues greater than 0.01 and at most 0.05. Recall that we used using 360,000 permutations to obtain these results. Therefore, we could obtain pvalues as low as 0.001. Many pathways were perturbed in almost all the cancers, with pvalue less than 0.01: IL3 pathway (18), IL2 pathway (17), TNFalpha Pathway (17) EGFR1 pathway (16), TGFbeta receptor pathway (15), Alpha6 Beta4 Integrin pathway (14), and B Cell Receptor pathway (13). Seven pathways, including the Androgen receptor, Hedgehog, IL1, IL5, IL9, Notch, and Wnt signaling pathways were not significantly perturbed by any condition in our dataset, leaving 13 pathways that were perturbed by at least one cancer. Many cancers perturb more than half of these 13 pathways. A complete analysis of these results is beyond the scope of this paper. We focus on literature support for our results on two important pathways: tumor necrosis factor alpha (TNFalpha) and interleukin 2 (IL2). Both pathways are associated with many tumors (11 and 13, respectively) in our results. Support for these associations can be found in literature.
Both of these pathways have downregulated expression in multiple tumor types [35, 36]. The TNFalpha pathway is perturbed in association with CNS, melanoma, and bladder tumors, among others. TNFalpha is down regulated in tumors like melanoma [35]. Studies have observed the cytotoxic effects of TNFalpha on medulloblastoma [37]. Other work has found that TNFalpha is an important factor in breast cancer promotion and survival [38]. TNF is used for localized treatment of metastatic melanomas and other irresectable tumors [39]. Recombinant TNF has been effectively used to treat bladder tumors in vivo [40]. The interleukin 2 (IL2) pathway is another pathway that we find perturbed by many cancers. The IL2 pathway is an immune signaling pathway that is commonly down regulated in tumors like Tcell lymphoma [36]. Like TNFalpha, IL2 is also added exogenously to treat multiple cancer types including metastatic melanoma [41] and superficial bladder tumors [42]. These treatments were found to work in breast cancer cell lines that express the interleukin 2 receptor on the cell surface [43].
A comprehensive understanding of pathway perturbations has important implications in disease treatment. As noted above, exogenous treatment with recombinant TNF and IL2 have had success in mitigating tumor progression in a number of diseases [37, 39, 40, 42]. The success of these treatments illustrates that reversing pathway perturbation to a precancerous state can help to restore the healthy phenotype. Therefore, it is important to characterize both the extent and direction of pathway perturbation across diseases.
Comparison to SubGSE
SubGSE [7] is another geneset oriented method that has been reported to be more sensitive than GSEA. Therefore, we ran SubGSE on the GCM and Netpath data and compared the results to our perturbed pathwayscancer pairs. We ran SubGSE with 10,000 iterations (for the permutation test SubGSE uses to compute significance). The SubGSE software gave memory allocation errors for approximately 20,000 or more iterations. Since we could not run SubGSE for larger numbers of iterations, we did not correct the pvalues yielded by SubGSE for multiple hypotheses testing.
We found that both SubGSE and our method identified many common pathwaycancer associations (Figure 4). However, SubGSE failed to identify any cancer associations for the ID or the alpha 6 beta 4 integrin signaling pathways. These pathways are known to be perturbed in multiple tumor types. The ID signaling pathway has been associated with carcinogenesis by supporting tumor cell migration and invasion [44]. Although the ID pathway is mostly dormant after embryogenesis, the pathway is reactivated during tumor progression [45]. Upregulation of the alpha 6 beta 4 integrin pathway has been associated with metastatic potential in many cancers [46]. In tumor microenvironments, alpha 6 beta 4 is relocalized to the leading edge of tumor cells and promotes invasion [46]. While SubGSE has superior sensitivity to GSEA, SubGSE was not sensitive enough to identify these important associations.
However, our approach was not able to identify significant associations with the Wnt or Androgen receptor pathways that were detected by SubGSE. Both pathways are known to be associated with multiple cancer types. Disregulation of the Wnt signaling pathway leads to upregulated expression of Bcatenin, which ultimately results in increased proliferation of tumor cells [47]. SubGSE is able to identify numerous cancers in which the Androgen receptor pathway is perturbed. However, neither SubGSE nor our method was detect the wellknown and widely studied association between this pathway and prostate cancer [48]. We note that the increased sensitivity of SubGSE in the case of these two pathways may arise from the fact that we did not adjust for testing multiple hypotheses in the case of SubGSE.
Summary
Our results indicate that integrating differential gene expression with the interaction structure in a pathway is a powerful approach for detecting links between a cancer and the pathways perturbed in it. The use of Stouffer's zscore to combine multiple pvalues provides an important advantage over methods that consider pathway membership alone: in many perturbed pathways, we noticed that the receptor protein at the head of the pathway was very slightly differentially expressed, often not to a statistically significant extent, whereas many genes with products downstream of the receptor were differentially expressed (data not shown). Our use of meta analysis to combine pvalues enabled detection of the perturbation of the pathway even in such cases.
There are several avenues for future work. Our method currently ignores the direction of differential expression of each gene. Incorporating this information is important. It is also essential to take into account prior information on whether any interactions are regulatory and on the type of regulation implied by an interaction [10]. Such information may yield pathways with both directed and undirected interactions. Finally, it would be interesting to use universal protein interaction networks in order to expand curated pathways.
References
 1.
Barry WT, Nobel AB, Wright FA: Significance analysis of functional categories in gene expression studies: a structured permutation approach. Bioinformatics. 2005, 21 (9): 19431949. 10.1093/bioinformatics/bti260.
 2.
Edelman E, Porrello A, Guinney J, Balakumaran B, Bild A, Febbo PG, Mukherjee S: Analysis of sample set enrichment scores: assaying the enrichment of sets of genes for individual samples in genomewide expression profiles. Bioinformatics. 2006, 22 (14): e108e116. 10.1093/bioinformatics/btl231.
 3.
Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, Paulovich A, Pomeroy SL, Golub TR, Lander ES, Mesirov JP: Gene set enrichment analysis: a knowledgebased approach for interpreting genomewide expression profiles. Proc Natl Acad Sci USA. 2005, 102: 1554515550. 10.1073/pnas.0506580102.
 4.
Guo Z, Zhang T, Li X, Wang Q, Xu J, Yu H, Zhu J, Wang H, Wang C, Topol EJ, Wang Q, Rao S: Towards precise classification of cancers based on robust gene functional expression profiles. BMC Bioinformatics. 2005, 6: 5810.1186/14712105658.
 5.
Tian L, Greenberg SA, Kong SW, Altschuler J, Kohane IS, Park PJ: Discovering statistically significant pathways in expression profiling studies. Proc Natl Acad Sci USA. 2005, 102 (38): 1354413549. 10.1073/pnas.0506577102.
 6.
Khatri P, Drăghici S: Ontological analysis of gene expression data: current tools, limitations, and open problems. Bioinformatics. 2005, 21 (18): 35873595. 10.1093/bioinformatics/bti565.
 7.
Yan X, Sun F: Testing gene set enrichment for subset of genes: SubGSE. BMC Bioinformatics. 2008, 9: 36210.1186/147121059362.
 8.
Segal E, Friedman N, Koller D, Regev A: A module map showing conditional activity of expression modules in cancer. Nat Genet. 2004, 36 (10): 10908. 10.1038/ng1434.
 9.
Wu Z, Zhao X, Chen L: Identifying responsive functional modules from proteinprotein interaction network. Mol Cells. 2009, 27 (3): 271277. 10.1007/s100590090035x.
 10.
Draghici S, Khatri P, Tarca AL, Amin K, Done A, Voichita C, Georgescu C, Romero R: A systems biology approach for pathway level analysis. Genome Res. 2007, 17: 15371545. 10.1101/gr.6202607. gr.6202607
 11.
Efroni S, Schaefer CF, Buetow KH: Identification of key processes underlying cancer phenotypes using biologic pathway analysis. PLoS One. 2007, 2 (5): e42510.1371/journal.pone.0000425.
 12.
Qiu YQ, Zhang S, Zhang XS, Chen L: Detecting disease associated modules and prioritizing active genes based on high throughput data. BMC Bioinformatics. 2010, 11: 2610.1186/147121051126.
 13.
Keller A, Backes C, Gerasch A, Kaufmann M, Kohlbacher O, Meese E, Lenhof HP: A novel algorithm for detecting differentially regulated paths based on gene set enrichment analysis. Bioinformatics. 2009, 25 (21): 27872794. 10.1093/bioinformatics/btp510.
 14.
Ulitsky I, Krishnamurthy A, Karp RM, Shamir R: DEGAS: de novo discovery of dysregulated pathways in human diseases. PLoS One. 2010, 5 (10): e1336710.1371/journal.pone.0013367.
 15.
Chuang HY, Lee E, Liu YT, Lee D, Ideker T: Networkbased classification of breast cancer metastasis. Mol Syst Biol. 2007, 3: 140
 16.
Ideker T, Ozier O, Schwikowski B, Siegel AF: Discovering regulatory and signalling circuits in molecular interaction networks. Bioinformatics. 2002, 18 (Suppl 1): S233S240. 10.1093/bioinformatics/18.suppl_1.S233.
 17.
Liu M, Liberzon A, Kong SW, Lai WR, Park PJ, Kohane IS, Kasif S: Networkbased analysis of affected biological processes in type 2 diabetes models. PLoS Genet. 2007, 3 (6): e9610.1371/journal.pgen.0030096.
 18.
Dittrich MT, Klau GW, Rosenwald A, Dandekar T, Muller T: Identifying functional modules in proteinprotein interaction networks: an integrated exact approach. Bioinformatics. 2008, 24 (13): i223i231. 10.1093/bioinformatics/btn161.
 19.
Ulitsky I, Shamir R: Identification of functional modules using network topology and highthroughput data. BMC Syst Biol. 2007, 1: 810.1186/1752050918.
 20.
Kandasamy K, Mohan SS, Raju R, Keerthikumar S, Kumar GS, Venugopal AK, Telikicherla D, Navarro JD, Mathivanan S, Pecquet C, Gollapudi SK, Tattikota SG, Mohan S, Padhukasahasram H, Subbannayya Y, Goel R, Jacob HK, Zhong J, Sekhar R, Nanjappa V, Balakrishnan L, Subbaiah R, Ramachandra YL, Rahiman BA, Prasad TS, Lin JX, Houtman JC, Desiderio S, Renauld JC, Constantinescu SN, Ohara O, Hirano T, Kubo M, Singh S, Khatri P, Draghici S, Bader GD, Sander C, Leonard WJ, Pandey A: NetPath: a public resource of curated signal transduction pathways. Genome Biol. 2010, 11: R310.1186/gb2010111r3.
 21.
Ramaswamy S, Tamayo P, Rifkin R, Mukherjee S, Yeang CH, Angelo M, Ladd C, Reich M, Latulippe E, Mesirov JP, Poggio T, Gerald W, Loda M, Lander ES, Golub TR: Multiclass cancer diagnosis using tumor gene expression signatures. Proc Natl Acad Sci USA. 2001, 98 (26): 1514915154. 10.1073/pnas.211566398.
 22.
Chowdhury SA, Koyutürk M: Identification of coordinately dysregulated subnetworks in complex phenotypes. Pac Symp Biocomput. 2010, 133144.
 23.
Dao P, Colak R, Salari R, Moser F, Davicioni E, Schönhuth A, Ester M: Inferring cancer subnetwork markers using densityconstrained biclustering. Bioinformatics. 2010, 26 (18): i62510.1093/bioinformatics/btq393.
 24.
Chowdhury S, Nibbe R, Chance M, Koyutürk M: Subnetwork state functions define dysregulated subnetworks in cancer. J Comput Biol. 2011, 18 (3): 263281. 10.1089/cmb.2010.0269.
 25.
Mootha V, Lindgren C, Eriksson K, Subramanian A, Sihag S, Lehar J, Puigserver P, Carlsson E, Ridderstrale M, Laurila E, Houstis N, Daly M, Patterson N, Mesirov J, Golub T, Tamayo P, Spiegelman B, Lander E, Hirschhorn J, Altshuler D, Groop L: PGC1alpharesponsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes. Nat Genet. 2003, 34 (3): 267273. 10.1038/ng1180.
 26.
Setlur SR, Royce TE, Sboner A, Mosquera JM, Demichelis F, Hofer MD, Mertz KD, Gerstein M, Rubin MA: Integrative microarray analysis of pathways dysregulated in metastatic prostate cancer. Cancer Res. 2007, 67 (21): 1029610303. 10.1158/00085472.CAN072173.
 27.
Hedges L, Olkin I: Statistical Methods for Metaanalysis. 1985, Academic Press
 28.
Ramani AK, Bunescu RC, Mooney RJ, Marcotte EM: Consolidating the set of known human proteinprotein interactions in preparation for largescale mapping of the human interactome. Genome Biol. 2005, 6 (5): R4010.1186/gb200565r40.
 29.
Lehner B, Fraser AG: A firstdraft human proteininteraction map. Genome Biol. 2004, 5 (9): R6310.1186/gb200459r63.
 30.
Stelzl U, Worm U, Lalowski M, Haenig C, Brembeck F, Goehler H, Stroedicke M, Zenkner M, Schoenherr A, Koeppen S, Timm J, Mintzlaff S, Abraham C, Bock N, Kietzmann S, Goedde A, Toksoz E, Droege A, Krobitsch S, Korn B, Birchmeier W, Lehrach H, Wanker E: A human proteinprotein interaction network: a resource for annotating the proteome. Cell. 2005, 122 (6): 957968. 10.1016/j.cell.2005.08.029.
 31.
Rual J, Venkatesan K, Hao T, HirozaneKishikawa T, Dricot A, Li N, Berriz G, Gibbons F, Dreze M, AyiviGuedehoussou N, Klitgord N, Simon C, Boxem M, Milstein S, Rosenberg J, Goldberg D, Zhang L, Wong S, Franklin G, Li S, Albala J, Lim J, Fraughton C, Llamosas E, Cevik S, Bex C, Lamesch P, Sikorski R, Vandenhaute J, Zoghbi H, Smolyar A, Bosak S, Sequerra R, DoucetteStamm L, Cusick M, Hill D, Roth F, Vidal M: Towards a proteomescale map of the human proteinprotein interaction network. Nature. 2005, 437 (7062): 11731178. 10.1038/nature04209.
 32.
Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. 1995, 57: 289300.
 33.
Maraziotis IA, Dimitrakopoulou K, Bezerianos A: Growing functional modules from a seed protein via integration of protein interaction and gene expression data. BMC Bioinformatics. 2007, 8: 40810.1186/147121058408.
 34.
Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, Amin N, Schwikowski B, Ideker T: Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res. 2003, 13 (11): 24982504. 10.1101/gr.1239303.
 35.
Novak EM, Metzger M, Chammas R, da Costa M, Dantas K, Manabe C, Pires J, de Oliveira AC, Bydlowski SP: Downregulation of TNFalpha and VEGF expression by Sp1 decoy oligodeoxynucleotides in mouse melanoma tumor. Gene Ther. 2003, 10 (23): 19921997. 10.1038/sj.gt.3302111.
 36.
Duprez V, Cornet V, DautryVarsat A: Downregulation of high affinity interleukin 2 receptors in a human tumor T cell line. Interleukin 2 increases the rate of surface receptor decay. J Biol Chem. 1988, 263 (26): 1286012865.
 37.
Maeda H, Uozumi T, Kurisu K, Matsuoka T, Kawamoto K, Kiya K, Ogasawara H, Sugiyama K, Mikami T, Monden S: Combined antitumor effects of TNF and GCSF on a human medulloblastoma xenograft line. J Neurooncol. 1994, 21 (3): 203213. 10.1007/BF01063769.
 38.
GarciaTunon I, Ricote M, Ruiz A, Fraile B, Paniagua R, Royuela M: Role of tumor necrosis factoralpha and its receptors in human benign breast lesions and tumors (in situ and infiltrative). Cancer Sci. 2006, 97 (10): 10441049. 10.1111/j.13497006.2006.00277.x.
 39.
van Horssen R, Ten Hagen TL, Eggermont AM: TNFalpha in cancer treatment: molecular insights, antitumor effects, and clinical utility. Oncologist. 2006, 11 (4): 397408. 10.1634/theoncologist.114397.
 40.
Bahnson RR, Ratliff TL: In vitro and in vivo antitumor activity of recombinant mouse tumor necrosis factor (TNF) in a mouse bladder tumor (MBT2). J Urol. 1990, 144: 172175.
 41.
Atkins MB, Kunkel L, Sznol M, Rosenberg SA: Highdose recombinant interleukin2 therapy in patients with metastatic melanoma: longterm survival update. Cancer J Sci Am. 2000, 6 (Suppl 1): S11S14.
 42.
Fujioka T, Shiraishi M, Tanji S, Sato S, Koike H, Aoki H, Suzuki K, Kumagai K, Banya Y, Kubo T: The efficacy of recombinant interleukin 2 in local treatment of superficial bladder tumors. Hinyokika Kiyo. 1988, 34 (12): 21152119.
 43.
Katano M, Matsuo T, Morisaki T, Naito K, Nagumo F, Kubota E, Nakamura M, Hisatsugu T, Tadano J: Increased proliferation of a human breast carcinoma cell line by recombinant interleukin2. Cancer Immunol Immunother. 1994, 39 (3): 161166.
 44.
Coma S, Amin DN, Shimizu A, Lasorella A, Iavarone A, Klagsbrun M: Id2 promotes tumor cell migration and invasion through transcriptional repression of semaphorin 3F. Cancer Res. 2010, 70 (9): 38233832. 10.1158/00085472.CAN093048.
 45.
Perk J, Iavarone A, Benezra R: Id family of helixloophelix proteins in cancer. Nat Rev Cancer. 2005, 5 (8): 603614. 10.1038/nrc1673.
 46.
Mercurio AM, Rabinovitz I: Towards a mechanistic understanding of tumor invasionlessons from the alpha6beta 4 integrin. Semin Cancer Biol. 2001, 11 (2): 129141. 10.1006/scbi.2000.0364.
 47.
Polakis P: Wnt signaling and cancer. Genes Dev. 2000, 14 (15): 18371851.
 48.
Chen Y, Sawyers CL, Scher HI: Targeting the androgen receptor pathway in prostate cancer. Curr Opin Pharmacol. 2008, 8 (4): 440448. 10.1016/j.coph.2008.07.005.
Acknowledgements
This work was supported by a grant from the Institute for Critical Technology and Applied Science at the Virginia Polytechnic Institute and State University to TMM and NSF grant DBI0211863 to BT.
This article has been published as part of BMC Bioinformatics Volume 13 Supplement 3, 2012: ACM Conference on Bioinformatics, Computational Biology and Biomedicine 2011. The full contents of the supplement are available online at http://www.biomedcentral.com/14712105/13/S3.
Author information
Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
All authors developed the method, and CGR implemented the algorithm. CGR and TMM analyzed the results, and all authors wrote the article.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Rivera, C.G., Tyler, B.M. & Murali, T. Sensitive detection of pathway perturbations in cancers. BMC Bioinformatics 13, S9 (2012). https://doi.org/10.1186/1471210513S3S9
Published:
Keywords
 Gene Expression Data
 Protein Interaction Network
 Gene Expression Measurement
 Immune Signaling Pathway
 Androgen Receptor Pathway