- Research article
- Open Access
Graph based fusion of miRNA and mRNA expression data improves clinical outcome prediction in prostate cancer
© Gade et al.; licensee BioMed Central Ltd. 2011
- Received: 23 September 2011
- Accepted: 21 December 2011
- Published: 21 December 2011
One of the main goals in cancer studies including high-throughput microRNA (miRNA) and mRNA data is to find and assess prognostic signatures capable of predicting clinical outcome. Both mRNA and miRNA expression changes in cancer diseases are described to reflect clinical characteristics like staging and prognosis. Furthermore, miRNA abundance can directly affect target transcripts and translation in tumor cells. Prediction models are trained to identify either mRNA or miRNA signatures for patient stratification. With the increasing number of microarray studies collecting mRNA and miRNA from the same patient cohort there is a need for statistical methods to integrate or fuse both kinds of data into one prediction model in order to find a combined signature that improves the prediction.
Here, we propose a new method to fuse miRNA and mRNA data into one prediction model. Since miRNAs are known regulators of mRNAs we used the correlations between them as well as the target prediction information to build a bipartite graph representing the relations between miRNAs and mRNAs. This graph was used to guide the feature selection in order to improve the prediction. The method is illustrated on a prostate cancer data set comprising 98 patient samples with miRNA and mRNA expression data. The biochemical relapse was used as clinical endpoint. It could be shown that the bipartite graph in combination with both data sets could improve prediction performance as well as the stability of the feature selection.
Fusion of mRNA and miRNA expression data into one prediction model improves clinical outcome prediction in terms of prediction error and stable feature selection. The R source code of the proposed method is available in the supplement.
- Feature Selection
- Prediction Error
- Bipartite Graph
- Bootstrap Sample
High throughput techniques, such as gene expression arrays, have made it possible to identify biomarkers and gene signatures for a wide range of diseases. For breast cancer several gene signatures have been proven to have a prognostic value [1–3]. Based on these, multigene tests like MammaPrint and Oncotype DX have found their way into clinical practice . However, the efforts in using gene expression data to stratify cancer patients unraveled general limitations. Prognostic or predictive signatures are often restricted to a subset of patients which meet specific inclusion criteria like epidemiological, histopathological and clinical characteristics. Furthermore, gene expression data alone often did not reflect robust molecular subtypes in other cancer entities. For example in prostate cancer, one of the most frequent cancer types among men , the robust molecular diagnosis of a clinical relevant disease is still a challenge .
Genome scale experiments measure thousands up to millions of features. To be able to build clinical prediction models with these data, methodology from the field of machine learning is applied. Popular methods include SVM , Random Forests , and certain boosting approaches . A particular challenge is the high number of features in the training data, especially if the correlation structure among the measured features is unknown. Therefore, the training results often remain unsatisfactory. In the past, integration of other sources of data that lead to an improved feature selection and thus to a better generalization of the prediction model has been discussed. Recent methods have integrated estimates of the correlation structure of the data based on prior information represented as graphs. The graph was gained from biological knowledge on interactions between genes or membership of genes to common pathways [10–15]. Other methods have integrated different kind of omics data . When integrating data from different levels, properties and scales have to be taken into account as well as the relations between the different types of features.
Here, we propose a new method to fuse gene expression data with microRNA (miRNA) expression data into one risk prediction model. miRNAs are small, around 22 base pairs long, non-coding RNAs that regulate gene expression post-transcriptionally. By sequence mediated binding of the miRNA to its target, the translational process is blocked or the mRNA is predisposed to degradation. Deregulation of miRNAs has been linked to development and progression of several tumor entities including prostate cancer [17–20]. Because of their regulatory nature, the primary targets of a miRNA are of particular interest. Since experimentally validated targets are rare, target prediction algorithms are an important source of knowledge when dealing with miRNA expression data. Several algorithms and databases for miRNA target predictions have been established in the last years including e.g. miRanda , TargetScan , and PicTar .
Our new method uses a bipartite graph combining correlations between miRNA and gene expression data, and target prediction information. This gave rise to better prediction results compared to the single data sets in a prostate cancer data set encompassing 98 tumor samples.
The manuscript is organized as follows. The first section describes the general setup including high-dimensional time-to-event data and the measure of prediction error as well as the prediction methods. In the results part the final workflow is explained in detail and the performance on the prostate cancer data set is shown. Comparisons with two other prediction methods suited for time-to-event data are shown as well. The manuscript closes with a discussion and conclusion.
High dimensional time-to-event data
Usually, observations are of the form (t1, δ1, x 1 ), ..., (t n , δ n , x n ) where t i is an observed time, δ i a censoring indicator (1 indicates an event while 0 indicates censoring), and x i = (x1, ..., x p ) a feature vector. The Cox model describes the instantaneous risk of having an event at a given time point t. In a high-dimensional setting x i and thus β comprises several thousands of features, most of them irrelevant for predicting h(t|x). Therefore, it is reasonable to assume most of the entries in β to be 0 and methods with an implicit feature selection are preferable.
Prediction error curves and IPEC
Estimation of prediction error
To estimate the prediction performance (and compare it among different models) for new patients without the need to set aside test data the .632 bootstrap estimator  was used. For every bootstrap sample the .632 estimator of the prediction error curve was calculated leading to the IPEC.
Boosting belongs to the class of ensemble learners. The basic principle of boosting is the weighted combination of several weak classifiers in order to build one strong classifier . This is equal to iteratively fit an additive model in function space by minimizing a loss function .
All other elements of the parameter estimation remain unchanged (and therewith zero in most cases). The number of boosting steps M is a tuning parameter which needs to be optimized e.g. via cross-validation. Usually, a common penalty parameter λ = λ j, k is used for all covariates and boosting steps. It should be chosen in a way the resulting number of boosting steps is larger than 50 . In this study the CoxBoost R-package  was used to train the CoxBoost models.
with a likelihood function l(β). Originally, quadratic programming was proposed to solve (9) for linear regression models . Since the solution for Cox proportional hazard models is much more computationally intensive, Goeman proposed a solution of the Lasso estimation based on gradient ascent optimization . In this paper the R-package penalized  was used to fit the Lasso estimator.
Random survival forests
A third method is based on decisions trees. Random survival forests  (RSF) is an extension of the Random forests  for right censored survival data. A collection of binary decision trees is build by bootstrap samples. In every tree at every node a random subset of m features is chosen. The survival difference between the daughter nodes is used to choose a feature and a split point. The R-package randomSurvivalForest  was used to train the model. The optimal value of m was determined via bootstrap [27, 41] using the peperr R-package .
Prostate cancer data set
A prostate cancer data set from Taylor et al.  was used in this study. Raw expression data from Affymetrix Human Exon 1.0 ST arrays were obtained from the NCBI GEO data repository (GEO accession number GSE21034) comprising 131 samples of tumor patients. Furthermore, miRNA expression data from the Agilent microRNA V2 were downloaded (GEO accession number GSE21036) including 113 samples of tumor patients.
Gene expression profiles were derived from the CEL files using Robust Multichip Average (RMA)  implemented in the Affymetrix Power Tools (APT). Raw data files from miRNA expression data were analyzed using the limma R-package . After quantile normalization  control probes were removed and the 16 replicates of each miRNA were summarized using the sample-wise median. At the end only tumor samples with gene expression as well as miRNA expression data were used yielding a data matrix with 98 tumor samples, 17881 transcripts, and 723 miRNAs.
Clinical parameters of the patients samples were downloaded from the supplemental material . The time to biochemical relapse (BCR) and the censoring status for 98 cancer patients were available. Of these 98 patients 18 suffered a relapse and 80 were censored.
Target predictions were downloaded from MicroCosm targets [21, 46] (formerly miRBase Targets) version 5. The p-values of these predictions were extracted for every miRNA-transcript pair (the transcripts were given as Ensembl transcript identifiers). For comparison the TargetScan 5.2 predictions  were downloaded.
Graph-based integration of miRNA and mRNA expression data
Since many tests (p1 × p2) were performed, the resulting p-values were corrected for multiple testing  (in the following refers to the corrected values). The second source of knowledge were the target predictions from MicroCosm . The p-values of these prediction were used to strengthen the importance of the connection of a mRNA m i and a certain miRNA mi j in the case where m i is a predicted target of mi j . Since the MicroCosm target database holds only mRNA-miRNA pairs with a p-value below 0.05 the p-values of pairs not present in MicroCosm were set to 1.
where is the probability distribution function of the standard normal distribution. For miRNAs and mRNAs not listed in MicroCosm targets the combined p-values were set to the correlation p-values.
The resulting matrix of weights W = w i, j could be viewed as the p1 × p2 adjacency matrix of a bipartite graph describing the relations between mRNAs and miRNAs.
Similar to graphs describing biological pathway knowledge the mRNA-miRNA graph W described the regulations among the features. Every time an mRNA m i was picked the penalties λ of miRNAs connected to m i were lowered according to the weight of the connection. As a consequence it was more likely to choose a miRNA mi j highly correlated and being a predicted regulator of m i in one of the next boosting steps. miRNAs with a connection with high weight to m i are likely to be a direct regulator of mi and therefore of importance for the event as well. The stepsize modification factor was set to a fixed value of 0.9 for all boosting runs.
Graph information reduces prediction error of CoxBoost
Comparison of Boosting Results.
both no graph
both with graph
There was no difference between the models trained only on the mRNAs and the model trained on both data sets without the graph. CoxBoost with only the miRNA expression data seemed to perform slightly worse.
Comparison with other methods
Comparison with Other Methods.
CoxBoost with graph
Graph information improves stability of feature selection
Another difference lies in the balance of genes and miRNAs picked by the models. While the number of genes and miRNAs among the top ten features using CoxBoost without graph were almost equal, in the list of CoxBoost with graph information there were only miRNAs.
Additionally, to exclude the possibility of overfitting the models were trained with a graph which was build separately for every single bootstrap sample. Therefore the correlations were calculated and tested solely on the patient samples included in the bootstrap sample. In this case the prediction error increased to 5.64 (median of 500 bootstrap samples) with an IQR of 0.99. In comparison with the IPECs of CoxBoost without graph the prediction error was significant smaller assuming a significance level of 0.05 (p-value from one-sided Wilcoxon test: 0.006). The runtime increased to 21:36 hours.
To asses the influence of the target prediction database one graph was constructed using TargetScan in the version 5.2. As a p-value for a miRNA-mRNA pair 1 - P CT was used. The P CT value given in the TargetScan flatfiles is a score that can be used to asses the biological relevance of predicted miRNA-mRNA interactions . 1 - P CT is an estimate of the FDR. CoxBoost using this graph yielded a median IPEC of 6.60 with an IQR of 0.95.
Due to their role as post-transcriptional regulators of around 30% of the human genome and their involvement in cancer development and progression [17, 18, 20, 50], miRNAs become more and more important for our understanding of the mechanisms leading to cancer. Since miRNAs are smaller than mRNAs they are more stable and in general more resistant against degradation processes than the longer mRNAs. Consequently, miRNA expression is measurable even in serum  and paraffin-embedded samples where mRNA expression is hardly detectable.
Several studies have combined gene and miRNA expression data [52, 53] or gene expression data with miRNA target predictions  to infer new miRNA regulation activities. In addition, several tools have been developed to integrate such data [55, 56]. In most cases, correlations between mRNA and miRNA expression profiles gained from matched samples and target prediction scores are most relevant for the analysis.
While there are several approaches to integrate mRNA and miRNA data to discover novel regulatory relation between miRNAs and mRNAs there is still a lack of prediction methods combining both kinds of data into one common prediction model. A central problem in these high-dimensional data is the tendency to overfit. When integrating several omics data sets the number of features increases, which makes the feature selection even more important.
In this article we introduce a method capable to fuse mRNA and miRNA expression data in a model to predict a clinical endpoint. Likelihood boosting was used as a method for fitting risk prediction models because of its performance and its ability to implicitly select features in the training process. The correlations between miRNAs and mRNAs and target prediction information were used to model the relations between miRNAs and mRNAs. The combination between these two sources of information was performed on a p-value level using the method from Stouffer . From the combined p-values a bipartite graph could be constructed covering the relations between the two types of features.
The integration of this graph into boosting improves the models in terms of prediction error. In this case the clinical endpoint was the biochemical relapse in prostate cancer using a combined miRNA/mRNA data set of 98 patients . The comparisons of the IPECs clearly showed a significant reduction of the prediction error in comparison with boosting on the single data sets or on the combined data set without the bipartite graph. Here we used the .632 bootstrap estimator of the prediction error because of its simplicity. Other estimators like the .632+ estimator  are often used for prediction error estimation for survival models [15, 41, 58]. It might be less biased but computationally more expensive. First tests with the .632+ estimator lead to comparable results.
Using the graph the feature selection became more stable regarding how often a specific feature was picked in the 500 bootstrap runs. By transferring the weights in the graph from mRNAs to miRNAs, these features were favored. However, it is important to note that miRNA expression data alone failed to predict the relapse as accurate as the combined data with the graph. This may be caused by the fact that one miRNA can have several targets and dysregulation of a miRNA can affect multiple molecular pathways with no direct connection to the outcome. Therefore, the genes as effectors seem to be a mandatory source of information. Among the top 10 features picked using the graph there are some miRNAs found to play a role in prostate cancer, e.g. hsa-miR-128 . However, most of the miRNAs have not been associated with prostate cancer before. It is therefore important to note that it is not straightforward to derive functional implications for single biomarkers from a panel found by a prediction model. The strength of our method is to find miRNA-gene combinations with high predictive power. To investigate whether the selected genes show differences in functional annotations, we also performed a GO enrichment test for the top 100 genes of CoxBoost with and without graph (data not shown). Both sets showed different enriched GO terms. However, no clear patterns concerning cancer related processes occurred.
To assess how our method performed in comparison with other methods suited for time-to-event data, Lasso and RSF were tested on the same data set using the same bootstrap samples. In both cases CoxBoost with the bipartite graph showed a significantly lower prediction error. RSF performed better than Lasso which was worse than CoxBoost without graph on this data set. The runtime of RSF and Lasso was considerably longer than the runtime of CoxBoost with graph on our test system. In this study we used the standard implementations of Lasso and RSF as a reference. As far as we know there are no established ways to combine Lasso or RSF with a graph to guide the feature selection. It might be interesting to see if such methods will improve the prediction error as well. Also other ways of fusing miRNA and mRNA expression data into one model e.g. bundling  or kernel based methods  have not been considered. Such methods offer a very flexible way of combining different prediction models and might also lead to improvements in terms of prediction error.
To minimize the possibility of overfitting, one CoxBoost model was trained with correlations calculated only on the training data of every bootstrap sample. The resulting prediction error is higher compared to the models with correlations calculated once on the whole data set but it is still significantly lower than CoxBoost with no graph. Further, we showed that the prediction could be improved using the target prediction information from MicroCosm. In order to test the influence of the target prediction database we also tried to incorporate the target predictions from TargetScan. This resulted in a higher prediction error, however. This result can possibly be explained by the lower coverage of TargetScan. From the 723 miRNAs in the data set only 170 could be found in TargetScan having a P CT value. In comparison, the MicroCosm predictions contained 698 out of the 723 miRNAs with p-values.
While miRNA and mRNA expression data gained from microarray experiments were used in this study, the method is independent of the underlying experimental setup. Next generation sequencing data might be, after the necessary preprocessing steps, used in a similar manner. We presented the fusion of the both data sets with respect to a prognostic time-to-event endpoint. However, in a similar fashion binary endpoints like diagnostic questions or treatment response prediction can be tackled. This would lead to classification problems for which boosting was originally designed and powerful approaches have been formulated. On our setting we would substitute the CoxBoost algorithm by GAMBoost .
With the increasing availability of high-throughput data on many different layers of biological regulation, the integration and fusion of these data sets becomes a key concept when analyzing complex diseases. Combined prediction models involving mRNA and miRNA expression data should include the relations between the different features in the model.
In this article we propose a new method to fuse miRNA and mRNA expression data in a risk prediction model to stratify the risk of a biochemical relapse of prostate cancer patients. In our new approach we combine the CoxBoost model with a bipartite graph assembled from correlations between miRNAs and mRNAs and target prediction information from MicroCosm targets. Using this graph an improvement of the risk prediction could be achieved. Besides an improved risk prediction we could show that the feature selection became more stable and therewith easier to interpret. CoxBoost with graph performed significantly better than two other methods suited for time-to-event data.
The R source code of the proposed method is available in the supplement (see Additional file 1).
We thank Christian Bender for help and discussions and Dirk Ledwinka for IT support. This project was supported by the German Federal Ministry of Education and Science in the framework NGFN IG-Prostate Cancer (01GS0890) and by the DFG through the Clinical Research Group 179. The authors are responsible for the contents of this publication.
- van 't Veer LJ, Dai H, van de Vijver MJ, He YD, Hart AaM, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT, Schreiber GJ, Kerkhoven RM, Roberts C, Linsley PS, Bernards R, Friend SH: Gene expression profiling predicts clinical outcome of breast cancer. Nature 2002, 415: 530–536. [http://www.ncbi.nlm.nih.gov/pubmed/11823860] 10.1038/415530aView ArticlePubMedGoogle Scholar
- Paik S, Shak S, Tang G, Kim C, Baker J, Cronin M, Baehner FL, Walker MG, Watson D, Park T, Hiller W, Fisher ER, Wickerham DL, Bryant J, Wolmark N: A multigene assay to predict recurrence of tamoxifen-treated, node-negative breast cancer. The New England Journal of Medicine 2004, 351(27):2817–2826. [http://www.ncbi.nlm.nih.gov/pubmed/15591335] 10.1056/NEJMoa041588View ArticlePubMedGoogle Scholar
- Wang Y, Klijn JGM, Zhang Y, Sieuwerts AM, Look MP, Yang F, Talantov D, Timmermans M, Meijer-van Gelder ME, Yu J, Jatkoe T, Berns EMJJ, Atkins D, Foekens Ja: Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer. Lancet 2005, 365: 671–679. [http://www.ncbi.nlm.nih.gov/pubmed/15721472]View ArticlePubMedGoogle Scholar
- Oakman C, Santarpia L, Di Leo A: Breast cancer assessment tools and optimizing adjuvant therapy. Nature Reviews Clinical Oncology 2010, 7(12):725–732. [http://www.ncbi.nlm.nih.gov/pubmed/20975745] 10.1038/nrclinonc.2010.170View ArticlePubMedGoogle Scholar
- Jemal a, Bray F, Center MM, Ferlay J, Ward E, Forman D: Global cancer statistics. CA: A Cancer Journal for Clinicians 2011, 61(2):69–90. 10.3322/caac.20107Google Scholar
- Tosoian J, Loeb S: PSA and beyond: the past, present, and future of investigative biomarkers for prostate cancer. The Scientific World Journal 2010, 10: 1919–31. [http://www.ncbi.nlm.nih.gov/pubmed/20890581]View ArticlePubMedGoogle Scholar
- Vapnik V: The nature of statistical learning theory. 2nd edition. New York: Springer; 1999.Google Scholar
- Breiman L: Random Forests. Machine Learning 2001, 45: 5–32. 10.1023/A:1010933404324View ArticleGoogle Scholar
- Freund Y, Schapire RE: Experiments with a New Boosting Algorithm. Proceedings of the Thirteenth International Conference on Machine Learning 1996, 148–156.Google Scholar
- Johannes M, Brase JC, Fröhlich H, Gade S, Gehrmann M, Fälth M, Sültmann H, Beiß barth T: Integration Of Pathway Knowledge Into A Reweighted Recursive Feature Elimination Approach For Risk Stratification Of Cancer Patients. Bioinformatics 2010, 26(17):2136–2144. [http://www.ncbi.nlm.nih.gov/pubmed/20591905] 10.1093/bioinformatics/btq345View ArticlePubMedGoogle Scholar
- Bellazzi R, Zupan B: Towards knowledge-based gene expression data mining. Journal of Biomedical Informatics 2007, 40(6):787–802. [http://www.ncbi.nlm.nih.gov/pubmed/17683991] 10.1016/j.jbi.2007.06.005View ArticlePubMedGoogle Scholar
- Chuang HY, Lee E, Liu YT, Lee D, Ideker T: Network-based classification of breast cancer metastasis. Molecular Systems Biology 2007, 3: 10.View ArticleGoogle Scholar
- Rapaport F, Zinovyev A, Dutreix M, Barillot E, Vert JP: Classification of microarray data using gene networks. BMC Bioinformatics 2007, 8: 35. 10.1186/1471-2105-8-35PubMed CentralView ArticlePubMedGoogle Scholar
- Porzelius C, Johannes M, Binder H, Beissbarth T: Leveraging external knowledge on molecular interactions in classification methods for risk prediction of patients. Biometrical Journal 2011, 53(2):190–201. [http://www.ncbi.nlm.nih.gov/pubmed/21328603] 10.1002/bimj.201000155View ArticlePubMedGoogle Scholar
- Binder H, Schumacher M: Incorporating pathway information into boosting estimation of high-dimensional risk prediction models. BMC Bioinformatics 2009, 10(18):11. [http://www.ncbi.nlm.nih.gov/pubmed/19144132]Google Scholar
- Daemen A, Gevaert O, Ojeda F, Debucquoy A, Suykens JA, Sempoux C, Machiels JP, Haustermans K, Moor BD: A kernel-based integration of genome-wide data for clinical decision support. Genome Medicine 2009, 1(4):1–17. [http://dx.doi.org/10.1186/gm39]View ArticleGoogle Scholar
- Lu J, Getz G, Miska Ea, Alvarez-Saavedra E, Lamb J, Peck D, Sweet-Cordero A, Ebert BL, Mak RH, Ferrando Aa, Downing JR, Jacks T, Horvitz HR, Golub TR: MicroRNA expression profiles classify human cancers. Nature 2005, 435: 834–838. [http://www.ncbi.nlm.nih.gov/pubmed/15944708] 10.1038/nature03702View ArticlePubMedGoogle Scholar
- Groce CM: Causes and consequences of microRNA dysregulation in cancer. Nature Reviews Genetics 2009, 10: 704–714. 10.1038/nrg2634View ArticleGoogle Scholar
- Coppola V, Maria RD, Bonci D: MicroRNAs and Prostate Cancer. Society for Endocrinology 2009.Google Scholar
- Brase JC, Johannes M, Schlomm T, Fälth M, Haese A, Steuber T, Beissbarth T, Kuner R, Sültmann H: Circulating miRNAs are correlated with tumor progression in prostate cancer. International Journal of Cancer 2011, 128(3):608–616. [http://www.ncbi.nlm.nih.gov/pubmed/20473869] 10.1002/ijc.25376View ArticleGoogle Scholar
- Enright AJ, John B, Gaul U, Tuschl T, Sander C, Marks DS: MicroRNA targets in Drosophila. Genome Biology 2003, 5: 14.View ArticleGoogle Scholar
- Friedman RC, Farh KKH, Burge CB, Bartel DP: Most mammalian mRNAs are conserved targets of microRNAs. Genome Research 2009, 19: 92–105. [http://www.ncbi.nlm.nih.gov/pubmed/18955434]PubMed CentralView ArticlePubMedGoogle Scholar
- Krek A, Grün D, Poy MN, Wolf R, Rosenberg L, Epstein EJ, MacMenamin P, da Piedade I, Gunsalus KC, Stoffel M, Rajewsky N: Combinatorial microRNA target predictions. Nature Genetics 2005, 37(5):495–500. [http://www.ncbi.nlm.nih.gov/pubmed/15806104] 10.1038/ng1536View ArticlePubMedGoogle Scholar
- Cox DR: Regression Models and Life-Tables. Journal of the Royal Statistical Society 1972, 34(2):187–220.Google Scholar
- Graf E, Schmoor C, Sauerbrei W, Schumacher M: Assessment and comparison of prognostic classification schemes for survival data. Statistics in Medicine 1999, 18(17–18):2529–2545. [http://www.ncbi.nlm.nih.gov/pubmed/10474158] 10.1002/(SICI)1097-0258(19990915/30)18:17/18<2529::AID-SIM274>3.0.CO;2-5View ArticlePubMedGoogle Scholar
- Kaplan EL, Meier P: Nonparametric Estimation from Incomplete Observations. Journal of the American Statistical Association 1958, 53(282):457–481. 10.2307/2281868View ArticleGoogle Scholar
- Porzelius C, Binder H, Schumacher M: Parallelized prediction error estimation for evaluation of high-dimensional models. Bioinformatics 2009, 25(6):827–829. [http://www.ncbi.nlm.nih.gov/pubmed/19176556] 10.1093/bioinformatics/btp062View ArticlePubMedGoogle Scholar
- Porzelius C, Binder H:peperr: Parallelised Estimation of Prediction Error. 2010. [http://CRAN.R-project.org/package=peperr] [R package version 1.1-5]Google Scholar
- Efron B: Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation. Journal of the American Statistical Association 1983, 78(382):316–331. 10.2307/2288636View ArticleGoogle Scholar
- Friedman J, Hastie T, Tibshirani R: Additive Logistic Regression: A Statistical View of Boosting. The Annals of Statistics 2000, 28(2):337–407.View ArticleGoogle Scholar
- Tutz G, Binder H: Generalized additive modelling with implicit variable selection by likelihood based boosting. Tech. rep., Institut für Statistik, Sonderforschungsbereich 386, Ludwig-Maximilians-Universität München 2004.Google Scholar
- Binder H, Schumacher M: Allowing for mandatory covariates in boosting estimation of sparse high-dimensional survival models. BMC Bioinformatics 2008, 9: 14. [http://dx.doi.org/10.1186/1471–2105–9-14] 10.1186/1471-2105-9-14PubMed CentralView ArticlePubMedGoogle Scholar
- Binder H: CoxBoost: Cox models by likelihood based boosting for a single survival endpoint or competing risks. 2010. [R package version 1.2-2]Google Scholar
- Tibshirani R: Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society 1996, 58: 267–288.Google Scholar
- Tibshirani R: The lasso method for variable selection in the Cox model. Statistics in Medicine 1997, 16: 385–395. [http://www.ncbi.nlm.nih.gov/pubmed/9044528] 10.1002/(SICI)1097-0258(19970228)16:4<385::AID-SIM380>3.0.CO;2-3View ArticlePubMedGoogle Scholar
- Hastie T, Tibshirani R, Friedman J: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition. Springer 2nd edition. 2009.Google Scholar
- Goeman JJ: L1 penalized estimation in the Cox proportional hazards model. Biometrical Journal 2010, 52: 70–84. [http://www.ncbi.nlm.nih.gov/pubmed/19937997]PubMedGoogle Scholar
- Goeman JJ: Penalized R package. 2011. [R package version 0.9-35]Google Scholar
- Ishwaran H, Kogalur UB, Blackstone EH, Lauer MS: Random survival forests. The Annals of Applied Statistics 2008, 2(3):841–860. [http://projecteuclid.org/euclid.aoas/1223908043] 10.1214/08-AOAS169View ArticleGoogle Scholar
- Ishwaran H, Kogalur UB: Random Survival Forests for R. R News 2007, 7(2):25–31.Google Scholar
- Porzelius C, Schumacher M, Binder H: The benefit of data-based model complexity selection via prediction error curves in time-to-event data. Computational Statistics 2011, 26(2):293–302. [http://www.springerlink.com/index/10.1007/s00180–011–0236–6] 10.1007/s00180-011-0236-6View ArticleGoogle Scholar
- Taylor BS, Schultz N, Hieronymus H, Gopalan A, Xiao Y, Carver BS, Arora VK, Kaushik P, Cerami E, Reva B, Antipin Y, Mitsiades N, Landers T, Dolgalev I, Major JE, Wilson M, Socci ND, Lash AE, Heguy A, Eastham Ja, Scher HI, Reuter VE, Scardino PT, Sander C, Sawyers CL, Gerald WL: Integrative Genomic Profiling of Human Prostate Cancer. Cancer Cell 2010, 18: 1–12. [http://www.ncbi.nlm.nih.gov/pubmed/20579941] 10.1016/j.ccr.2010.06.011View ArticleGoogle Scholar
- Irizarry Ra: Summaries of Affymetrix GeneChip probe level data. Nucleic Acids Research 2003, 31(4):8. [http://www.nar.oupjournals.org/cgi/doi/10.1093/nar/gng015]View ArticleGoogle Scholar
- Smyth GK: Limma: linear models for microarray data. In Bioinformatics and Computational Biology Solutions using R and Bioconductor. Edited by: Gentleman R, Carey V, Dudoit S, Irizarry R, Huber W. New York: Springer; 2005:397–420.View ArticleGoogle Scholar
- Bolstad BM, Irizarry Ra, Astrand M, Speed TP: A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics 2003, 19(2):185–193. [http://www.ncbi.nlm.nih.gov/pubmed/12538238] 10.1093/bioinformatics/19.2.185View ArticlePubMedGoogle Scholar
- Griffiths-Jones S, Saini HK, van Dongen S, Enright AJ: miRBase: tools for microRNA genomics. Nucleic Acids Research 2008, (36 Database):D154-D158. [http://www.ncbi.nlm.nih.gov/pubmed/17991681]Google Scholar
- Benjamini Y, Hochberg Y: Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society, Series B 1995, 57: 289–300.Google Scholar
- Stouffer S, Suchman E, De Vinney L, Star S, Williams RJ: The American Soldier, Vol. 1: Adjustment during Army Life. Princeton: Princeton University Press; 1949.Google Scholar
- Zaykin DV, Zhivotovsky LA, Westfall PH, Weir BS: Truncated product method for combining P-values. Genetic Epidemiology 2002, 22(2):170–185. [http://www.ncbi.nlm.nih.gov/pubmed/11788962] 10.1002/gepi.0042View ArticlePubMedGoogle Scholar
- Garzon R, Fabbri M, Cimmino A, Calin GA, Croce CM: MicroRNA expression and function in cancer. Trends in molecular medicine 2006, 12(12):580–7. [http://www.ncbi.nlm.nih.gov/pubmed/17071139] 10.1016/j.molmed.2006.10.006View ArticlePubMedGoogle Scholar
- Brase JC, Wuttig D, Kuner R, Sültmann H: Serum microRNAs as non-invasive biomarkers for cancer. Molecular Cancer 2010, 9: 306. 10.1186/1476-4598-9-306PubMed CentralView ArticlePubMedGoogle Scholar
- Cho JH, Gelinas R, Wang K, Etheridge A, Piper MG, Batte K, Dakhallah D, Price J, Bornman D, Zhang S, Marsh C, Galas D: Systems biology of interstitial lung diseases: integration of mRNA and microRNA expression changes. BMC Medical Genomics 2011, 4: 8. [http://www.ncbi.nlm.nih.gov/pubmed/21241464] 10.1186/1755-8794-4-8PubMed CentralView ArticlePubMedGoogle Scholar
- Nymark P, Guled M, Borze I, Faisal A, Lahti L, Salmenkivi K, Kettunen E, Anttila S, Knuutila S: Integrative Analysis of microRNA, mRNA and aCGH Data Reveals Asbestos- and Histology-Related Changes in Lung Cancer. Genes, Chromosomes & Cancer 2011, 50: 585–597. 10.1002/gcc.20880View ArticleGoogle Scholar
- Cheng C, Li LM: Inferring microRNA activities by combining gene expression with microRNA target prediction. PloS one 2008, 3(4):9.Google Scholar
- Huang GT, Athanassiou C, Benos PV: mirConnX: condition-specific mRNA-microRNA network integrator. Nucleic Acids Research 2011, 1–8. [http://www.ncbi.nlm.nih.gov/pubmed/21558324]Google Scholar
- Sales G, Coppe A, Bisognin A, Biasiolo M, Bortoluzzi S, Romualdi C: MAGIA, a web-based tool for miRNA and Genes Integrated Analysis. Nucleic Acids Research 2010, 38: 352–359. [http://www.ncbi.nlm.nih.gov/pubmed/20484379] 10.1093/nar/gkq423View ArticleGoogle Scholar
- Efron B, Tibshirani R: Improvements on Cross-Validation: The .632 + Bootstrap Method. Journal of the American Statistical Association 1997, 92(438):548–560. 10.2307/2965703Google Scholar
- Gerds Ta, Schumacher M: Efron-type measures of prediction error for survival analysis. Biometrics 2007, 63(4):1283–1287. [http://www.ncbi.nlm.nih.gov/pubmed/17651459] 10.1111/j.1541-0420.2007.00832.xView ArticlePubMedGoogle Scholar
- Khan AP, Poisson LM, Bhat VB, Fermin D, Zhao R, Kalyana-Sundaram S, Michailidis G, Nesvizhskii AI, Omenn GS, Chinnaiyan AM, Sreekumar A: Quantitative proteomic profiling of prostate cancer reveals a role for miR-128 in prostate cancer. Molecular & Cellular Proteomicst 2010, 9(2):298–312. 10.1074/mcp.M900159-MCP200View ArticleGoogle Scholar
- Hothorn T, Lausen B: Bundling classifiers by bagging trees. Computational Statistics & Data Analysis 2005, 49(4):1068–1078. [http://linkinghub.elsevier.com/retrieve/pii/S0167947304002051] 10.1016/j.csda.2004.06.019View ArticleGoogle Scholar
- Tutz G, Binder H: Generalized additive modeling with implicit variable selection by likelihood-based boosting. Biometrics 2006, 62(4):961–971. [http://www.ncbi.nlm.nih.gov/pubmed/17156269] 10.1111/j.1541-0420.2006.00578.xView ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.