Skip to main content

Integrative, multi-omics, analysis of blood samples improves model predictions: applications to cancer



Cancer genomic studies often include data collected from several omics platforms. Each omics data source contributes to the understanding of the underlying biological process via source specific (“individual”) patterns of variability. At the same time, statistical associations and potential interactions among the different data sources can reveal signals from common biological processes that might not be identified by single source analyses. These common patterns of variability are referred to as “shared” or “joint”. In this work, we show how the use of joint and individual components can lead to better predictive models, and to a deeper understanding of the biological process at hand. We identify joint and individual contributions of DNA methylation, miRNA and mRNA expression collected from blood samples in a lung cancer case–control study nested within the Norwegian Women and Cancer (NOWAC) cohort study, and we use such components to build prediction models for case–control and metastatic status. To assess the quality of predictions, we compare models based on simultaneous, integrative analysis of multi-source omics data to a standard non-integrative analysis of each single omics dataset, and to penalized regression models. Additionally, we apply the proposed approach to a breast cancer dataset from The Cancer Genome Atlas.


Our results show how an integrative analysis that preserves both components of variation is more appropriate than standard multi-omics analyses that are not based on such a distinction. Both joint and individual components are shown to contribute to a better quality of model predictions, and facilitate the interpretation of the underlying biological processes in lung cancer development.


In the presence of multiple omics data sources, we recommend the use of data integration techniques that preserve the joint and individual components across the omics sources. We show how the inclusion of such components increases the quality of model predictions of clinical outcomes.


Cancer studies benefit from the availability of genomic data, also known as omics. The dimensionality of omics data is extremely high, suggesting the application of dimension reduction techniques. Additionally, omics are available across multiple sources (or ‘blocks’) of data, collected on the same organisms or tissues, and measured on different platforms. A comprehensive understanding of the key underlying biological process relies on an integrative approach able to combine the information arising from such multi-source data. To this end, a large number of statistical methods for the simultaneous analysis of multi-omics data have recently been proposed. Multiple reviews of such methods are available, for example in [1,2,3].

Data integration techniques are often used to identify ‘joint’ (also referred to as ‘common’ or ‘shared’) contributions of the data sources to the observed variation, and their simultaneous effect on the biological process under study. Such patterns of variation arise from the interaction among different omics sources, and may not be detected by a separate analysis of each single source. However, the different data sources do not only contain the joint information, but also independent contributions. The separate analysis of each data source has so far been the most common approach used in the omics context, and knowledge about the individual contributions of each omics source is relevant to the understanding of the biological processes of interest. As a consequence, considering only the joint patterns might also prove insufficient, as it overlooks the heterogeneity among single data sources, and their individual signals from the underlying relevant biological process. An example of this can be seen in genomic studies collecting DNA methylation and gene expression data. It is known that methylation regulates gene expression and that this can cause a non-negligible joint structure across the different data sources. For example, they have been shown to contribute together and jointly relate to the occurrence and characteristics of lung cancer [4, 5]. On the other hand, methylation and gene expression correlate to these clinical outcomes also through signals that are specific to each omics data source and biologically relevant independently from each other [6,7,8,9]. Therefore, dimension reduction methods that take both joint and individual patterns into account are necessary.

Several methods that have recently been proposed to address this problem are based on matrix factorization. In this framework, each data block is decomposed into three matrices modeling different types of variation, specifically joint variation across the blocks, individual variation for each data block, and residual variation. One such method is JIVE. JIVE stands for Joint and Individual Variance Explained, it was formulated by [10] and, also thanks to its implementation available in R [11], has been used in various medical applications, including clustering of cancer genomic data [12], multi-source omics data [13, 14] and imaging and behavioral data [15]. Although JIVE successfully maintains joint and individual structures, it uses an iterative algorithm and is computationally very intensive. In [16], Angle Based JIVE (aJIVE) was formulated to improve this aspect. It computes the matrix decomposition by using perturbations of the row spaces to identify the joint and individual variation, and results in a much faster implementation than the original JIVE. Besides resulting in a faster implementation of the algorithm, aJIVE provides a more intuitive interpretation of the decomposition, especially in the case of high correlations among individual components [16].

Other dimension reduction methods have been extended to the case of multi-source data, as for example canonical correlation analysis (CCA) [17] or partial least squares (PLS) analysis, which has been further generalized to O2PLS [18]. A similar method that allows for the presence of multiple data sources is the multiple CCA [19], but it mainly focuses on the common variation among the components, and seems to neglect the individual contributions of the data sources. An alternative method based on factor analysis has been proposed in [20], and provides a low-dimensional representation of multi-source omics data, although it can fail to detect individual components in the presence of heterogeneous dimensionalities of the single data sources. Other similar approaches to identify both kinds of variation have been proposed, as for example DISCO [21] and OnPLS [22]. An illustration of these methods and a comparison with JIVE was provided in [23].

Additionally, Principal Component Analysis (PCA) based techniques have been expanded to the case of multi-source data. For example, consensus PCA [24] consists of PCA on the normalized concatenated data, and distributed PCA [25] performs local PCA on the individual data sources and then uses these principal components to estimate a global covariance structure. Integrated PCA (iPCA) is a model based generalization of PCA that decomposes variance into joint and individual variation [26].

In this work, we focus on prediction models for lung cancer development using both joint and individual components arising from different sources of omics data. We show how the inclusion of both joint and individual components in predictive models leads to a better quality of predictions. The combination of joint and individual components can also facilitate the biological interpretation of the underlying process, although this might still fail as the dimension reduction itself bears the risk of obscuring some relevant information.

We use aJIVE to formulate integrative prediction models in a real data set on lung cancer, identifying individual and joint components across three sources of omics data. We chose to use aJIVE because it inherits a good subspace recovery in comparison to other methods [23], as well as the robustness to model misspecification from JIVE, but it also solves the issue of correlated individual subspaces [16], and provides a much faster implementation. Furthermore, [27] show that aJIVE performs best in terms of consistency and lack of overfitting when compared to other integrative methods. We use the aJIVE joint and individual components to build prediction models for lung cancer development. We evaluate the performance of the proposed models in terms of prediction quality, and we compare them to non-integrative benchmark methods, as well as standard regularized variable selection techniques. Additionally, we show how disentangling joint and individual sources of variation can lead to the identification of biological mechanisms, which would not be highlighted by source-specific analyses.

The data we use stem from a lung cancer case–control study nested within the Norwegian Women and Cancer (NOWAC) cohort study [28]. The associations among three levels of omics data analyzed in blood samples, specifically DNA methylation, mRNA and miRNA expression, are investigated and their joint and individual contributions are used to predict future cancer cases, and for the characterization of future cancers as metastatic or non-metastatic at diagnosis. We show that both types of components contain information that reveal properties about biological processes and that using joint and individual components results in good model predictions for case–control and metastatic status. We assess the quality of prediction by comparing models based on both joint and individual components to models uniquely based on clinical, patient-level covariates, and most importantly non-integrative models, i. e. based on independent analyses of data from each source.

To further evaluate this approach, we provide an application to a publicly available dataset on breast cancer from The Cancer Genome Atlas (TCGA).


Data integration setup

Throughout the manuscript, we will denote each data block with \(\varvec{X}_k\), where \(k =1, \ldots , K\) and K is the number of data sources used in the study. Each block is a matrix with n columns, where n is the number of study subjects. The kth matrix \(\varvec{X}_k\) has \(p_k\) rows, corresponding to the variables in data source k. The overall dimensionality is denoted as \(p\,=\,p_1 +\cdots +p_K\). The low-rank decomposition we want to obtain is:

$$\begin{aligned} \varvec{X}_1&= \varvec{J}_1 + \varvec{I}_1 + \varvec{\epsilon }_1 \nonumber \\&\;\;\vdots \nonumber \\ \varvec{X}_K&= \varvec{J}_K + \varvec{I}_K + \varvec{\epsilon }_K \end{aligned}$$

where \(\varvec{I}_k\) is the individual component for data block k, \(\varvec{\epsilon }_k\) is its residual component and

$$\begin{aligned} \varvec{J} = \begin{bmatrix} \varvec{J}_1 \\ \ldots \\ \ldots \\ \varvec{J}_K \end{bmatrix} \end{aligned}$$

is the joint structure matrix, where each \(\varvec{J}_k\) is the submatrix of the joint structure \(\varvec{J}\) associated with \(\varvec{X}_k\).

Angle based JIVE

Angle based Joint and Individual Variation Explained (aJIVE) is a variant of the JIVE method, based on perturbation of row subspaces. JIVE aims to minimize the squared residual components \(\epsilon _1\),…, \(\epsilon _K\), using an iterative algorithm that alternatively estimates the joint and individual components by singular value decomposition (SVD). AJIVE builds on this method but constructs the algorithm in a more efficient and computationally feasible way. The aJIVE algorithm is structured in three phases: First the low-rank approximation of each data block \(\varvec{X}_k\) is obtained by SVD. Secondly, the joint structure between the obtained low-rank approximations is extracted by computing the SVD of the stacked row basis matrices. This second phase of the algorithm is based on basic principles of Principal Angle Analysis. Finally, the joint components \(\varvec{J}_k\) are obtained by projection of each data block onto the joint basis, while the individual components \(\varvec{I}_k\) are calculated by orthonormal basis subtraction.

The first step is based on the choice of the initial ranks for each data block, which are used as a threshold value in the first SVD decomposition of the data blocks. This choice is rather subjective and involves taking into account some bias variance trade-off in the joint signals representation. Although [16] provide guidelines on how to determine the initial ranks, the recommended choice is based on the observation of scree plots, which remains highly subjective. As an alternative, [29] present a choice of initial ranks based on the profile likelihood of the single data blocks.

From the aJIVE decomposition, it is possible to obtain the full matrix representation of the original features, as well as the block specific decompositions of each data source and the common normalized scores. The aJIVE implementation is available in Matlab [30] and R [31].

Application to the NOWAC data

The dataset

The data used in the following analyses stems from blood samples in a lung cancer case–control study nested within the Norwegian Women and Cancer Study (NOWAC) [28]. All participating subjects are women who did not have a cancer diagnosis at time of blood sampling (2003–2006). The time from blood sampling to cancer diagnosis ranges from 0.3 to 7.9 years, with a median time equal to 4.2 years. The study was designed as a nested case–control study, starting from 125 subjects who developed lung cancer in the NOWAC cohort. One control was randomly chosen for each case from the risk set at the time of cancer diagnosis, following an incidence density sampling scheme. Cases and controls were matched on time since blood sampling and birth year. All participants gave written informed consent and the study was approved by the Regional Committee for Medical and Health Research Ethics and the Norwegian Data Inspectorate. Three levels of omics data are available for \(n= 230\) individuals (115 case–control pairs), with numbers of variables respectively equal to \(p_1 = 485,512\) CpG methylation, \(p_2 = 11,610\) mRNA expression and \(p_3 = 198\) miRNA expression. Information about individual covariates, including age, body mass index (BMI) and smoking habits was also collected for all participants. Outcomes of interest are the classification of case versus control, as well as the characterization of cancers as metastatic or non-metastatic at diagnosis.

Filtering and preprocessing

Laboratory processing and microarray analyses for DNA methylation and mRNA expression are described in [5]. For miRNA, laboratory processing included miRNA isolation and purification from 100 \(\mu\)l plasma using the Qiagen miRNeasy Serum/Plasma Kit. Small RNA sequencing libraries were prepared using the NEXTflex small RNA-seq kit v3 (Bioo Scientific, Austin, TX, USA) and sequencing of fragments was performed using a Illumina HiSeq4000 flowcell, according to the manufacturer’s instructions (Illumina, Inc., San Diego, CA, USA), at 50 bp SE, resulting in approximately 7–9 M reads per sample.

Preprocessing and quality control of methylation data accounted for missing values and intensities below detection thresholds, and included background subtraction and dye bias correction [32]. For mRNA data, the probe values were background-corrected and probes reported to have poor quality from Illumina or detected in less than 95% of samples were filtered out [5]. The filtering of miRNA expressions was based on the counts per million, that is the total read counts of a miRNA divided by the total read counts of the sample and multiplied by \(10^6\), and signals having less than one count per million were excluded. Additionally, signals with null reads on more than 5 patients were excluded.

Because of the high computational requirements, we reduced the number of mRNA expressions to \(p_2 = 5000\), by selecting the variables with higher variance. We then reduced the number of methylation sites by selecting the CpGs located on the same genes as the filtered mRNAs, as well as the 10,000 CpGs with highest variance. Among these, we excluded CpGs with more than 40% missing data, as well as CpGs with extreme M-values (\(|M|>3\), see [33, 34]). This resulted in \(p_1 = 26,706\). All \(p_3 = 198\) available miRNAs were analysed. Other possible filtering criteria have been considered and are described in the discussion of the paper. We used log2 transformed expressions for both mRNA and miRNA, and M-values for methylation [35]. We accounted for missing values in the data by using SVDmiss, as suggested in [10]. The data was mean-centered. Thanks to the insensitivity of aJIVE to scale heterogeneity, scaling was not performed in the data normalization stage.


We performed aJIVE on the three levels of omics data. The initial ranks were selected by maximizing the profile likelihood [29], but different choices of initial ranks were also explored and results did not change substantially.

Joint and individual components were used in prediction models. The outcomes of interest were the occurrence of lung cancer (yes/no) and metastasis (yes/no).

We fitted logistic models on each outcome using joint and individual components as explanatory variables, in addition to age, BMI and smoking. These models were compared in terms of AUC with the respective models with only age, BMI and smoking as covariates. To assess the performance of the models, we measured the average AUC in a 10-fold cross-validation. We compared these with a non-integrative analysis, obtained by performing PCA separately on each single data source. We fitted a model on the first principal components (PCs) of each data source, and on the same clinical covariates. We chose to include five PCs for each data source, based on the variance explained by the first PCs and on the analysis of screeplots. We included the same numbers of individual components in the integrative model described above.

To provide a comparison with a standard supervised prediction method, we ran a lasso procedure that selects signals from all three omics layers and used it to predict the two outcomes of interest. We used 10-fold cross-validation on 2/3 of the data points to select the optimal penalty parameter and we used the fitted lasso model to predict case–control status and metastasis. We ensured the inclusion of the clinical covariates in the lasso models by fixing the corresponding penalty parameters to 0 for age, BMI and smoking status. We compared the quality of model prediction in terms of average AUC across 50 repeats of this procedure.

In addition, we used a random forest of 1000 trees to predict case versus control on the basis of joint and individual components, and patient covariates as above (age, BMI, smoking). We extracted the AUCs and the out of the bag (OOB) classification errors from the random forest, and we ranked all the variables in importance on the basis of their mean decrease in gini index [36].

Application to the TCGA data

To assess the predictive performance also in another dataset, we illustrate an application to a subset of data generated by The Cancer Genome Atlas (TCGA Research Network,, and used in the mixOmics project [37].

Records are included for 379 patients, and consist of 2000 CpGs, 2000 mRNA and 184 miRNA expression. We used methyaltion, mRNA, and miRNA expression data to explore shared and data-specific components of variation via aJIVE. The joint and individual contributions were used to predict tumor subtypes, specifically a four level classification into Basal, Her2, LumA and LumB breast cancer. The original classification of these subtypes is based on levels of mRNA expression [38]. We built a prediction model based on joint and individual components, and compared it to a non-integrative model, i. e. based on independent analyses of data from each source.


Application to the NOWAC data


Using initial ranks obtained with the profile likelihood method resulted in a joint rank equal to 5, and individual ranks respectively equal to 67, 10 and 9. Figure 1 reports the proportions of variance explained that are due to the joint, individual and residual components.

Estimated proportions of variance explained with different choices of initial ranks are stable and reported in Additional file 2.

Fig. 1

Joint and individual proportions of variance explained in the NOWAC dataset. The individual component is prevalent for all three datasets, especially for methylation. The joint component is relevant for mRNA and miRNA

Prediction models

Figure 2 reports the in-sample ROC curves relative to the logistic models fitted on the joint and individual components estimated by aJIVE. The model with only patient covariates (age, BMI and smoking) as explanatory variables and the full, integrative model are reported. The integrative model is fitted using patient covariates, aJIVE joint components and first five aJIVE individual components for each data source as explanatory variables. These are compared to non-integrative models, using the first five individual PCs obtained for each dataset separately, in addition to the same covariates. In the prediction of both outcomes, the integrative model shows the highest AUCs, showing how the combination of both kinds of components results in better model predictions. In particular, the integrative models perform better than a non-integrative analysis based on source specific PCs. Additionally, the omics data contribute substantially to the predictions, and result in considerably better prediction quality than patient covariates alone.

Fig. 2

ROC curves from logistic prediction models. a Reports the ROC curves and their AUCs for the prediction models on case versus control, b reports the ROC curves and their AUCs for the prediction models on metastasis status. The integrative models are fitted on the joint and individual components extracted from aJIVE, while the non-integrative models are fitted on the first principal components obtained separately for each omics source

A 10-fold cross-validation was used to validate the in-sample results for each outcome, and shows a considerable improvement for the aJIVE integrative model, when compared to non-integrative analysis. In the ROC studies from cross-validation, the integrative models based on the aJIVE components improve the prediction for both case–control and metastasis status. The mean AUCs for the integrative models are 0.69 and 0.70, for case–control and metastasis status respectively. The mean AUC of the non-integrative model, based on the single data source PCAs and the clinical covariates, is respectively 0.65 and 0.63. In the prediction of both outcomes, the aJIVE integrative models perform better than the non-integrative analysis.

For comparison, as mentioned above, we also ran lasso models on the two outcomes. The mean AUCs obtained by the lasso procedure are 0.69 and 0.61 for case–control status and metastastasis, respectively.

Table 1 reports accuracy and OOB classification error for the random forests, as well as the mean AUCs. For case–control status, the aJIVE based model improves the quality of predictions, both in terms of accuracy and AUC, compared to the non-integrative model. The difference from the logistic models with cross-validation can be due to the instability of the random forest, and to the limited sample size. We do not report the random forests results for metastasis because they are highly unstable and the accuracy is very low, most likely due to the even more limited sample size, that is only 125 (only cases) for the metastasis classification.

Table 1 Random forest diagnostics for prediction models of case–control status in the NOWAC dataset

Figure 3 shows the first ten variables ranked by variable importance in the integrative model for case–control status. One joint component and three individual components appear among the first five variables when ranked for variable importance in the random forest prediction.

Fig. 3

Variable importance plot from random forest on case versus control in the NOWAC dataset. First ten variables ranked by variable importance (in terms of mean Gini index) in the full integrative model for case versus control in the NOWAC dataset. \(\texttt {Joint}_i\) denotes the i-th joint component estimates by aJIVE, while \(\texttt {MetInd}_i\), \(\texttt {mRNAInd}_i\) and \(\texttt {miRNAInd}_i\) are the i-th individual components estimated by aJIVE for methylation, mRNA and miRNA respectively

Biological interpretation

To investigate the biological processes indicated in the most influential components, we extracted the top genetic features from any omics level that contributed to the first ten variables identified by the random forests. We investigated the omics signals with the highest contribution in terms of loadings estimated by aJIVE, for each component identified by the random forests. Among the mRNAs with the highest contribution, 13 have earlier been identified in conditional logistic regression analyses of metastatic cases sampled within 3 years of their diagnosis as compared to their controls [39]. Additionally, 11 genes overlapped with the top genes identified in the analyses of all case–control pairs independent of metastatic status. We used the Bioconductor package “clusterProfiler” [40] to conduct functional enrichment analyses of GO(BP) categories for these genes, and identified the following ontology categories: inflammatory response, peptide secretion, innate immune response, positive regulation of DNA-binding transcription factor activity, protein secretion, establishment of protein localization to extracellular region. Inflammatory response was identified in [5] in the non-smoking related integrative analysis of DNA methylation and gene expression. Among the miRNAs with highest contributions, 80 are significantly associated with the classification of cases versus controls, respectively 36 from the first individual component and 44 from the third individual component. Using the Bioconductor package multiMiR and validated databases therein [41], 55,267 miRNA-gene target interactions were identified for the 36 miRNAs with the highest contribution to the first individual miRNA component. Among the known gene targets for these miRNAs, there were ten (S100A12, MX2, EIF2AK2, TNFSF13B, FFAR2, IL1RN, ANXA3, CCR1, TNFAIP6, TLR5) that were among the mRNA with the highest contributions to the aJIVE mRNA component (“mRNAInd3”). Correspondingly, 32,707 miRNA-target interactions were identified for the 44 miRNAs in the third individual miRNA component. Among these, three (IL1RN, FFAR2, EIF2AK2) were among the mRNA with the highest contribution to the aJIVE mRNA component (“mRNAInd3”).

Application to the TCGA data


Using initial ranks obtained with the profile likelihood method resulted in a joint rank equal to 4, and individual ranks equal to 2, 6 and 11, respectively for methylation, mRNA and miRNA. Figure 4 reports the proportions of variance explained that are due to the joint, individual and residual components. The joint components explain about 30% of the variation in the datasets, and the individual contributions are limited to about 25%, leaving a high contribution to the residual components.

Fig. 4

Joint and individual proportions of variance explained in the TCGA dataset. Both joint and individual components are relevant for the three datasets

Prediction models

An integrative model for prediction of tumor subtype is fitted using the aJIVE joint components and the first five aJIVE individual components for each data source as explanatory variables. This is compared to the non-integrative model, using the first five individual PCs obtained for each data source separately. Multinomial logistic models were used, with four classes for the response variable.

The results were validated by 10-fold cross-validation. Multiclass AUCs for in-sample classification of tumor type, as well as mean AUCs from cross-validation, are reported in Table 2 for each model. The integrative model including both individual and joint components shows the best quality of prediction.

Table 2 In-sample and cross validated AUCs for prediction of tumor subtype in the TCGA dataset

In addition, we used random forest of 1000 trees to predict tumor subtype on the basis of joint and individual components, and again compared them to non-integrative models. Table 3 reports accuracy and OOB classification error for the random forests, as well as the mean AUCs. The integrative model performs better than the non-integrative model in terms of AUC. In terms of accuracy and classification error, the integrative model and the non-integrative model are equivalent. Figure 5 shows the first ten variables ranked by variable importance in the full integrative model. The three top variables are joint components, and their importance measured in mean gini index is substantially higher than the importance of the other variables.

Fig. 5

Variable importance plot from random forest on cancer subtype in the TCGA dataset. First ten variables ranked by variable importance (in terms of mean Gini index) in the full integrative model for cancer subtype in the TCGA dataset. \(\texttt {Joint}_i\) denotes the i-th joint component estimates by aJIVE, while \(\texttt {MetInd}_i\), \(\texttt {mRNAInd}_i\) and \(\texttt {miRNAInd}_i\) are the i-th individual components estimated by aJIVE for methylation, mRNA and miRNA respectively

Table 3 Random forest diagnostics for prediction models of cancer subtype in the TCGA dataset


Prediction results

We use data integration to identify both joint and individual components in a lung cancer study, where multiple omics data sources are available. While the individual contribution of each data source is known to be relevant and has been widely studied in this context, different data sources are also expected to jointly associate with the clinical outcomes. We show how including both joint and individual components in prediction models improves the quality of prediction of the occurrence of lung cancer, as well as its classification into metastatic or non-metastatic cancer. Models that include both types of components lead to better predictions when compared to non-integrative models, or to models based on clinical covariates. This approach was also used on data from a breast cancer study available from The Cancer Genome Atlas (TCGA Research Network) and the results are similar.

Prediction models are validated in a 10-fold cross-validation framework, and such results are further confirmed by random forests. From the cross-validation study, we see that for case–control status, the integrative analysis provides better prediction than non-integrative analysis.

As an additional comparison, we use supervised variable selection and fit a lasso model on the three omics layers. Although we would expect that a supervised method, by using information from the response variable in fitting the model itself, results in better predictions, the aJIVE models used here perform similarly (for case vs. control), and substantially better (for metastasis).

A possible explanation of generally low AUCs is that prediction models for the NOWAC dataset might also be affected by the time between blood sampling and cancer diagnosis, and we expect the quality of predictions to be higher in subjects with a shorter time to diagnosis. We stratified cases into two subgroups based on time to diagnosis (higher vs. lower than the median time) and obtained higher in-sample AUCs for the classification of case versus control in subjects with a closer time to diagnosis. For the classification of metastasis, the sample size in the two time to diagnosis classes is not enough to draw conclusions. In the application to the NOWAC dataset, it is interesting to observe that one genomic component identified from aJIVE, specifically one individual component from the methylation data, ranks above smoking in importance for case–control classification (Fig. 3), smoking being known to be the one, major risk factor for lung cancer.

In the TCGA example, the high prediction quality of the non-integrative model is likely to arise from the definition of subtypes, which is based on levels of mRNA expression. In the non-integrative models, the mRNA principal components highly contribute to the prediction quality (mean AUC from 10-fold CV = 0.875 for non-integrative models based on mRNA components only versus mean AUC from 10-fold CV = 0.867 for the non-integrative models based on all three sources). Although we use multiclass ROC curves in this example, a dichotomous classification of the tumor classes could provide a deeper understanding of the models and easier comparison with the logistic case.

While this work provides preliminary evidence of the importance of an integrative analysis of the omics sources, a more thorough investigation of the joint and individual components could help identifying relevant biological patterns for future research. An example can be given by the underlying biological processes involving smoking and lung cancer: the omics signals that are dominating the components could be important risk factors for lung cancer, in addition to being informative about present or past smoking, and their interaction could shed light on the relevant underlying biological processes. Although a functional interpretation of such processes and of their link to the clinical outcomes is not straightforward, an investigation of the aJIVE components could provide further information that would not be identified by a non-integrative analysis of the separate omics sources.

Variable filtering

The chosen approach for variable filtering is based on variance for mRNA, and on genomic location and variance for methylation. Specifically, the top 5000 most variable mRNAs are selected and CpGs are then selected based on their location on genes, by including CpGs located on the same genes as filtered mRNAs. The top 10,000 most variable CpGs are included in addition to these. We expect that choosing signals that are on the same gene locations, and therefore naturally associated, will result in very relevant joint contributions and possibly obscure the individual components associated with methylation. The inclusion of the most variable CpGs, independently from their gene locations, solves this issue. Varying the proportions of CpGs that are selected based on their variance and on their gene location can give rise to different joint and individual contributions, and this aspect needs to be fully considered in the interpretation of the results. In the supplementary material (Additional file 2), we report the aJIVE results for two additional filtering set ups, specifically: a) by selecting CpGs uniquely on the basis of their gene location, and b) by including only the top most variable CpGs regardless of their location. The filtering of mRNA is based on the variance of the log-transformed signals. Although this procedure might generally result in selecting signals with the lowest intensities, this did not seem to have any impact on the results in our example. Different choices of filtering criteria for the mRNAs can be the interquantile range (IQR), or the association with the clinical outcome of interest, estimated by an appropriate regression model, and would yield different results of the aJIVE decomposition. Finally, also the filtering of the miRNAs needs to be taken into account, where less restrictive criteria might result in the estimation of different joint and individual components. Other choices could be made in this phase, for example applying the variance criterion independently on each data source, which could yield different joint and individual components. Another choice we made in the preprocessing and filtering of the data is the use of M-values for methylation. This choice is motivated by [35].

Methodological considerations

One of the main issues in aJIVE is the selection of initial ranks. The most common method for the choice of initial ranks in aJIVE is the visualization of screeplots, which is subjective and highly sensitive to noise in the data. The profile likelihood idea suggested by [29] partly addresses the problem, but it still lacks some objectivity and automation. Nevertheless, the correct choice of ranks is fundamental for aJIVE, and ranks misspecification can lead to incorrect results [16].

The high dimensionality of the data motivates the use of sparse methods, which reduce the number of variables included in the model and provide an easier interpretation of the results. A sparse version of the aJIVE method could be used for this purpose, by introducing a penalty term in the decomposition to induce variable sparsity. This has not been specifically implemented for aJIVE, but [10] discuss and provide an implementation of a sparse version of the JIVE method.

Finally, one aspect that is not accounted for in aJIVE is the presence of partially shared components. When joint components are only shared by, for example, two out of the three data sources, they will not be identified by aJIVE. This is a limitation of most data integration methods, and we expect partially shared components to result in even better prediction models. A way to investigate partially shared patterns is provided in the SLIDE method by [42], and is a potential starting point for further work in this direction.


Our study shows how integrative models that include both joint and individual contribution of multiple datasets lead to more accurate model predictions, and facilitate the interpretation of the underlying biological processes. We use joint and individual contributions of DNA methylation, miRNA and mRNA expression to predict cancer development in a lung cancer case–control study, and breast cancer subtype in a dataset from The Cancer Genome Atlas. We show that the use of joint and individual components leads to better prediction models, and to a deeper understanding of the biological process in hand.

Availability of data and materials

The code for the statistical analysis is available at Data cannot be shared publicly because of local and national ethical and security policies. Data access for researchers will be conditional on adherence to both the data access procedures of the Norwegian Women and Cancer Cohort and the UiT –The Arctic University of Norway (contact via Tonje Braaten and Arne Bastian Wiik in addition to an approval from the local ethical committee.


  1. 1.

    Tseng G, Ghosh D, Zhou XJ. Integrating omics data. Cambridge: Cambridge University Press; 2015.

    Book  Google Scholar 

  2. 2.

    Huang S, Chaudhary K, Garmire LX. More is better: recent progress in multi-omics data integration methods. Front Genet. 2017;8:84.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  3. 3.

    Rappaport N, Ron S. Multi-omic and multi-view clustering algorithms: review and cancer benchmark. Nucleic Acids Res. 2018;42:10546–62.

    Article  Google Scholar 

  4. 4.

    Heller G, Weinzierl M, Noll C, Babinsky V, Ziegler B, Altenberger C, Minichsdorfer C, Lang G, Döme B, End-Pfützenreuter A, Arns B-M, Grin Y, Klepetko W, Zielinski CC, Zöchbauer-Müller S. Genome-wide miRNA expression profiling identifies mir-9-3 and mir-193a as targets for DNA methylation in non-small cell lung cancers. Clin Cancer Res. 2012;18(6):1619–29.

    CAS  Article  PubMed  Google Scholar 

  5. 5.

    Sandanger TM, Haugdahl Nøst T, Guida F, Rylander C, Campanella G, Muller DC, van Dongen J, Boomsma DI, Johansson M, Vineis P, Vermeulen R, Lund E, Chadeau-Hyam M. DNA methylation and associated gene expression in blood prior to lung cancer diagnosis in the Norwegian Women and Cancer cohort. Sci Rep. 2018;8:16714.

    Article  Google Scholar 

  6. 6.

    Yanaihara N, Caplen N, Bowman E, Seike M, Kumamoto K, Yi M, Stephens RM, Okamoto A, Yokota J, Tanaka T, Calin GA, Liu C-G, Croce CM, Harris CC. Unique microRNA molecular profiles in lung cancer diagnosis and prognosis. Cancer Cell. 2006;9(3):189–98.

    CAS  Article  PubMed  Google Scholar 

  7. 7.

    Hu Y, Chen G. Pathogenic mechanisms of lung adenocarcinoma in smokers and non-smokers determined by gene expression interrogation. Oncol Lett. 2015;10:1350–70.

    CAS  Article  Google Scholar 

  8. 8.

    Zhang Y, Breitling LP, Balavarca Y, Holleczek B, Schöttker B, Brenner H. Comparison and combination of blood DNA methylation at smoking-associated genes and at lung cancer-related genes in prediction of lung cancer mortality. Int J Cancer. 2016;139(11):2482–92.

    CAS  Article  PubMed  Google Scholar 

  9. 9.

    Baglietto L, Ponzi E, Haycock P, Hodge A, Assumma MB, Jung CH, Chung J, Fasanelli F, Guida F, Campanella G, Chadeau-Hyam M, Grankvist K, Johansson M, Ala U, Provero P, Wong EM, Joo J, English DR, Kazmi N, Lund E, Faltus C, Kaaks R, Risch A, Barrdahl M, Sandanger TM, Southey MC, Giles GG, Johansson M, Vineis P, Polidoro S, Relton CL, Severi G. DNA methylation changes measured in pre-diagnostic peripheral blood samples are associated with smoking and lung cancer risk. Int J Cancer. 2017;140:50–61.

    CAS  Article  Google Scholar 

  10. 10.

    Lock EF, Hoadley KA, Marron JS, Nobel AB. Joint and individual variation explained (JIVE) for integrated analysis of multiple data types. Ann Appl Stat. 2013;7:523–42.

    Article  Google Scholar 

  11. 11.

    O’Connell MJ, Lock EF. RJIVE for exploration of multi-source molecular data. Bioinformatics. 2016;32(18):2877–9.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  12. 12.

    Hellton KH, Thoresen M. Integrative clustering of high-dimensional data with joint and individual clusters. Biostatistics. 2016;17(3):537–48.

    Article  PubMed  Google Scholar 

  13. 13.

    Kuligowski J, Perez-Guaita D, Sanchez-Illana A, Leon-Gonzalez Z, de la Guardia M, Vento M, Lock EF, Quintas G. Analysis of multi-source metabolomic data using joint and individual variation explained (JIVE). Analyst. 2015;13:4521–9.

    Article  Google Scholar 

  14. 14.

    Kaplan A, Lock EF. Prediction with dimension reduction of multiple molecular data sources for patient survival. Cancer Inform. 2017;16:1–11.

    Article  Google Scholar 

  15. 15.

    Yu Q, Risk BB, Zhang K, Marron JS. JIVE integration of imaging and behavioral data. NeuroImage. 2017;152:38–49.

    Article  PubMed  Google Scholar 

  16. 16.

    Feng Q, Jiang M, Hannig J, Marron JS. Angle-based joint and individual variation explained. J Multivariate Anal. 2018;166:241–65.

    Article  Google Scholar 

  17. 17.

    Hotelling H. Relations between two sets of variates. Biometrika. 1936;28:321–77.

    Article  Google Scholar 

  18. 18.

    Trygg J, Wold H. O2-PLS, a two-block (x-y) latent variable regression (LVR) method with an integral OSC filter. J Chemom. 2003;17:53–64.

    CAS  Article  Google Scholar 

  19. 19.

    Witten D, Tibshirani R. Extensions of sparse canonical correlation analysis with applications to genomic data. Stat Appl Genet Mol Biol. 2009;8:28.

    Article  Google Scholar 

  20. 20.

    Argelaguet R, Velten B, Arnol D, Dietrich S, Zenz T, Marioni JC, Buettner F, Huber W, Stegle O. Multi-omics factor analysis—a framework for unsupervised integration of multi-omics data sets. Mol Syst Biol. 2018;14:8124.

    Article  Google Scholar 

  21. 21.

    Schouteden M, Van Deun TF, Wilderjans TF, Van Mechelen I. Performing DISCO-SCA to search for distinctive and common information in linked data. Behav Res Methods. 2013;46:576–87.

    Google Scholar 

  22. 22.

    Lofsted T, Hoffman D, Trygg J. Global, local and unique decomposition in OnPLS for multiblock data analysis. Anal Chim Acta. 2012;791:13–24.

    Article  Google Scholar 

  23. 23.

    Måge I, Smilde AK, van der Kloet FM. Performance of methods that separate common and distinct variation in multiple data blocks. J Chemom. 2019;33:3085.

    Article  Google Scholar 

  24. 24.

    Westerhuis JA, Kourti T, MacGregor JF. Analysis of multiblock and hierarchical PCA and PLS models. J Chemom. 1998;12:301–21.

    CAS  Article  Google Scholar 

  25. 25.

    Fan J, Wang D, Wang K, Zhu Z. Distributed estimation of principal eigenspaces. Ann Stat. 2019;47:3009–31.

    PubMed  PubMed Central  Google Scholar 

  26. 26.

    Tang T.M., Allen G.I.: Integrated principal components analysis (2018). arXiv:1810.00832

  27. 27.

    McCabe SD, Lin DY, Love MI. Consistency and overfitting of multi-omics methods on experimental data. Briefings Bioinf. 2020;21:1277–84.

    CAS  Article  Google Scholar 

  28. 28.

    Lund E, Dumeaux V, Braaten T, Hjartåker A, Engeset D, Skeie G, Kumle M. Cohort profile: the Norwegian Women and Cancer study: NOWAC—kvinner og kreft. Int J Epidemiol. 2008;37:36–41.

    Article  Google Scholar 

  29. 29.

    Zhu M, Ghodsi A. Automatic dimensionality selection from the scree plot via the use of profile likelihood. Comput Stat Data Anal. 2006;51:918–30.

    Article  Google Scholar 

  30. 30.

    Jiang M. AJIVE project (2018).

  31. 31.

    Carmichael I. ajive: angle based joint and individual variation explained. 2019.

  32. 32.

    Guida F, Sandanger TM, Castagne R, Campanella G, Polidoro S, Palli D, Krogh V, Tumino R, Sacerdote C, Panico S, Severi G, Kyrtopoulos SA, Georgiadis P, Vermeulen RCH, Lund E, Vineis P, Chadeau-Hyam M. Dynamics of smoking-induced genome-wide methylation changes with time since smoking cessation. Hum Mol Genet. 2015;24:2349–59.

    CAS  Article  Google Scholar 

  33. 33.

    Zhang Z, Liu J, Kaur M, Krantz ID. Characterization of DNA methylation and its association with other biological systems in lymphoblastoid cell lines. Genomics. 2012;99(4):209–19.

    CAS  Article  PubMed  Google Scholar 

  34. 34.

    Ma B, Wilker EH, Willis-Owen SAG, Byun H-M, Wong KCC, Motta V, Baccarelli AA, Schwartz J, Cookson WOCM, Khabbaz K, Mittleman MA, Moffatt MF, Liang L. Predicting DNA methylation level across human tissues. Nucleic Acids Res. 2014;42(6):3515–28.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  35. 35.

    Du P, Zhang X, Huang CC, Jafari N, Kibbe WA, Hou L, Lin SM. Comparison of Beta-value and M-value methods for quantifying methylation levels by microarray analysis. BMC Bioinf. 2010;11:587.

    CAS  Article  Google Scholar 

  36. 36.

    Jiang R, Tang W, Wu X, Wenhui F. A random forest approach to the detection of epistatic interactions in case–control studies. BMC Bioinf. 2009;10:65.

    Article  Google Scholar 

  37. 37.

    Rohart F, Gautier B, Singh A, Le Cao KA. mixOmics: an R package for omics feature selection and multiple data integration. PLoS Comput Biol. 2017;13(11):1005752.

    Article  Google Scholar 

  38. 38.

    Sørlie T, Perou CM, Tibshirani R, Aas T, Geisler S, Johnsen H, Hastie T, Eisen MB, van de Rijn M, Jeffrey SS, Thorsen T, Quist H, Matese JC, Brown PO, Botstein PE, Lønning D, Børresen-Dale AL. Gene expression patterns of breast carcinomas distinguish tumor subclasses with clinical implications. Proc Natl Acad Sci. 2001;98(19):10869–74.

    Article  Google Scholar 

  39. 39.

    Nøst T.H., Holden M., Dønnem T., Bøvelstad H.M., Rylander C., Lund E., Sandanger T.: Transcriptomic signals in blood prior to lung cancer focusing on time to diagnosis and metastasis. In Submission (2020)

  40. 40.

    Yu G, Wang LG, Han Y, He QYA. clusterprofiler: an R package for comparing biological themes among gene clusters. Omics: J Integr Biol. 2012;16:284–7.

    CAS  Article  Google Scholar 

  41. 41.

    Ru Y, Kechris KJ, Tabakoff B, Hoffman P, Radcliffe RA, Bowler R, Mahaffey S, Rossi S, Calin GA, Bemis L, Theodorescu DA. The multiMiR R package and database: integration of microRNA-target interactions along with their disease and drug associations. Nucleic Acids Res. 2014;42:133.

    Article  Google Scholar 

  42. 42.

    Gayananova I, Li G. Structural learning and integrative decomposition of multi-view data. Biometrics. 2019;75:1121–32.

    Article  Google Scholar 

Download references


The miRNA and mRNA analyses were provided by the Genomics Core Facility (GCF), Norwegian University of Science and Technology (NTNU). GCF is funded by the Faculty of Medicine and Health Sciences at NTNU and Central Norway Regional Health Authority.


Norwegian Research Council—Grant Number 248804: National training initiative to make better use of biobanks and health registry data. Norwegian Research Council—FRIMEDBIO Grant Number 262111: Identifying biomarkers of metastatic lung cancer using gene expression, DNA methylation and microRNAs in blood prior to clinical diagnosis (Id-Lung).

Author information




KM, MT and EP conceived the research idea. EP conducted the statistical analyses. THN was responsible for the acquisition of data and the biological interpretation of the results. EP, KM and MT wrote the manuscript, with inputs from THN. All authors gave final approval.

Corresponding author

Correspondence to Erica Ponzi.

Ethics declarations

Ethics approval and consent to participate

All participants gave written informed consent and the study was approved by the Regional Committee for Medical and Health Research Ethics and the Norwegian Data Inspectorate. More information is available in [28].

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. Different filtering methods on the NOWAC dataset.

Additional file 2

. Effect of initial ranks on the proportion of variance explained.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ponzi, E., Thoresen, M., Haugdahl Nøst, T. et al. Integrative, multi-omics, analysis of blood samples improves model predictions: applications to cancer. BMC Bioinformatics 22, 395 (2021).

Download citation


  • Data integration
  • Dimension reduction
  • Joint and individual variance explained
  • Multi-omics
  • Prediction models