 Methodology article
 Open access
 Published:
Coupled mixed model for joint genetic analysis of complex disorders with two independently collected data sets
BMC Bioinformatics volume 22, Article number: 50 (2021)
Abstract
Background
In the last decade, Genomewide Association studies (GWASs) have contributed to decoding the human genome by uncovering many genetic variations associated with various diseases. Many followup investigations involve joint analysis of multiple independently generated GWAS data sets. While most of the computational approaches developed for joint analysis are based on summary statistics, the joint analysis based on individuallevel data with consideration of confounding factors remains to be a challenge.
Results
In this study, we propose a method, called Coupled Mixed Model (CMM), that enables a joint GWAS analysis on two independently collected sets of GWAS data with different phenotypes. The CMM method does not require the data sets to have the same phenotypes as it aims to infer the unknown phenotypes using a set of multivariate sparse mixed models. Moreover, CMM addresses the confounding variables due to population stratification, family structures, and cryptic relatedness, as well as those arising during data collection such as batch effects that frequently appear in joint genetic studies. We evaluate the performance of CMM using simulation experiments. In real data analysis, we illustrate the utility of CMM by an application to evaluating common genetic associations for Alzheimer’s disease and substance use disorder using datasets independently collected for the two complex human disorders. Comparison of the results with those from previous experiments and analyses supports the utility of our method and provides new insights into the diseases. The software is available at https://github.com/HaohanWang/CMM.
Background
Genomewide Association Studies (GWASs) have helped reveal about 10,000 associations between genetic variants in the human genome and diseases [1]. With the success of GWASs involving analysis of single data sets, a natural followup is to investigate multiple data sets [2], which we refer to as joint analysis. A joint analysis may uncover genetic mechanisms that cannot be discovered in a single analysis [3]. For example, recent studies have revealed overlapping genetic factors that influence multiple psychiatric disorders [4], genetic correlations between schizophrenia, ADHD, depression, and cannabis use [5], as well as an association between schizophrenia and illicit drug use [6]. Also, cooccurrences of substance use disorders (SUDs) and psychopathology have been observed in national epidemiologic surveys [7, 8], which suggests a further joint analysis should be conducted to uncover potential common genetic factors underlying both SUDs and diseases involving cognitive dysfunction.
However, a joint genetic analysis using two independently collected data sets can be very challenging. In addition to the issues commonly expected from single data sets such as population stratification [9], a straightforward application of computational methods proposed for single data sets for the joint analysis could result in false discoveries caused by confounding factors such as the batch effects due to different data collection procedures. Moreover, two independently collected data sets do not often share the phenotypes of interest. To help better understand these challenges, we illustrate them in detail in Fig. 1. For the two data sets 1 and 2 originally collected for independent studies of the red and blue phenotype, respectively, a joint analysis aims to discover common genetic variants associated with both of these phenotypes. However, in order to perform such analysis, as shown in Fig. 1, all the information that is enclosed in the boxes with dashed lines needs to be inferred which could pose major challenges for these analyses; questions need to be answered involve, e.g., what is the blue phenotype of the samples in data set 1 since the blue phenotype may not be collected when the data set 1 is generated? How to deal with different confounding factors present in different data sets, including population stratification, family structures, cryptic relatedness, and data collection confounders?
Existing methods for joint analysis on genetic data are mostly built on summary statistics e.g., [10,11,12,13,14,15,16,17,18,19,20]. More recently, [21] introduced multitrait analysis of GWAS (MTAG) that can perform joint analysis using the summary statistics calculated from cohorts with overlapping samples. [22] proposed a regularized Gaussian mixture model called iMAP to infer the association between SNPs to correlated phenotypes. [23] presented a heritabilityinformed power optimization method that finds an optimal linear combinations of association coefficients.
While summary statistics can help uncover common genetic factors from joint analysis, individuallevel data nonetheless contains more information that allows the analyst to adjust for patientlevel covariates, repeated measures, etc. [24]. Recently, [25] proposed a method for joint analysis which integrates individuallevel data together with summarylevel data. [26] directly used individuallevel data for the joint analysis of traits that are collected separately from different cohorts. However, none of these methods took advantage of the rich information of the distribution of SNPs in the individuallevel data, which allows the analyst to infer and correct the sample population structure or other potential confounding factors. In this work, we introduce a computational method for joint genetic analysis using individuallevel data with correction of potential confounding factors.
Here, we propose a method, namely Coupled Mixed Model (CMM), for a joint association analysis that directly operates on two GWAS sequence data sets. CMM aims to address all the challenges above and to provide a reliable joint analysis of the data sets by inferring the missing information as illustrated in Fig. 1. In particular, CMM infers the missing phenotypes and various confounding factors with the maximum likelihood estimation. It is also noteworthy that our method is different from the approaches for missing phenotype imputation such as [27, 28] in that our method aims to address the challenges when there are no empirical data which allows the correlation between different phenotypes to be measured—a common situation for independently collected data sets which are not originally generated for joint analysis purposes. We first verify the performance of our methods with simulation experiments, and then apply our method to real GWAS data sets previously generated for investigating genetic variants associated with substance use disorders (SUDs) and Alzheimer’s disease (AD), respectively, for joint analysis.
Results
Simulation experiments
We compare CMM to several approaches using simulated data sets.

HG(W): Joint analysis conducted with the hypergeometric tests [10] when the two independent problems are each solved by the standard univariate Wald testing with the BenjaminiHochberg (BH) procedure [29]. This is the most popular approach in GWAS for a single data set.

HG(L): Joint analysis conducted with the hypergeometric tests [10] when the two independent problems are each solved by a standard linear mixed model with the BenjaminiHochberg (BH) procedure [29].

CD: Combining dataset approach. CD merges two data sets \(X_1\) and \(X_2\) into one \(X=[X_1;X_2]\) and create a pseudo phenotype \(y\in \{0,1\}^{n_1+n_2}\) where \(y(i)=1\) if the i^{th} sample has either one of the two diseases.

iMAP: integrative MApping of Pleiotropic association, which is a method for joint analysis that models summary statistics from GWAS results by integrating SNP annotations in the model [22]. For a fair comparison of the methods, we do not use the SNP annotations with this method.

MTAG: multitrait analysis of GWAS [21], which is also a method for joint analysis of GWAS data sets using summary statistics, which accounts for potential confounders due to population stratification or cryptic relatedness.

LR: \(\ell _1\)regularized logistic regression, which can be directly applied to the two independent data sets for joint analysis. We select the intersection of the identified SNPs associated with each of the phenotypes as the SNPs jointly associated with both phenotypes.

AL: Adaptive Lasso, which is an extension of the Lasso that weighs the regularization term [30] (enabled by the method introduced in [31] for highdimensional data). AL is applied to the independent data sets in the same manner as LR. We use the logisticregression version of the method if the phenotypes are binary.

PL: Precision Lasso, a novel variant of the Lasso, that is developed for analyzing data with correlated and linearly dependent features, commonly seen in genomic studies [32]. PL is applied to the independent data sets in the same manner as LR.

JL: Joint Lasso, which is a method we implement in this study for a fair comparison of our proposed CMM method. JL solves the lasso problems jointly with the constraint \(\beta ^{(1)}=\beta ^{(2)}\) with ADMM. This approach can be seen as a CMM method without consideration of the confounding factors in the data.

CMM: Coupled Mixed Model. Our proposed method.
We simulate two independent data sets with binary phenotypes, whose SNPs are generated via SimuPop [33] with population structures. We also introduce the influences from confounding factors, resulting in a roughly 0.25 signaltonoise ratio for effect sizes. We mainly experiment with two different settings: the number of the associated SNPs and the fraction of these SNPs that are jointly associated with both phenotypes. We repeat the experiments with 10 different random seeds. Details of simulation are in Additional file 1: Section S5.1.
We first evaluate these methods with the focus on finding the SNPs associated with both phenotypes, and compare the performance of the competing methods with ROC curves. For the univariate testing methods (HG, CD, MTAG), the curves are plotted by varying the nullhypothesisrejecting threshold of pvalues, while for multivariate regularized regression methods, the curves are plotted by varying the regularizing hyperparameter (200 different choices evenly distributed in logspace from \(10^{5}\) to \(10^5\)), except the Precision Lasso which is tested with only 20 choices because of its limitation in scalability.
Figure 2 shows the ROC curves of the compared methods in terms of their abilities to find the SNPs associated with both phenotypes. Overall, the results favor our CMM method significantly. In comparison with the other methods, the superiority of the proposed CMM is more evident when there are fewer associated SNPs in each data set, and also when there are fewer SNPs associated with both phenotypes. For example, as shown in Fig. 2, when only \(0.1\%\) of the SNPs are associated with a phenotype (first row), the advantage of CMM can be clearly seen; however, when \(1\%\) of SNPs are associated with a phenotype (last row), CMM barely outperforms HG(L) methods.
By comparing the performances of the compared methods in different columns in Fig. 2, we can see how the common SNPs (i.e., those associated with both phenotypes) affect the results: as the percentage of the common SNPs increases, in general, the performances of all the compared methods increase. Also, we notice that the performance of CMM does not vary significantly as the number of the common SNPs varies, This observation indicates that the Constraint (3) in our optimization problem does not necessarily deteriorate the method’s performance even when the two phenotypes are less related.
With the clear advantage of CMM, we now proceed to discuss more about the other competing methods. We notice that multivariate methods (LR, AL, JL) tend to perform well when there are less associated SNPs as well as less common SNPs, while univariate methods (HG(W), HG(L), CD) favor the opposite scenarios with more associated SNPs and more common SNPs. For instance, JL, which can be considered as a multivariate version of CD, barely outperforms CD. As the number of the common SNPs increases, the performance of CD improves clearly, while that of JL does not. This result can be explained as follows: CD only aims to recover the common SNPs, while JL balances between minimizing the two logistic regression cost functions and minimizing the differentiation between coefficients which may not result in a more effective recovery of the common SNPs. Unfortunately, summary statisticsbased methods (iMAP and MTAG) do not perform well in our simulation experiment settings, most likely due to the presence of the multiple sources of confounding factors in the simulated data. Also, iMAP is introduced as a method which leverages the power of SNP annotations for joint analysis, but we do not include the annotation information in the experiments for fair comparisons.
We also notice that LMM performs surprisingly well when there are many associated SNPs. For example, when there are \(1\%\) of the associated SNPs (last row of Fig. 2), LMM performs as the second best method. However, LMM does not perform well with fewer associated SNPs, as shown in the first two rows of Fig. 2. Furthermore, we plot the results of the ROC curves of the compared methods regarding their abilities in uncovering the associated SNPs separately for each data set, which are shown in Additional file 1: Section S4.2. Together, these simulation results demonstrate that CMM outperforms the other methods in terms of finding common SNPs associated with both phenotypes, as well as finding associated SNPs with individual phenotype.
We also tested our CMM method for predicting the phenotypes across data sets in comparison to the other competing regressionbased methods. The results are presented in Additionalfile 1: Section S5.2 and S5.3.
Real data analysis: joint genetic analysis for Alzheimer’s disease and substance use disorder
Application of CMM to two GWAS data sets for AD and SUDs
In the real data analysis, we apply our proposed CMM method to two GWAS data sets independently generated previously to investigate genetic association for AD and SUDs, respectively. The AD data set was collected from the Alzheimer’s Disease Neuroimaging Initiative (ADNI)^{Footnote 1} and the SUD data set was collected by the CEDAR Center at the University of Pittsburgh^{Footnote 2}. For the AD data set, we only used the data generated from the individuals diagnosed with either AD or normal controls. There are 477 individuals in the final AD data set with 188 case samples and 289 control samples. For the SUD data set, we consider the subjects with drug abuse history as the case group and the subjects with neither drug abuse nor alcohol abuse behavior as the control group, excluding the subjects with only alcohol abuse behavior (but not drug abuse history), because alcoholism is usually believed to be related to drug abuse. There are 359 patients in the final SUD data set with 153 case samples and 206 control samples. We also exclude the SNPs on Xchromosome following suggestions of previous studies [34]. There are 257361 SNPs in these two data sets left to be examined. Even though the sample sizes of the AD and the SUD data sets are small, which unfortunately is a common situation for genetic studies of complex human diseases, particularly for SUDs, our results suggest that our CMM method can help identify promising genetic variants that are worth further investigation.
Due to the statistical limitation of selecting hyperparameters using crossvalidation and information criteria in high dimensional data [32], we tune the hyperparameters according to the number of SNPs we aim to select, following previous work [32, 35, 36] and the hyperparameters of our model will be tuned automatically through binary search for the set of parameters according to the number of SNPs we inquire. This hyperparameter selection procedure has been shown to generate less false positives in general than crossvalidation, even when the queried number of SNPs is (reasonably) misspecified [32]. To mitigate the computation load, the algorithm will terminate the hyperparameter search when the number of the reported SNPs lies within 50–200% of the number we inquire.
We inquire for 30 SNPs selected in each data set, and CMM identified five SNPs that are associated with both SUD and AD, which is reported in Table 1. CMM reported 15 additional SNPs and 35 additional SNPs for SUD and AD respectively, which are reported in Tables S1 and S2 (Additional file 1: Section S7). Notably, we do not find much overlap between our findings and those from the previous studies in the GWAS Catalog [37], and we believe this is because our method explicitly favors to identify the SNPs that are jointly associated with both of the disease phenotypes. Nevertheless, we find many pieces of evidence supporting our findings. The following discussion focuses on the validation of these five identified SNPs.
Validation of the identified common SNPs associated with both AD and SUDs
Statistical validation In order to validate the five identified common SNPs, we first compared the distribution differences of SNPs between the case and control samples in each of the diseases. We notice that in most cases, the allele frequencies are different between the case and the control samples (shown in Table 2). Also, we examine the statistical significance of independence between the SNPs in the control group vs. the case group with the student’s t test. Seven out of the ten tests report a statistically significant sign of independence (shown in Table 2).
Literature support Due to the lack of direct information on the SNPs and the disease phenotypes, we also verify our findings via literature search based on the relationship between the genes where the identified SNPs reside and the phenotypes.
Our results show that rs224534 identified by CMM to be associated with both AD and SUD resides in TRPV1 which encodes transient receptor potential cation channel subfamily V member 1. Previous evidence showed that positive modulation of the TRPV1 channels could be a potential target for mitigation of AD [38], suggesting an important involvement of TRPV1 in AD. In addition, [39] have also shown that TRPV1 plays a key role in morphine addiction. Blednov and Harris [40] showed that the deletion of TRPV1 in mice altered behavioral effects of ethanol which indicates a connection between TRPV1 and alcoholism.
Moreover, TRPV1 mediates longterm synaptic depression in the hippocampus [41], which is key to rewardrelated learning and addiction [42]. Further, we notice that in the “Inflammatory mediator regulation of TRP channels” pathway of the KEGG database [43], TRPV1 serves as a Ca2+ channel. Ca2+ binding to calmodulin (CaM) activates Ca2+/CaMdependent protein kinase II (CAMKII). CaMKII is involved in many signaling cascades and is an important mediator of learning and memory [44], which plays an important role in neuropsychiatric disorders including drug addiction, schizophrenia, depression and multiple neurodevelopmental disorders [45, 46].
Additional evidence using an independent approach In addition to the statistical and literature support, we also validate TRPV1 as a SUDrelated protein using an independent study of the drugtarget interaction analysis.
In this drugtarget interaction analysis, we identified the known ligands of the corresponding proteins of each gene through drug/ligandtarget interactions compiled in DrugBank [47] and STITCH [48] databases. In addition, predicted ligands with high confidence were obtained by applying a probabilistic matrix factorization (PMF) model [49] on known drug/ligandtarget interactions in DrugBank and STITCH. The data and the method are accessible on our online server (http://quartata.csb.pitt.edu). Among the identified known and predicted ligands, we focused on the drugs that are associated with either SUD or AD. The results show that 4 SUDrelated drugs are known to interact with TRPV1 and 5 SUDrelated drugs are predicted to interact with TRPV1, which supports the association between TRPV1 and SUD.
In particular, as illustrated in Fig. 3, our analysis shows that TRPV1 is the known target of medical cannabis (plant use of marijuana), as well as three cannabinoids (nabiximols, cannabidivarin, and cannabidiol) in cannabis, according to the annotations in DrugBank. In the PMF prediction model, TRPV1 is the predicted target of two cannabinoids (tetrahydrocannabivarin, cannabichromene) extracted from cannabis, two synthetic cannabinoids (dronabinol and nabilone) of \(\Delta\)9THC (another cannabinoid from cannabis), as well as a central nervous system (CNS) depressant (flunitrazepam). These drugs are commonly known as drugs of abuse, and thus these results help verify the association between TRPV1 and SUD.
Together, these results suggest that our findings, although explorative, may reveal novel genetic connections between SUD and AD. More discussions on the SNPs shown in Table 1 are presented in Additional file 1: Section S6. For other SNPs identified by CMM which are associated with either AD or SUD, we discuss them in detail in Additional file 1: Section S7.
Conclusion
Following previous successes in joint genetic analysis using summary statisticsbased approaches, we propose a novel method, Coupled Mixed Model (CMM), that operates on individuallevel SNP data and aims to address challenges illustrated in Fig. 1. We further present an algorithm that allows an efficient parameter estimation of the objective function derived from our model.
With extensive simulation experiments, we showed the superior performance of the CMM method in comparison with several competing approaches. In the real data analysis, we applied our method to identify the common SNPs associated with both AD and SUD. CMM identified five SNPs associated with both of the disease phenotypes. Notably, one of the identified SNPs reside in the gene TRPV1, which has been linked to both AD and SUD by multiple pieces of evidence, including statistical tests showing differences in the allele frequencies between the case and the control samples, previous evidence in the literature, as well as results from an independent study of the drugtarget interaction analysis. Together, we show that our proposed CMM method is able to uncover promising genetic variants that are associated with different disease phenotypes using individually collected GWAS data sets and reveal novel connections between diseases.
Methods
Coupled mixed model
The following are the notations we use in this work: The subscript denotes the identifier of data set, and the superscript in parentheses denotes the identifier of phenotypes. Genotypes and phenotypes are denoted as \({\mathbf {X}}\) and \({\mathbf {y}}\), respectively. Also, n denotes the sample size, and p denotes the number of SNPs. Specifically, consider a scenario as illustrated in Fig. 1, \({\mathbf {X}}_1\) and \({\mathbf {X}}_2\) represent the genotypes of the samples in data sets 1 and 2 with the dimension of \(n_1 \times p\) and \(n_2 \times p\), respectively. \({\mathbf {y}}_1^{(1)}\) and \({\mathbf {y}}_1^{(2)}\) denote the vectors of phenotypes 1 and 2, respectively, of the dimension \(n_1 \times 1\) for the samples in data set 1. Note that \({\mathbf {y}}_1^{(2)}\) is not observed. Similarly, \({\mathbf {y}}_2^{(1)}\) and \({\mathbf {y}}_2^{(2)}\) denote the vectors of phenotypes 1 and 2, respectively, of the dimension \(n_2 \times 1\) for the samples in data set 2. \({\mathbf {y}}_2^{(1)}\) is not observed.
Our method does not require \(n_1 = n_2\). However, for the convenience of the discussion, we will assume \(n_1 = n_2 = n\). The case of \(n_1 \ne n_2\) can be easily generalized by weighing the corresponding cost function components with \(1/n_1\) and \(1/n_2\), respectively. Following the similar logic, we introduce our method with the simplest linear models, but our method can be extended to the case of generalized linear models; for example, for casecontrol data, one can directly apply our method to binary trait data, as done by many previous examples [22, 50,51,52,53]. Also, one can use our method with the residual phenotype after regressing other additional covariates (e.g, age or sex).
Straightforwardly, for the scenario shown in Fig. 1, we have:
where \({\mathbf {u}}_i^{(j)}\) accounts for the confounding effects due to population stratification, family structures and cryptic relatedness in data set i with phenotype j; and \({\mathbf {v}}_i\) accounts for the confounding effects due to data collection (e.g., batch effects) in data set i; \(\mathbf {\epsilon }_i^{(j)}\) stands for residual noises for data set i with phenotype j, and \(\mathbf {\epsilon }_i^{(j)} \sim N(0, \mathbf {I}\sigma _\epsilon ^2)\), where \(\mathbf {I}\) is an identity matrix with the shape of \(n \times n\). Notice that we will drop the unidentifiable term \(\mathbf {\epsilon }_i^{(j)}\) later during parameter estimation, otherwise these terms will turn the entire model unidentifiable.
We have \({\mathbf {u}}_i^{(j)} \sim N(0, {\mathbf{K}}_i\sigma _{u^{(j)}}^2)\) for data set i with phenotype j. As observed by [9], population stratification can cause false discoveries because there exist real associations between a phenotype and untyped SNPs that have similar allele frequencies with some typed SNPs that are not actually associated with the phenotype, which, as a result, can lead to false associations between the phenotype and the typed SNPs. Since these false associations due to confounders from population stratification are phenotype specific, we model \(\sigma _{u^{(j)}}^2\) as phenotypespecific. Hence, although we have four different variance terms (i.e., \({\mathbf {u}}_1^{(1)}\), \({\mathbf {u}}_1^{(2)}\), \({\mathbf {u}}_2^{(1)}\), and \({\mathbf {u}}_2^{(2)}\)) accounting for population confounders, they are only parameterized by two scalars, \(\sigma _{u^{(1)}}^2\) and \(\sigma _{u^{(2)}}^2\). \({\mathbf{K}}_i={\mathbf {X}}_i{\mathbf {X}}_i^T\) is the kinship matrix, constructed following the genetics convention [54]. A more sophisticated construction of the kinship matrix may be used to improve detection of the signals, but these details are beyond the scope of this paper. One can refer to examples in [55,56,57] for more details.
To model the confounders due to data collection, we have \({\mathbf {v}}_i \sim N(0, \mathbf {I}\sigma _{v_i}^2)\) for data set i. Because these confounders are only related to the data collection procedure, we model \(\sigma _{v_i}^2\) as data setspecific.
For the independently collected data sets, we only observe \(\langle {\mathbf {X}}_1, {\mathbf {y}}_1^{(1)} \rangle\) and \(\langle {\mathbf {X}}_2, {\mathbf {y}}_2^{(2)}\rangle\). Since we are interested in estimating \({ {\beta }}^{(1)}\) and \({ {\beta }}^{(2)}\), we also need to estimate \({\mathbf {y}}_1^{(2)}\), \({\mathbf {y}}_2^{(1)}\), \(\sigma _{u^1}^2\), \(\sigma _{u^2}^2\), \(\sigma _{v_1}^2\), and \(\sigma _{v_2}^2\) in Eq. 1. As noted earlier, we drop the \(\mathbf {\epsilon }_i^{(j)}\). to avoid the model to become unidentifiable.
In order to estimate \({ {\beta }}^{(1)}\) and \({ {\beta }}^{(2)}\), we minimize the joint negative loglikelihood function. Because there are only a subset of SNPs that contribute to the phenotype, we introduce the standard \(\ell _1\) regularization by setting the prior distribution of \({ {\beta }}^{(1)}\) and \({ {\beta }}^{(2)}\) as a Laplace distribution. Additionally, to encourage our method to find common SNPs associated with both phenotypes, we use a simple constraint, as shown in Constraint (3). Taken together, the optimization problem for solving our model in Eq. 1 can be represented as follows:
where
where \(\Sigma\) is the covariance matrix defined as:
and we have:
and \(\xi\) denotes a small number. The detailed derivation is described in Additional file 1: Section S1. The key steps involve replacing \({\mathbf {y}}_1^{(2)}\) with \({\mathbf {X}}_1\beta ^{(2)}\), and replacing \({\mathbf {y}}_2^{(1)}\) with \({\mathbf {X}}_2\beta ^{(1)}\), and then writing out the joint likelihood function of Eq. 1.
To solve the optimization Function (2), we propose a strategy as follows. We first estimate the parameters \(\{\sigma _{u^{(1)}}^2, \sigma _{u^{(2)}}^2, \sigma _{v_1}^2, \sigma _{v_2}^2 \}\) following the P3D setup [58]. Then we propose an iterative updating algorithm that decouples the dependency between \(\{\beta ^{(1)}, \beta ^{(2)}\}\) and t in the optimization function 2 and solves for \(\{\beta ^{(1)}, \beta ^{(2)}\}\) and t with ADMM [59], which naturally uses the Constraint 3. We also offer a proof to show that our iterative updating algorithm will converge. The details of the algorithm and the convergence proof are presented in the Additional file 1: Section S2 and S3, respectively. While the method presented above works reasonably well (as we will show below), we hope to remind the readers that an alternative approach is to marginalize \({\mathbf {y}}_1^{(2)}\) and \({\mathbf {y}}_2^{(1)}\) instead of replacing them with the MLE estimation. However, this approach is not the focus of this paper and we will leave it for future study.
Implementation
The implementation of the CMM method is available as a python software. Without installation, one can run the software with a single command line. It takes standard Plink format as input. If there are mismatched SNPs between the data sets, CMM will use the intersection of these SNPs. We recommend the users to query CMM to identify a specific number of SNPs for each data set and CMM can tune the hyperparameters accordingly [32]. However, users can also choose to specify the regularization parameters. If none of the above information is specified, CMM will automatically conduct fivefold crossvalidation to tune parameters. \(\xi\) does not need to be specified or tuned, because it can be dropped due to ADMM. The implementation is available as a standalone software (https://github.com/HaohanWang/CMM). More detailed instructions of how to use the software are presented in Additional file 1: Section S4.
In theory, the computational complexity of the first step of the algorithm is \(O(n^3)\), and complexity of the second step is O(np). In practice, as we observe on two data sets with hundreds of samples and 200k SNPs, it takes CMM around a minute to converge given a set of hyperparameters on a modern server (2.30 GHz CPU and 128G RAM, Linux OS), and up to an hour to finish the entire hyperparameter tuning process.
Availability of data and materials
The programs CMM is available at https://github.com/HaohanWang/CMM The datasets used and analysed during the current study are available from the corresponding author on reasonable request.
Abbreviations
 LMM:

Linear mixed model
 CMM:

Coupled Mixed Model
 MAF:

Minor allele frequency
 SNP:

Single nucleotide polymorphism
 AD:

Alzheimer’s disease
 SUD:

Substance use disorder
 GWAS:

Genome Wide Association Studies
References
Visscher PM, Wray NR, Zhang Q, Sklar P, McCarthy MI, Brown MA, Yang J. 10 years of GWAS discovery: biology, function, and translation. Am J Hum Genet. 2017;101(1):5–22.
Wu C, Wang Z, Song X, Feng XS, Abnet CC, He J, Hu N, Zuo XB, Tan W, Zhan Q, et al. Joint analysis of three genomewide association studies of esophageal squamous cell carcinoma in Chinese populations. Nat Genet. 2014;46(9):1001–6.
Mukherjee S, Thornton T, Naj A, Kim S, Kauwe J, Fardo D, Valladares O, Wijsman E, Schellenberg G, Crane P. GWAS of the joint ADGC data set identifies novel common variants associated with lateonset Alzheimer’s disease. Alzheimer’s Dement J Alzheimer’s Assoc. 2013;9(4):550.
Pain O, Dudbridge F, Cardno AG, Freeman D, Lu Y, Lundstrom S, Lichtenstein P, Ronald A. Genomewide analysis of adolescent psychoticlike experiences shows genetic overlap with psychiatric disorders. bioRxiv; 2018. 265512.
Walters RK, Adams MJ, Adkins AE, Aliev F, Bacanu SA, Batzler A, Bertelsen S, Biernacka J, Bigdeli TB, Chen LS, et al. Transancestral GWAS of alcohol dependence reveals common genetic underpinnings with psychiatric disorders. bioRxiv; 2018. 257311.
Mallard TT, Harden KP, Fromme K. Genetic risk for schizophrenia influences substance use in emerging adulthood: an eventlevel polygenic prediction model. bioRxiv; 2018.157636.
Grant BF, Goldstein RB, Saha TD, Chou SP, Jung J, Zhang H, Pickering RP, Ruan WJ, Smith SM, Huang B, et al. Epidemiology of dsm5 alcohol use disorder: results from the national epidemiologic survey on alcohol and related conditions iii. JAMA Psychiatry. 2015;72(8):757–66.
Grant BF, Saha TD, Ruan WJ, Goldstein RB, Chou SP, Jung J, Zhang H, Smith SM, Pickering RP, Huang B, et al. Epidemiology of dsm5 drug use disorder: results from the national epidemiologic survey on alcohol and related conditionsiii. JAMA Psychiatry. 2016;73(1):39–47.
Devlin B, Roeder K. Genomic control for association studies. Biometrics. 1999;55(4):997–1004.
McGeachie MJ, Clemmer GL, LaskySu J, Dahlin A, Raby BA, Weiss ST. Joint GWAS analysis: comparing similar GWAS at different genomic resolutions identifies novel pathway associations with six complex diseases. Genomics Data. 2014;2:202–11.
Giambartolomei C, Vukcevic D, Schadt EE, Franke L, Hingorani AD, Wallace C, Plagnol V. Bayesian test for colocalisation between pairs of genetic association studies using summary statistics. PLoS Genet. 2014;10(5):1004383.
Kang EY, Han B, Furlotte N, Joo JWJ, Shih D, Davis RC, Lusis AJ, Eskin E. Metaanalysis identifies genebyenvironment interactions as demonstrated in a study of 4,965 mice. PLoS Genet. 2014;10(1):1004022.
Zhu X, Feng T, Tayo BO, Liang J, Young JH, Franceschini N, Smith JA, Yanek LR, Sun YV, Edwards TL, et al. Metaanalysis of correlated traits via summary statistics from GWASs with an application in hypertension. Am J Hum Genet. 2015;96(1):21–36.
BulikSullivan B, Finucane HK, Anttila V, Gusev A, Day FR, Loh PR, Duncan L, Perry JR, Patterson N, Robinson EB, et al. An atlas of genetic correlations across human diseases and traits. Nat Genet. 2015;47(11):1236.
Nieuwboer HA, Pool R, Dolan CV, Boomsma DI, Nivard MG. GWIS: genomewide inferred statistics for functions of multiple phenotypes. Am J Hum Genet. 2016;99(4):917–27.
Hu Y, Lu Q, Liu W, Zhang Y, Li M, Zhao H. Joint modeling of genetically correlated diseases and functional annotations increases accuracy of polygenic risk prediction. PLoS Genet. 2017;13(6):1006836.
Wen X, PiqueRegi R, Luca F. Integrating molecular qtl data into genomewide genetic association analysis: probabilistic assessment of enrichment and colocalization. PLoS Genet. 2017;13(3):1006646.
Liu J, Wan X, Wang C, Yang C, Zhou X, Yang C. LLR: a latent lowrank approach to colocalizing genetic risk variants in multiple GWAS. Bioinformatics. 2017;33(24):3878–86.
Sha Q, Wang Z, Zhang X, Zhang S. A clustering linear combination approach to jointly analyze multiple phenotypes for GWAS. Bioinformatics. 2019;35(8):1373–79.
Guo B, Wu B. Powerful and efficient SNPset association tests across multiple phenotypes using GWAS summary data. Bioinformatics. 2019;35(8):1366–72.
Turley P, Walters RK, Maghzian O, Okbay A, Lee JJ, Fontana MA, NguyenViet TA, Wedow R, Zacher M, Furlotte NA, et al. Multitrait analysis of genomewide association summary statistics using mtag. Nat Genet. 2018;50(2):229.
Zeng P, Hao X, Zhou X. Pleiotropic mapping and annotation selection in genomewide association studies with penalized Gaussian mixture models. Bioinformatics. 2018;34(16):2797–807.
Qi G, Chatterjee N. Heritability informed power optimization (HIPO) leads to enhanced detection of genetic associations across multiple traits. PLoS Genet. 2018;14(10):1007549.
Siddique J, Reiter JP, Brincks A, Gibbons RD, Crespi CM, Brown CH. Multiple imputation for harmonizing longitudinal noncommensurate measures in individual participant data metaanalysis. Stat Med. 2015;34(26):3399–414.
Dai M, Wan X, Peng H, Wang Y, Liu Y, Liu J, Xu Z, Yang C. Joint analysis of individuallevel and summarylevel GWAS data by leveraging pleiotropy. Bioinformatics. 2019;35(10):1729–36.
Yang Y, Dai M, Huang J, Lin X, Yang C, Chen M, Liu J. LPG: a fourgroup probabilistic approach to leveraging pleiotropy in genomewide association studies. BMC Genomics. 2018;19(1):503.
Dahl A, Iotchkova V, Baud A, Johansson Å, Gyllensten U, Soranzo N, Mott R, Kranis A, Marchini J. A multiplephenotype imputation method for genetic studies. Nat Genet. 2015;47(3):466.
Hormozdiari F, Kang EY, Bilow M, BenDavid E, Vulpe C, McLachlan S, Lusis AJ, Han B, Eskin E. Imputing phenotypes for genomewide association studies. Am J Hum Genet. 2016;99(1):89–103.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat soc Ser B (Methodological). 1995;57:289–300.
Zou H. The adaptive lasso and its oracle properties. J Am Stat Assoc. 2006;101(476):1418–29.
Huang J, Ma S, Zhang CH. Adaptive lasso for sparse highdimensional regression models. Stat Sin. 2008;18:1603–18.
Wang H, Lengerich BJ, Aragam B, Xing EP. Precision Lasso: accounting for correlations and linear dependencies in highdimensional genomic data. Bioinformatics. 2019;35(7):1181–87.
Peng B, Kimmel M. simuPOP: a forwardtime population genetics simulation environment. Bioinformatics. 2005;21(18):3686–7.
Bertram L, Lange C, Mullin K, Parkinson M, Hsiao M, Hogan MF, Schjeide BM, Hooli B, DiVito J, Ionita I, et al. Genomewide association analysis reveals putative Alzheimer’s disease susceptibility loci in addition to apoe. Am J Hum Genet. 2008;83(5):623–32.
Wu TT, Chen YF, Hastie T, Sobel E, Lange K. Genomewide association analysis by lasso penalized logistic regression. Bioinformatics. 2009;25(6):714–21.
MarchettiBowick M, Yin J, Howrylak JA, Xing EP. A timevarying group sparse additive model for genomewide association studies of dynamic complex traits. Bioinformatics. 2016;32(19):2903–10.
Welter D, MacArthur J, Morales J, Burdett T, Hall P, Junkins H, Klemm A, Flicek P, Manolio T, Hindorff L, et al. The NHGRI GWAS catalog, a curated resource of SNPtrait associations. Nucleic Acids Res. 2013;42(D1):1001–6.
Jayant S, Sharma B, Sharma B. Protective effect of transient receptor potential vanilloid subtype 1 (TRPV1) modulator, against behavioral, biochemical and structural damage in experimental models of Alzheimer’s disease. Brain Res. 2016;1642:397–408.
Nguyen TL, Kwon SH, Hong SI, Ma SX, Jung YH, Hwang JY, Kim HC, Lee SY, Jang CG. Transient receptor potential vanilloid type 1 channel may modulate opioid reward. Neuropsychopharmacology. 2014;39(10):2414–22.
Blednov Y, Harris R. Deletion of vanilloid receptor (TRPV1) in mice alters behavioral effects of ethanol. Neuropharmacology. 2009;56(4):814–20.
Gibson HE, Edwards JG, Page RS, Van Hook MJ, Kauer JA. TRPV1 channels mediate longterm depression at synapses on hippocampal interneurons. Neuron. 2008;57(5):746–59.
Kauer JA, Malenka RC. Synaptic plasticity and addiction. Nat Rev Neurosci. 2007;8(11):844.
Kanehisa M, Furumichi M, Tanabe M, Sato Y, Morishima K. KEGG: new perspectives on genomes, pathways, diseases and drugs. Nucleic Acids Res. 2016;45(D1):353–61.
Yamauchi T. Neuronal ca2+/calmodulindependent protein kinase iidiscovery, progress in a quarter of a century, and perspective: implication for learning and memory. Biol Pharm Bull. 2005;28(8):1342–54.
Robison A. Emerging role of Camkii in neuropsychiatric disease. Trends Neurosci. 2014;37(11):653–62.
Müller CP, Quednow BB, Lourdusamy A, Kornhuber J, Schumann G, Giese KP. Cam kinases: from memories to addiction. Trends Pharmacol Sci. 2016;37(2):153–66.
Wishart DS, Feunang YD, Guo AC, Lo EJ, Marcu A, Grant JR, Sajed T, Johnson D, Li C, Sayeeda Z, et al. Drugbank 50: a major update to the drugbank database for 2018. Nucleic Acids Res. 2017;46(D1):1074–82.
Szklarczyk D, Santos A, von Mering C, Jensen LJ, Bork P, Kuhn M. STITCH 5: augmenting protein–chemical interaction networks with tissue and affinity data. Nucleic Acids Res. 2015;44(D1):380–4.
Cobanoglu MC, Liu C, Hu F, Oltvai ZN, Bahar I. Predicting drug–target interactions using probabilistic matrix factorization. J Chem Inf Model. 2013;53(12):3399–409.
Moser G, Lee SH, Hayes BJ, Goddard ME, Wray NR, Visscher PM. Simultaneous discovery, estimation and prediction analysis of complex traits using a Bayesian mixture model. PLoS Genet. 2015;11(4):1004969.
Speed D, Balding DJ. Multiblup: improved SNPbased prediction for complex traits. Genome Res. 2014;24(9):1550–7.
Weissbrod O, Geiger D, Rosset S. Multikernel linear mixed models for complex phenotype prediction. Genome Res. 2016;26(7):969–79.
Zhou X, Carbonetto P, Stephens M. Polygenic modeling with Bayesian sparse linear mixed models. PLoS Genet. 2013;9(2):1003264.
Yang J, Zaitlen NA, Goddard ME, Visscher PM, Price AL. Advantages and pitfalls in the application of mixedmodel association methods. Nat Genet. 2014;46(2):100–6.
Listgarten J, Lippert C, Heckerman D. FastLMMselect for addressing confounding from spatial structure and rare variants. Nat Genet. 2013;45(5):470.
Tucker G, Price AL, Berger B. Improving the power of GWAS and avoiding confounding from population stratification with PCselect. Genetics. 2014;197(3):1045–9.
Wang H, Aragam B, Xing EP. Variable selection in heterogeneous datasets: a truncatedrank sparse linear mixed model with applications to genomewide association studies. In: IEEE international conference on bioinformatics and biomedicine (BIBM). IEEE. 2017.
Zhang Z, Ersoz E, Lai CQ, Todhunter RJ, Tiwari HK, Gore MA, Bradbury PJ, Yu J, Arnett DK, Ordovas JM, et al. Mixed linear model approach adapted for genomewide association studies. Nat Genet. 2010;42(4):355–60.
Boyd S, Parikh N, Chu E, Peleato B, Eckstein J. Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn. 2011;3(1):1–122.
Sherry ST, Ward MH, Kholodov M, Baker J, Phan L, Smigielski EM, Sirotkin K. DBSNP: the NCBI database of genetic variation. Nucleic Acids Res. 2001;29(1):308–11.
Acknowledgements
The authors would like to thank Seunghak Lee and Ben Lengerich for suggestions and comments in the preparation of this manuscript. The authors would also like to thank Miaofeng Liu for help in the convergence proof of the algorithm. The authors would also like to thank Alzheimer’s Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense Award Number W81XWH1220012) for the availability of the data.
Funding
This work is supported by the National Institutes of Health Grants R01GM093156 and P30DA035778. The funding sources had no role in the design of the study, the collection, analysis, and interpretation of data or in writing the manuscript.
Author information
Authors and Affiliations
Contributions
HW proposed and the idea, conducted the experiment and wrote the manuscript. FP analyzed the results. MMV prepared the Alcoholism data. WW designed the experiment, read and wrote the manuscript. IB and EPX read and wrote the manuscript. All authors read and approved of the final manuscript.
Corresponding authors
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
Supporting information including mathematical details of the derivations, software instructions and additional experimental results.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Wang, H., Pei, F., Vanyukov, M.M. et al. Coupled mixed model for joint genetic analysis of complex disorders with two independently collected data sets. BMC Bioinformatics 22, 50 (2021). https://doi.org/10.1186/s12859021039592
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12859021039592