Skip to main content

Longitudinal linear combination test for gene set analysis



Although microarray studies have greatly contributed to recent genetic advances, lack of replication has been a continuing concern in this area. Complex study designs have the potential to address this concern, though they remain undervalued by investigators due to the lack of proper analysis methods. The primary challenge in the analysis of complex microarray study data is handling the correlation structure within data while also dealing with the combination of large number of genetic measurements and small number of subjects that are ubiquitous even in standard microarray studies. Motivated by the lack of available methods for analysis of repeatedly measured phenotypic or transcriptomic data, herein we develop a longitudinal linear combination test (LLCT).


LLCT is a two-step method to analyze multiple longitudinal phenotypes when there is high dimensionality in response and/or explanatory variables. Alternating between calculating within-subjects and between-subjects variations in two steps, LLCT examines if the maximum possible correlation between a linear combination of the time trends and a linear combination of the predictors given by the gene expressions is statistically significant. A generalization of this method can handle family-based study designs when the subjects are not independent. This method is also applicable to time-course microarray, with the ability to identify gene sets that exhibit significantly different expression patterns over time. Based on the results from a simulation study, LLCT outperformed its alternative: pathway analysis via regression. LLCT was shown to be very powerful in the analysis of large gene sets even when the sample size is small.


This self-contained pathway analysis method is applicable to a wide range of longitudinal genomics, proteomics, metabolomics (OMICS) data, allows adjusting for potentially time-dependent covariates and works well with unbalanced and incomplete data. An important potential application of this method could be time-course linkage of OMICS, an attractive possibility for future genetic researchers.

Availability: R package of LLCT is available at:


Longitudinal designs are fast becoming a key instrument in genetics studies, as they advance our understanding of disease progression and underlying biological mechanism. Longitudinal studies can provide information regarding age of onset along with time-varying covariates that may aid in our understanding of a complex disease. A primary concern of these study designs is to find a proper analysis method which deals best with the correlation structure imposed by longitudinal data. Within-subject correlation in the context of high dimensional data cannot be addressed by traditional statistical analysis methods.

In the past two decades, there has been an increasing interest in microarray studies which has triggered rapid advances in microarray data analysis methods. From 2001, a considerable amount of literature has been published on methods of Individual Gene Analysis (IGA) [1] and Gene Set Analysis (GSA) [2,3,4,5]. Majority of these studies have proposed enrichment methods for binary and categorical phenotypes. Little attention has been paid to developing the methods for other phenotypes, especially longitudinal ones. The current paper contributes to filling this gap by proposing a longitudinal linear combination test (LLCT).

A frequent practice to deal with longitudinal phenotypes in genetics studies is to simply average across the multiple measurements. With this approach, the temporal variation of the phenotype is discarded and part of the information is lost [6]. To the best of our knowledge, the only GSA method developed to analyze longitudinal phenotype is the Pathway Analysis via Regression (PAVR) method proposed by Adewale et al. [7]. This method utilizes regression modelling to analyze binary, multi-class, continuous, count, rate, survival and longitudinal data and adjusts the results for potential covariates. In this method, the measure of association of a specific gene set with the phenotype is a sum of squares of Wald statistics from regression models fitted on the phenotype against the individual genes in the pathway of interest. We will compare this method with LLCT and discuss its limitations, later in this manuscript.

Our goal is to develop a statistical method which not only tackles the limitations of available methods, but addresses challenges of complex designs in recent microarray studies. The main function of this method is to recognize differentially expressed gene sets associated with a phenotype trajectory over time. It is also applicable to family-based study designs when the subjects are not independent. A generalization of this method can handle time-course microarray studies and identify gene sets with significantly different expression patterns over time.

Longitudinal microarray studies may wish to consider the trajectories of both phenotypes and gene expressions. In time-course microarray studies, arrays are collected repeatedly over time, allowing one to examine the dynamic behavior of gene expressions. GSA methods for time-course gene expressions have received more attention than GSA methods for repeated measurements of phenotypes. These methods are exploratory in nature, clustering genes to co-expressed groups [8]. Unfortunately, this development is not sufficient to address biologists’ concerns about the association of gene expressions trajectories with one or more specific covariate(s). Many procedures have been proposed for time-course microarray experiments to test if specific genes exhibit different expression profiles significantly associated with covariates. ANOVA-based methods [9, 10] and regression-based approaches are very popular in this field. Linear Mixed Models (LMM) or Generalized Estimating Equations (GEE) are more mature statistical models accommodating the correlations between repeated measurements. However, they are not directly applicable, as the time-course expression data is often collected for a large number of genes, but only for few subjects. To deal with the high dimensionality problem, Turner et al. [11] modeled the genes separately and then rescaled the data using Variance Inflation Factor (VIF) estimates to accommodate the correlation between the genes within gene sets. LMMs were also used in the methods developed by Hejblum et al. [12], Zhang et al. [13], and Conesa et al. (maSigPro method) [8], but they only work with categorical predictor variables. Our proposed method, LLCT can handle both categorical and continuous predictors.

Family-based data is another type of complex design in microarray studies. Family-based study designs are advantageous compared to studies of unrelated subjects in terms of lower genomic or phenotypic heterogeneity. Also, we are more likely to detect any significant effect when we observe multiple copies of the significant effects in a family [14]. Over the past few decades, study designs incorporating information from related subjects have resulted in better scientific interpretations [15].

LLCT is a GSA method. Incorporating information about the group of genes which are linked via biological pathways, LLCT aims to discover gene sets associated with the phenotype trajectories. These biological pathways, or a-priori defined gene sets, are archived in online databases: The Cancer Genome Atlas (TCGA) [16], Gene Expression Omnibus (GEO) [17], Keyoto Encyclopedia of Genes and Genomes (KEGG) [18], BioCarta [18], Molecular Signature Database of the Broad Institute [19] . Although imposing additional complexity into the analysis, this feature of LLCT is biologically very appealing. In contrast to IGA, GSA works based on a biologically realistic assumption that the genes are not independent and a cell’s function can be accomplished by differential expression of a group of genes, even if all of them show only weak to moderate changes [20].

LLCT is a self-contained method. Methodological reviews on GSA emphasize the distinction between self-contained and competitive GSA. A competitive method employs gene permutation to test whether the association between a gene set and the outcome is equal to those of the other gene sets (so-called “Q1 hypothesis” [21]). A self-contained method employs subject permutation to test the equality of the two mean vectors of gene set expressions corresponding to the two groups (so-called “Q2 hypothesis” [21]). Since competitive methods have been widely criticized for their inability to take care of the correlation within gene sets, we focus here on developing a self-contained method testing the Q2 hypothesis.


Simulation study

We present here results of our simulation study on LLCT performance. Figure 1 shows the power of LLCT analyzing diverse sets of data, simulated by considering different within-gene-set and within-subject correlations, sample and gene set sizes, and the number of repeated measurements. For each plot, the type I error was constant at 0.05 and the simulated data were similar for all characteristics except the one mentioned at the top of the plot. The power was calculated at the presence of different Β3 values, determining the effect of each gene within specific gene set over time. The power of LLCT increased by higher within-gene-set correlation, sample size and gene set size (Fig. 1a-c). However, it remains unaffected by within-subject correlation and number of repeated measurements (Fig. 1d-e).The power of LLCT and PAVR were compared in Fig. 2, where we let within-gene-set correlation, sample size, gene set size, and number of repeated measurements change. PAVR does not distinguish between the gene effect and the gene effect over time. Therefore, two parameters of Β1 and Β3 were set at different values (other than zero for both) to define alternative hypotheses for this method. However, the power of LLCT was consistent over different values of Β1 and altered by Β3 only. For small within-gene-set correlation values (ρ < 0.5), LLCT significantly outperformed PAVR. However, as the within-gene-set correlation increased, the power values of PAVR and LLCT became closer (Fig. 2a, b, c). Comparing with LLCT, PAVR performed poorly when the sample was small (Fig. 2d, e). Furthermore, different gene set sizes did not make a considerable difference between the methods’ powers (Fig. 2f, g). LLCT exhibited a better ability in dealing with large number of repeated measurements over time (Fig. 2h, i).

Fig. 1

Calculation of the power of LLCT using simulated data generated with different within-geneest correlation (a), sample size (b), geneset size (c), number of repeated measurements (d) and within-subject correlation (e). Type I error is set at 5%. For each plot, the simulation variables except the one mentioned on the title varies but remains comparable among the curves

Fig. 2

Comparison of the powers of LLCT method and the method of pathway analysis via regression (PAVR) proposed by Adewale et a1. using simulated data generated with different within-geneset correlation (a, b and c); different sample size (d and e); different geneset size (f and g and h) and different number of repeated measurements (h and i). Β1 denotes the gene effect and Β3 denotes the gene effect over time referring to eq. 7

Application 1: blood pressure

Hypertension affects more than a quarter of the world’s adult population [22] annually and adds a significant burden on healthcare systems. Long-term hypertension damages heart, kidney, brain, large blood vessels and retinal vessels [23] and explains about half of stroke and ischaemic heart diseases worldwide. Despite this high health risk, hypertension is unknown for more than 30% of patients, untreated for 50% of them, and uncontrolled for 75% [24].

Blood pressure is known as a highly-heritable complex trait [25] regulated by multiple environmental and genetic factors. The importance of understanding the genetics mechanism of blood pressure on identification of therapeutic and prevention targets has been emphasized in studies examining the variation of effectiveness of antihypertensive medications on different ancestral groups [26].

Hypertension is developed by small contributions of a large number of genes, whose effects may be hard to detect. Facing this challenge, most studies on hypertension genetics failed to reach replication. Traditional statistical approaches suffer from inferential limitations in genetic studies, largely due to small sample sizes. Novel methodologies are being developed to address this issue.

Genetic Analysis Workshops (GAWs) are designed to evaluate the performance of different statistical methods applied on high density genotype. Among them, GAW13 [27], GAW16 [28], GAW18 [29] and GAW19 [30] have focused on analysis of longitudinal datasets. GAW19 [30], the focus of our work, is based on data from San Antonio Family Heart Study (SAFHS), conducted to investigate the genetics of cardiovascular disease in Mexican-Americans. GAW19 researchers were divided into different teams to work on heterogeneous statistical methods dealing with longitudinal datasets. For analysis of gene expressions, these teams independently worked on different areas of individual or pathway gene analysis, unrelated or family-based analysis and joint or separated analysis of phenotypes. However, utilizing heterogeneous statistical methods prevented them from replicating their findings.

The subjects of SAFHS were born in a large, multi-generational family and their stated pedigree relationships were verified. The transcriptional profile data of 647 people was recorded, including 16,383 gene expression measurements, for each individual. For each subject, systolic blood pressure (SBP), diastolic blood pressure (DBP), hypertension status (HTN), use of antihypertensive medications, and smoking status were measured at four time points and the subjects’ sex and age were recorded. By applying the proposed method to this family-based data, we detected differentially expressed gene sets significantly associated with blood pressure trajectories over time. We analyzed this real data set and considered DBP, SBP, pulse pressure (PP) (defined as PP = SBP − DBP), and hypertension (defined as blood pressure ≥ 140/90 mmHg) as the outcome variables.

We first analyzed the unrelated subjects by selecting subjects with no shared parents. In this part of analysis, the repeatedly measured expressions of 10,072 genes for 64 subjects, belonging to 5898 gene sets were examined by LLCT for unrelated subjects. The gene sets are defined by Gene Ontology database. The size of gene sets varied from 2 to 1417 with median of 22.

In the second part of analysis, 647 related subjects in 17 family clusters were analyzed. The size of families varied from 21 to 62 with the median of 31. The total number of 10,072 genes contributing in 5907 pathways was tested by LLCT for related subjects. Table 1 shows the characteristics of the related and unrelated subjects.

Table 1 Summary information (mean (standard deviation)) of covariates and outcomes at different time points: GAW19 application, studies of related and unrelated subjects

The test of association was conducted after adjustment for either smoking status or antihypertensive medications intake. As some subjects were measured for two times only, the method was unable to adjust for both time-dependent covariates at the same time, unless we restricted our subjects to those with more than 2 measurements.

LLCT was used to find the gene sets whose expressions are significantly associated with the outcome(s) and calculated 5989 p-values for testing the gene sets in unrelated study and 5907 p-values for analysis of family-based dataset. Table 2 shows the number of significant gene sets in testing each outcome and each dataset separately. The pathways that were significantly associated with both pulse pressure and linear combination of SBP and DBP, after adjusting for antihypertensive medication consumption, were selected and shown in Additional file 2 and Additional file 3. Exposure to blood pressure medication, compared to smoking, showed more considerable effect in changing SBP and DBP trajectories and the best model is the one adjusting for this effect.

Table 2 The number of significant gene sets found by LLCT at different levels of confidence, testing a variety of outcomes and datasets

In Additional file 2 and Additional file 3, the gene sets were classified based on their shared ancestral categories, derived from Gene Ontology Tree. A few descendent pathways of immune system process, cellular response to stimulus, cell communication, cellular metabolic process, multi-organism cellular process, multi-cellular organism process and metabolic process has been found to be significant in the analyses of related and unrelated subjects. Cell differentiation, cell activation, cell cycle, cellular component organization or biogenesis, biological regulation, system development, localization, metabolic process and response to stimulus are other parental classes of biological processes with significant descending pathways in the analysis of the related dataset only. In addition to these biological processes, few significant pathways in major classes of molecular function and cell components were found significant. The family-based analysis is expected to result in more accurate findings, as it works on the larger database.

Blood pressure is a complex phenotype that is controlled by multiple biological processes, multiple molecular functions and multiple cell components. Comparing the results of the analysis of multiple phenotypes, pulse pressure displayed higher level of robustness and was less affected by covariates. Also, HTN failed to reflect the changes of SBP and DBP and mostly failed to agree with the analysis results of other phenotypes. From a statistical perspective, the result of HTN analysis is limited because the information is lost by dichotomizing the continuous variables. Also, many biological studies doubted the reliability of this one-size-fits-all stratification scheme [31]. The other noteworthy finding of this study was the difference between SBP and DBP trajectories in their association with gene expressions. There were larger number of pathways associated with SBP compared to DBP. This underlines the sensitivity of SBP, as a blood pressure measurement, to gene expression alterations.

By discussing the list of significant pathways in Additional file 2 and Additional file 3, insights can be gained into the genetics of hypertension. However, we admit that an in-depth biological interpretation of the findings is beyond the scope of this manuscript. Below, we will discuss some processes underlying hypertension, whose presence was supported by more than one significant pathway in LLCT analysis. We also provided the prioritization score, indicating the proportion of gene sets with smaller p-values [32], for each significant pathway. These scores were calculated using the p-value ranks based on LLCT analysis of bivariate SBP and DBP after adjustment for medications.

Regulation of smooth muscle contraction by signal transduction

Recent developments in blood pressure studies have highlighted the importance of the regulation of vascular smooth muscle contraction and vascular tone on the regulation of blood pressure. Young blood vessels are contractible and plastic, but as people age they become synthetic and less contractible in response to proinflammatory stimuli, diet, or other factors [33,34,35].

The significant pathways of negative and positive regulation of ERK1 and ERK2 cascade (PS = 0.3 and 4.3%), negative and positive regulation of dephosphorylation (PS = 5.3 and 5.6%), protein dephosphorylation (PS = 1.2%), actin binding (PS = 5.6%), response to camp (PS = 1.2%) may reveal some biological processes behind the regulation of vascular smooth cell and its subsequent effect on blood pressure regulation. Previous studies have detected significant roles of these pathways and other related pathways in regulation of vascular smooth muscle contraction [36, 37]. Brozovich et al. [38] provided a thorough description of these roles.

Regulation of smooth muscle contraction by epigenetic mechanism

Epigenetic mechanism refers to heritable changes of gene expression which are not related to the genome sequence [39]. These mechanisms may contribute in changing plasticity of vascular smooth muscle by either altering the accessibility of transcription factors at DNA regulatory regions or changing the genetic translations [40]. Our study identified histone methylation (PS = 4.1%) as a significant pathway to alter accessibility of transcription factors by changing chromatin packaging of the cells. Also, significant pathways of messenger RNA transcription (PS = 0.8%), basal transcription machinery binding (PS = 3.0%), transcription cofactor binding (PS = 1.7%) and damaged DNA binding (PS = 3.6%) may reveal more epigenetic mechanisms causing differential transcription of smooth muscle cell.

Cell-cell Signalling: WNT signaling

Non-canonical and canonical WNT pathways (PS = 5.4 and 5.5%) were found to be associated with trajectories of pulse pressure and multiple outcome of SBP and DBP. Massive literature has supported the association between WNT pathway and hypertension [41,42,43]. The study of these pathways has been motivated by heterogeneity of hypertensive patient population in response to antihypertensive medications. Patients with type 2 diabetes mellitus responded poorly to the treatment compared to others.

Many Genome Wide Association Studies (GWAS) suggest the association between hypertension and WNT3 that encodes a canonical WNT ligand and SOX proteins which interact with b-catenin and modulate the transcription of WNT-target genes [44,45,46,47]. In experiments, mice infused with angiotensin II have been diagnosed with activated b-catenin and proliferated vascular smooth muscle contraction. The other line of evidence supporting this relationship is the association of neurolocal regulation of blood pressure with interaction of insulin and WNT signaling [42].

DNA damage and genomic instability

The associations between age, development of cardiovascular diseases, and hypertension can be explained by pathways related to DNA damage and repair. This result is in agreement with our earlier observation that biological processes of intrinsic apoptotic signaling pathway in response to DNA damage (PS = 3.2%), nucleotide excision repair (PS = 4.2%), positive regulation of DNA repair (PS = 2.2%), and regulation of response to reactive oxygen species (ROS) (PS = 4.1%)are significantly associated with blood pressure trajectory over time. Below, there is a description of how these pathways collaborate to develop hypertension.

DNA is damaged by exposure to exogenous and endogenous agents, such as smoking and diabetes mellitus. Aging leads to prolonged exposure, accumulation of DNA damages, and elevated production of ROS at the molecular level. In order to preserve genomic stability under ROS-induced stress, multiple pathways to repair or respond to the presence of DNA damage are employed by the cell and their functions may overlap, compromise or exceed the capability to repair DNA. A defective DNA repair system leads to genomic instability and can accelerate development of vascular problems, such as increased blood pressure, increased vascular stiffness, and decreased vascular relaxation [48]. Also, multiple lines of evidence have suggested the direct or indirect effect of increased ROS on hypertension incidence, affecting blood vessels (contraction, relaxation and growth), heart, kidney [49] and nervous system functions [50]. This path of investigation can promote antioxidant therapies and production of drugs enhancing genomic integrity.

Nervous system development: pituitary development and ventral spinal cord development

Blood pressure changes can be related to nervous system development. In our study, we found pituitary development (PS = 0.4%) as a significant pathway affecting the pulse pressure and SBP&DBP trajectories. Endocrine hypertension, a special type of hypertension, is caused by the pituitary or adrenal gland producing too much or not enough of the hormones [51, 52]. Secretion of Antidiuretic hormone (vasopressin) by pituitary gland plays an important role in water retention in kidneys and controlling blood pressure. Furthermore, the imbalanced influence of the posterior and interior parts of pituitary gland is known to increase blood pressure [53].

The other significant nervous-system-related pathway in this study is spinal cord development (PS = 4.4%). Higher prevalence of hypertension among patients with spinal cord injury as a result of the interruption in the autonomic nervous pathways supports our finding. Reduction in autonomic cardiovascular control of hypertension explains this result [54].

Heart and blood vessel development

Our results are consistent with the significant influence of cardiac chamber development, coronary vasculature development (PS = 5.1%), embryonic heart tube development (PS = 4.3%), embryonic heart tube morphogenesis (PS = 2.8%), and blood vessel morphogenesis pathways (PS = 1.5%) on blood pressure trajectories.

The extra load on the thin wall chamber or tube caused by increased blood pressure is normalized by an increase in wall thickness and/or by a reduction in chamber/lumen diameter. More specifically, the left ventricle adopts its structure in response to imposed stress through remodelling or hypertrophy [55]. At the cellular level, cardiac gene expressions are altered in response to stress stimulus [56].

Overall, this study illustrated the application of LLCT on gene expression data measured on related and unrelated subjects. This was the first attempt to analyze gene sets when the blood pressure is repeatedly measured, and the data set is clustered by families. Analysis at the gene set level improves interpretability of findings. Incorporating repeated measurements of outcome over time enables us to investigate the temporal progression of phenotype over time. These studies provide the opportunity to investigate genomics under an important assumption: the effects of the genes contributing to the underlying phenotype are persistent over time. Also, the potential genetic and environmental covariates are better controlled via longitudinal study design. The family-based structure of data decreases heterogeneity leading to more precise investigations. The previous works in GAW19 never had these three features together. Although this study is unique in its kind, our findings have been shown to be mostly consistent with those of experimental or GWAS studies. However, we recognize that our study may not present the best set of pathways involved in blood pressure development because of the following limitations. The first limitation, albeit common among genomic studies, is that a single significant gene may lead to the significance of the whole pathway. Second, although we adjusted for anti-hypertensive intake and smoking status, there are many other uncontrolled covariates, such as diet, stress, and physical activity [57]. Lack of availability of informative covariates, such as behavioral recommendations that accompany medical prescriptions, has also been mentioned as a general limitation of GAW19 studies in the summary provided by Chiu et al. [58].

Application 2: wound healing

A mouth wound may heal up to 3 times faster than a skin wound [59]. Researchers are interested to learn from the differential gene activations during skin and mouth wound healing to discover the genetic reasons underlying the speedy oral repairs. Understanding the genetic mechanisms involved in wound healing is critical for promoting a fast recovery through which many infections are prevented, many lives are saved, and many costs are decreased [60].

Several previous studies examined human and mice samples to find the genes or gene pathways which are differentially expressed in a mucosal cell compared to a skin cell after wounding. They mostly agreed that the transcriptome regulatory system leading the fast recovery of mucosal wounds are activated at unwounded state [59]. Consequently, as a mucosal cell needs to undergo a simpler molecular recovery process compared to a skin cell, a shorter healing time is expected.

Although previous findings contributed in better understanding of the speedy healing of mucosal tissue, we believe that there is still much more to investigate. Aside from the genes which are differentially expressed at the unwounded state, the genes with the similar expression levels before injury may exhibit differential expression pattern over time. In this application, we took advantage of LLCT to examine if the fast repair after oral injury is caused by the differential trajectories of gene expression, rather than their differential levels. We believe this analysis revealed more aspects of the undergoing transcriptome regulatory system.

This application study used the mice gene expression data collected from tongue and skin wounds of six- to eight-week-old female Balb/c mice at 6 h, 12 h, 1 day, 3 days, 5 days, 7 days and 10 days after the injury. Chen et al. [61] designed this experiment to explore the differences in gene expression in skin and tongue wound healing at different states of unwounded (referred as time 0), hemostasis (6 to 12 h), inflammation (24 h to 3 days), proliferation (5 days to 7 days) and remodeling (10 days). In this case study, we focused exploring the time 0 to 7 days as the remodeling state may take up to several months and an exact length time determination may not be possible [62]. At each time point, the total RNA from 3 skin samples and 3 tongue samples was hybridized to Affymetrix GeneChip Mouse Genome 430 v 2.0 chip. The closure time for tongue and skin wounds were 3 and 5 days, respectively. An interested reader may refer to Chen et al. [61] for more information regarding the experimental procedure.

We applied LLCT to analyze the association between the time trajectories of gene expression and the wound position in 247 KEGG pathways. The LLCT examined the changing patterns of gene expressions at different stages of hemostatic, inflammation and proliferation separately and in combination. LCT also was utilized to detect the pathways with non-differential gene-set expression level between tongue and skin wounds before the injury.

Among 247 KEGG pathways selected, there were 95 pathways with differential expression pattern at hemostasis stage, 125 pathways with differential expression pattern at inflammation stage and 150 pathways with differential expression pattern at proliferation stage (Additional file 4). Table 3 lists the 38 gene pathways that are differentially expressed in all three stages of hemostatis, inflammation and proliferation for different organs of tongue and skin. The Additional file 4 provides the analysis results for all pathways. The eight pathways with the similar expression level at unwounded state can be identified using the last column of Table 3 and are plotted in Fig. 3.

Table 3 The list of KEGG pathways significantly expressed over three healing states of hemostasis, inflammation and proliferation for different wounds of skin and tongue, and their corresponding p-values calculated by LLCT method
Fig. 3

Time-course expression patterns of gene pathways. These gene sets were expressed non-differentially at unwounded state (time 0) but they are expressed differentially over all three stages of hemostasis (before 12 h after wounding), inflammatory (12–72 h after wounding) and proliferation (3–7 days after wounding)

Chen et al. [61] found KEGG pathways of Toll-like receptor signaling pathway and Jak-STAT signaling pathway to be early upregulated in skin wounds while the KEGG pathway of Cytokine-cytokine receptor interaction was observed to be upregulated in both organs with larger number of genes activating in skin cell. Consistently, we observed these three pathways underwent significantly distinct expression patterns in all three stages in association with the wound organ with a sharper increasing trend within the first 24 h after the skin injury. In agreement with Chen et al. [61], who reported a more refined gene responses after oral wounding, most of the pathways whose expression trajectories varied significantly by the related organ have shown relatively lower variation among oral samples.

There is extensive literature supporting the differential expression patterns of the 38 pathways we listed in Table 3, however this is beyond the scope and the length of this manuscript. Therefore, we are mainly discussing the pathways which were not differentially expressed at the initial state, but they underwent distinctive expression patterns after injury.

The prioritization scores indicated in the last column of Table 3 helps the reader evaluate the strength of LLCT in prioritizing biologically most relevant gene pathways.

Inflammations and immune systems

It is commonly reported that pathways related to inflammatory mediators, such as cytokine-cytokine receptor interaction and chemokine signaling pathways, and the immune system pathways were significantly over-expressed for skin cells [59]. The lower activation of immune processes during mucosal wound recovery prevents the chronic inflammation and decreases fibrosis and scarring [59, 63]. Our analysis showed that the skin and mucosal cells took differential expression patterns of inflammatory and immune factors in different states with a higher peak expression at 12 or 24 h after injury for skin wound and a subsequent steeper decline by Day 7. Although all the immune system pathways were upregulated before wounding, the basal pathway of Fc ε RI signaling expressed at the same level for different wound organs (Fig. 3a). According to a study conducted on skin-drived mast cells, the mast cells responses to Fc ε RI - mediated simulation through secretion of mediators like cytokines [64]. We consistently observed pattern similarities between cytokine-cytokine receptor interaction and Fc ε RI signaling pathway over time in different samples of skin and tongue. Therefore, the low level of cytokine expression in tongue wound could be regulated by the low expression of Fc ε RI signaling pathway.

Cellular death processes

Programmed cell death is required to maintain tissue hemostasis. Apoptosis and autophagy are known as a “programmed cell death”, which when inhibited, a new type of cell death, necroptosis, occurs [65]. In our study, the apoptosis, necroptosis and autophagy were differentially regulated over different types of skin and tongue samples. The higher upregulation of apoptosis in skin samples during the time course of wound healing compared to mucosal samples were also reported by Johnson et al. [66]. This study discussed that while apoptosis occurs predominantly through the intrinsic pathway in the healing mucosa, it occurs predominantly through the extrinsic pathway in skin samples [66]. In contrast to apoptosis pathway, the necroptosis and autophagy expressions at basal were statistically identical for both wound organs (Fig. 3b-c). As necroptosis expression is regulated by secretion of cytokines/chemokines, its post-injury fluctuations resemble that of cytokines/chemokines [67]. However, Autophagy regulates and is regulated by the inflammatory cytokine and chemokines, and therefore, its expression values did not reflect well the trajectories of cytokine and chemokine expressions [68].

Signal transduction

Having the same level of oral MAPK expression at unwounded state, skin cells responded immediately to the injury through overexpression of MAPK signaling pathway in the first day followed by a consistent decline afterwards. In contrast, the expression of this pathway in tongue cells remained approximately unchanged after wounding and started increasing in proliferation state (Fig. 3d). The level of MAPK signaling pathway expression for skin wound stayed lower than that of tongue wound in proliferation state. This pattern also resembles the observed pattern of RAS in this study (Fig. 3e). The RAS and MAPK pathways play a critical role in regulation of cell proliferation through a series of protein kinase cascades and their upregulation at proliferation phase in tongue wounds can help the wound rebuild [69].

Several evidences suggested the induction of tenascin-C, a fibroblast marker whose expression is necessary for accelerated wound healing [70], by several growth factors [71]. This association is regulated by neuroactive ligand-receptor interaction [72]. Therefore, the increasing expression pattern of neuroactive ligand-receptor interaction in the tongue cells, in contrast to the plateau and slightly decreasing pattern of that in the skin cells, could explain the rapid oral healing (Fig. 3f).


Glycosaminoglycan is a major component of connective tissue and play an important regulatory role in extracellular matrix production [73]. Our observation of distinct expression patterns of glycosaminoglycan in dermal and mucosal wounds over different wound healing stages accords the previous finding that suggested their distinctive features and quantities of glycosaminoglycan [73]. While expressed at the same level at unwounded state, the pathway of glycosaminoglycan degradation was overexpressed in the late hemostasis state and early inflammatory stage in tongue wound which helps coagulation, inhibits enzymes and cytotoxic mediators released from proinflammatory cells, and improves recruitment of inflammatory cells (Fig. 3g). The pathway of glycosaminoglycan degradation was greatly overregulated in late inflammatory state and over proliferation state of healing the skin wound. The excess expression of Heparin, a highly sulfated glycosaminoglycan, inhibits the activity of the FGF-7, which regulates keratinocytes migration and proliferation and therefore impedes the tissue development process [74].

Nervous system

Distinct response of Cholinergic Synapse pathway was observed in different wound organs. While Cholinergic Synapse pathway of skin wound reaches its highest expression level at day 1, the expression of this pathway in tongue tissue peaks at day 5 (Fig. 3h). In agreement, Anderson et al. [75] observed Acetylcholinesterase, an enzyme located at neuromuscular and central cholinergic synapse, to be highly expressed at day 1. They found the important role of Acetylcholinesterase in cell migration and fibroblast wound healing. Therefore, the increasing trend of theexpression of Cholinergic Synapse pathway in tongue sample by day 5 accounts for the speedy mucosal repair.

Our results suggested that tissue repair is a complex process involving multiple gene pathways. Our pattern analysis also suggested that the mucosal wounds required a less demanding procedure to repair, characterized by many invariant time-course expressions patterns, in comparison with the dermal wounds. We identified the important role of Fc ε RI signaling pathway in regulating the inflammatory mediators and the critical roles of neuroactive ligand-receptor interaction, cholinergic synapse and MAPK and RAS pathways in promoting the different healing phases. We also recognized the destructive effect of excess expression of glycosaminoglycan degradation in proliferation phase. All these findings improve our understanding of the molecular pathways and may contribute in devising new strategies for successful wounds treatment. We believe that a study of the time-course correlations between different gene pathways would also help advancing the grasp of the underlying transcriptome system.


The interest in temporal patterns of change in the patients’ conditions is becoming increasingly popular, as it aids in the explanation of complex biological systems. Longitudinal studies provide the possibility to study individual development of an outcome over time, and in doing so advance our understanding of disease progression or phenotype trajectory. Through longitudinal studies, the development of other variables can also be examined as determinants of the outcome trajectories. Therefore, incorporating longitudinal designs in genetic studies enable examination of genetic variants that affect phenotypes over time [58, 76]. Moreover, longitudinal studies are more reliable as the subjects are closely followed up with and the onset of the events is precisely observed [58]. Obviously, there is higher certainty behind the existence of an effect that is detected to be continuously significant over time in the presence of many uncontrolled or unmeasured time-dependent covariates than an effect that is observed only once. In other words, multiple measurements and significant trajectory over time provide more reliable evidence than what a single time point measurement and a cross-sectional effect can provide. Adding family structure to the study design can improve this reliability by detecting a significant genetic effect in a family rather than simply an individual.

The main purpose of the current study was to develop a statistical method for high-dimensional data able to analyze repeatedly-measured outcomes and covariates. This method offers many interesting flexibilities to the analysis. It allows adjusting for potentially time-dependent covariates. Since genetics and environment always interact to shape the phenotype, the result of genetics studies alone may be biased when environmental factors are not taken into account. A very common drawback of many available GSA methods is the lack of ability to accommodate between-gene correlation, which our proposed LLCT addresses. In addition, LLCT is a self-contained method proven to be powerful and computationally efficient compared to existing methods. Being a self-contained method, LLCT is also expected to result in high reproducibility, high power and high robustness to the sample heterogeneity, as applied on RNA-seq data [77]. This method can be applied to different classes of phenotypes, such as continuous, binary or categorical phenotype if an appropriate model is defined in the first stage. Furthermore, it is applicable to both unbalanced and incomplete data, which is important in longitudinal studies as some subjects are often lost to follow up. The evidence from the simulation study suggests higher power of LLCT in comparison to existing method, PAVR [7]. Aside from higher power of LLCT, there are two critical features that discriminate these two methods. First, LLCT is computationally far more efficient. Compared to LLCT, the run time is about 70 times longer for PAVR. For the same reason, we could not design a large simulation for evaluation of PAVR. Second, PAVR is unable to test the interaction of time and covariate over time and it only tests the covariate effect. The interaction of time and covariate indicates if the covariate’s effect varies over time; which is known to be the most critical parameter of longitudinal analysis. Without considering this parameter, the longitudinal study resembles a cross-sectional study that takes advantage of multiple measurements for gaining higher accuracy of measurements. Our simulation study also showed that the power, and therefore the required sample size, is dependent on the gene set size and the within-gene-set correlation and it is independent on the number of repeated measurements and within-subjects correlation. Moreover, Significance of a set exhibiting lower between-genes correlations can be achieved with a smaller sample size..

Despite the strengths mentioned above, there are a few limitations for this method that need to be considered. Our method for dealing with longitudinal phenotype is unable to adjust for time-independent covariates. Including time-independent covariates in the second step of the method may result in misleading findings. As a self-contained method, LLCT would identify a set as significant even if a small number of genes, or even if one single gene is associated with the phenotype. One way to address this limitation is to consider reducing the significant sets to their core members. In time-course microarray data analysis, this method can identify the gene sets which are differentially expressed over time in association with a set of covariates. However, our method is unable to distinguish the individual covariates responsible for this difference, unless we include one covariate at a time. Resembling the mixed effect models, LLCT assumes the expressions of the genes within a geneset can be characterized by the same type of model. If the study includes the genes with differential patterns of expression which could not be characterized by a single type of model, spline models should be used. The researcher may also consider analysis of the expression trajectory in the time subperiods.

LLCT was applied to GAW19 data. As noted earlier, GAW19 has been analyzed before. However, significant differences across various methods used prevented a meaningful comparison of the results. There are four pedigree-based GAW19 studies exploring the association between phenotype and gene expressions via different methods: linear mixed models, nonparametric weighted U statistics, structural equation modeling, Bayesian unified frameworks, and multiple regression. However, their results cannot be compared with ours because of the following differences in the analytical approaches: (1) They incorporated the information of rare variants into their analysis while this study examined the transcriptome variations only; (2) In contrast to our GSA approach, they did not include the priori information of gene pathways; (3) They did not take the longitudinal pattern of the phenotype into the account. There are seven GAW19 pathway-based analysis, three of which explored gene expression data [78]. There are three GAW19 studies with longitudinal analytical approaches, all of them examining genetic variants [58]. The longitudinal studies used GEE, latent class growth modeling (LCGM), LMM, and variance components (VC) in their analysis. Among all these studies, the study of Ziyatdinov et al., which is a gene ontology pathway and family-based enrichment analysis of gene-expression data using the mixed effect models, came closest to the current study, but it is unpublished at the time of submission of this work. GAW19 studies acknowledged higher power of longitudinal methods in detecting genetic effects, decreased trait heterogeneity and smaller standard error of effect estimates [58]. Also, they identified unique genetic-related trajectories of disease progression missed by the previous studies.

We demonstrated the applicability of LLCT on analysis of time-course microarray data in the second application. Contrary to the first application, LLCT dealt with a binary phenotype collected from mice samples in this application. The data was previously analyzed using ANOVA for comparing the expression level at each post-wounding time with that of unwounded state. In order to gain some understanding of the underlying expression dynamics, the temporal trajectories of the genes which were differentially expressed were K-means clustered [61]. The inherent assumptions of this clustering method limit the ability to describe the differential dynamic behaviour of the genes and, also, do not provide a test of time-course diversities.

Although we found many phenotype-relevant gene sets in our application, that are supported by previous studies, a future study comparing the sensitivity and specificity of the LLCT applied to a large number of longitudinal studies is needed.


The proposed LLCT method can be used for analysis of complex genetic studies and may result in better reproducibility across studies. LLCT can be applied to a wide range of longitudinal genomics, transcriptomics, proteomics, metabolomics and microbiota data. A very important application of LLCT is to link omics over time - an approach that has been emphasized by recent studies for gaining better understanding of complex biological process. Linkage of omics over time requires a method that can handle large scale outcomes and predictors datasets, simultaneously, which cannot be accommodated by most methods. Our method has strong potential to contribute to the progression of genetic science.


Longitudinal linear combination test (LLCT)

We propose a two-step method to analyze multiple longitudinal phenotypes when there is high dimensionality in either the response or explanatory variables. In the first step, within-subject variation is analyzed. The changing trend of outcomes over time is estimated using an appropriate model for the structure and type of the data. In the second step, LCT [79] is applied to analyze the between-subject variation. In this step, LCT is employed to examine if the maximum possible correlation between a linear combination of the time trends and a linear combination of the predictors given by the gene expressions is statistically significant. We generalized our method to accommodate data generated by two complex study designs: time-course microarray studies and family-based studies. A time-course study measures gene expression repeatedly over time and is designed to find the correlation between time trajectory of gene-expressions and covariates. A family-based design collects the information from family members and examines the association between longitudinal phenotypes and gene expressions, while taking care of the correlation between subjects within each family.

We borrowed the main idea of this method from mixed effect modelling wherein the variation in the longitudinal phenotype is modelled taking two steps: first step, the within-subject variation is modelled; in the second step, the between-subject variation is modeled using the coefficients estimated in the first step [80]. Roughly the same strategy is also practiced by Conesa et al. [8] in their microarray significant profiles (maSigPro) method.

The proposed method is designed to model continuous outcome variables. However, this method can be generalized to work with other type of data, such as binary or categorical response variable, using an appropriate link function in the first step. This method is self-contained, designed to accommodate the correlations between genes in the gene sets, works well in the presence of missing data at random and is efficient to work with high dimensional data. It can also adjust for time-variant covariates. Next, we describe the two steps of the method, followed by two generalizations.

Analysis of Within-Subject Variation (Step 1)

Consider a microarray study on I subjects where longitudinal phenotypes of size M is measured for ni times for the i th subject, i = 1, …, I. Let Ymij be the j th measurement (j = 1, …, ni) of the m th phenotype (m = 1, …, M) of the i th subject that happened at time tij and let \( {Y}_{mi}={\left({Y}_{mi1},\dots, {Y}_{mi{n}_i}\right)}^T \) be the vector of ni measurements of the m th phenotype for the i th subject (\( \sum \limits_{i=1}^I{n}_i={n}_{.}\Big) \) and Yi = (Y1i, …, YMi) be the matrix of phenotype measurements of the i th subject. We also consider that the study measured the expressions of a predefined set of P genes for the i th subject, Gi = (Gi1, …, GiP)T, i = 1, …, I; and we define the vector of the expressions of gene p for I subjects as Gp = (G1p, …, GIp)T, p = 1, …, P. We are interested to test if there is a significant linear relationship between the gene set G and the longitudinal phenotype Y. The null hypothesis is that the changes in Y over time are not dependent on the expressions of the genes in the predefined gene set G.

In order to analyze within-subject correlation, we define the regression equation in matrix notation as below:

$$ {Y}_{mi}={Z}_i{\beta}_{mi}+{W}_i{\gamma}_{mi}+{\varepsilon}_{mi} $$

In this equation, Zi is (ni × Q) matrix of Q potential time variables and it usually includes \( {t}_i=\left({t}_{i1},\dots .,{t}_{i{n}_i}\right) \) and different polynomial functions of ti (e.g. \( {t}_i^2,{t}_i^3 \)) if required. Wi is (ni × Q ′ ) matrix of Q′ potential time-variant covariates, and γmi(Q ′  × 1) represents their corresponding coefficients. Also, βmi denotes a (Q × 1) vector of coefficients for each specific phenotype (m) with elements of βmqi. We define βi a (Q × M) matrix of regression coefficients generated by column-wise binding of βmi s: βi = [β1i|β2i|…| βMi].

Analysis of Between-Subject Variation (Step 2)

In our method, we used Linear Combination Test (LCT) [79] to detect significant gene sets associated with different trajectories of longitudinal phenotypes. We reason that a lack of gene set related variability in the subject-specific regression coefficient estimated in the first step, leads to no relationship between the gene set expressions and the changing trend of M longitudinal phenotypes. In other words, there is no linear combination of the columns of \( \beta ={\left[{\beta}_1^T|\dots |{\beta}_I^T\right]}^T \) associated to any linear combination of gene set expression measurements. The null hypothesis is that there is no association between any of the linear combination of G1, …, GP with any linear combination of columns of β.

Let G be a ((I × Q) × (P)) matrix obtained by vertically merging the vectors of the gene expressions, Gp s, duplicating the rows for Q times. Then, let

$$ Z\left(G,\mathrm{A}\right)={\left[\begin{array}{c}\begin{array}{ccc}{G}_{11}& \dots & {G}_{1P}\\ {}\vdots & \ddots & \vdots \\ {}{G}_{11}& \dots & {G}_{1P}\end{array}\\ {}\begin{array}{ccc}{G}_{21}& \dots & {G}_{2P}\\ {}\vdots & \ddots & \vdots \\ {}{G}_{21}& \dots & {G}_{2P}\end{array}\\ {}\begin{array}{ccc}\vdots & \vdots & \vdots \\ {}{G}_{I1}& \dots & {G}_{IP}\\ {}{G}_{I1}& \dots & {G}_{IP}\end{array}\end{array}\right]}_{(I.Q)\times (P)}\times {\left[\begin{array}{c}\begin{array}{c}{\alpha}_1\\ {}{\alpha}_2\end{array}\\ {}\vdots \\ {}{\alpha}_P\end{array}\right]}_{(P)\times 1} $$

be a linear combination of the columns of matrix G, and,

$$ Z\left(\mathrm{B},\Gamma \right)={\beta}_{(I.Q)\times M}\times {\left[\begin{array}{c}\begin{array}{c}{\gamma}_1\\ {}{\gamma}_2\end{array}\\ {}\vdots \\ {}{\gamma}_M\end{array}\right]}_{(M)\times 1} $$

a linear combination of columns of β. The null hypothesis can be written as an optimization problem, more precisely, identifying A and B to maximize the correlation of Z(G, Α) and (Β, Γ), and then test if this maximum correlation is significant or not.

Let ΣG, G =  cov (G, G) be the covariance matrix of G; and similarly, let ΣΒ, Β =  cov (Β, Β) be the covariance matrix of Β and ΣG, Β =  cov (G, Β) be the covariance matrix between G and Β. This leads to the proposed test statistic:

$$ {T}^2={\mathit{\max}}_{A,B}{\left|\rho \left(Z\left(\mathrm{G},\mathrm{A}\right),Z\left(\mathrm{B},\Gamma \right)\right)\right|}^2={\mathit{\max}}_{A,B}\frac{{\left({\mathrm{A}}^T{\Sigma}_{\mathrm{B},\mathrm{G}}\Gamma \right)}^2}{{\mathrm{A}}^T{\Sigma}_{\mathrm{G},\mathrm{G}}\mathrm{A}.{\Gamma}^T{\Sigma}_{\mathrm{B},\mathrm{B}}\Gamma} $$

The problem of singularity of ΣΒ, Β and ΣG, G emerges when the dimensions of Β or G are large. This is very likely to happen as we usually measure the expressions of a large number of gene sets. A possible remedy for this problem is to utilize the shrinkage method [81]. Therefore, we need to replace the covariance matrices with their shrinkage versions, \( {\Sigma}_{\mathrm{B},\mathrm{B}}^{\ast } \) and \( {\Sigma}_{\mathrm{G},\mathrm{G}}^{\ast } \). T2, the shrinkage version of T2, is defined as below:

$$ {T}^{2\ast }={\mathit{\max}}_{A,B}\frac{{\left({\mathrm{A}}^T{\Sigma}_{\mathrm{B},\mathrm{G}}\Gamma \right)}^2}{{\mathrm{A}}^T\ {\Sigma}_{\mathrm{G},\mathrm{G}}^{\ast}\mathrm{A}.{\Gamma}^T{\Sigma}_{\mathrm{B},\mathrm{B}}^{\ast}\Gamma} $$

We use the permutation method to calculate the p-value corresponding to this statistic. When the permutation method is employed, it would be computationally inefficient to maximize the right-hand side of the equation above. The remedy could be using two groups of normalized orthogonal bases, instead of using the original observation vectors G and Β. We decomposed the two shrinkage covariance matrices using eigenvalues (\( {\Sigma}_{\mathrm{G},\mathrm{G}}^{\ast }=\Psi {D}_{\mathrm{G}}{\Psi}^T \) and \( {\Sigma}_{\mathrm{B},\mathrm{B}}^{\ast }=\Omega {D}_{\mathrm{B}}{\Omega}^T \)) to obtain two groups of orthogonal basis vectors \( \overset{\sim }{\mathrm{G}} \) and \( \overset{\sim }{\mathrm{B}} \). Thus, the test statistic becomes:

$$ {T}^{2\ast }=\underset{\eta, \theta }{\max}\frac{{\left({\eta}^T{\Sigma}_{\overset{\sim }{\mathrm{G}},\overset{\sim }{\mathrm{B}}}\theta \right)}^2}{{\left\Vert \eta \right\Vert}_2^2.{\left\Vert \theta \right\Vert}_2^2} $$

where \( \eta ={D}_{\mathrm{G}}^{1/2}{\Psi}^T\mathrm{A} \) and \( \theta ={D}_{\mathrm{B}}^{1/2}{\Omega}^T\Gamma \). Optimizing this expression will be straightforward if we first optimize η given θ and then optimizing θ at the next step. The value of T2 is equal to the largest eigenvalue of \( {\Sigma}_{\overset{\sim }{\mathrm{G}},\overset{\sim }{\mathrm{B}}}^T{\Sigma}_{\overset{\sim }{\mathrm{G}},\overset{\sim }{\mathrm{B}\ }} \) (or \( {\Sigma}_{\overset{\sim }{\mathrm{B}},\overset{\sim }{\mathrm{G}}}^T{\Sigma}_{\overset{\sim }{\mathrm{B}},\overset{\sim }{\mathrm{G}}} \)).

The sample permutation method is employed to calculate p-values. The sample permutation changes neither the correlation structure within gene sets nor the correlation structure within phenotype. This feature brings a considerable computational advantage to the analysis because there is no need to repeat eigenvalue decomposition for each permuted version of the dataset.

The LLCT method can also be generalized to analyze (1) family-based data in which the subjects are nested within families and expected to share many similarities; and, (2) time-course microarray data in which the gene expressions are repeatedly measured over time. These two generalizations are expanded in Additional file 1.

Simulation study design

A simulation study was designed to evaluate the performance of LLCT method and compare its performance with PAVR proposed by Adewale et al. [7]. Several simulations were generated with varying number of subjects, gene set sizes, number of repeated measurements, within-gene set correlation, within-subject correlation and gene set effect sizes. The number of subjects and gene set size changed from 30,50 to 100.

For each gene set, gene expressions are simulated from MVNG, ΣG) where ΜG is the mean vector of gene expressions, taken from a truncated exponential distribution with λ = 0.7. ΣG is the variance-covariance matrix of genes within a gene set. The variances of the genes were set at \( {\sigma}_G^2=0.5 \) and the correlations between genes were set at ρG=.0.1, 0.5 or 0.7. The effect of within-gene set correlation on the performance of the method was evaluated.

For each gene set, the longitudinal data was simulated based on the following model:

$$ {y}_{ij}={\mathrm{B}}_1\times {GS}_i+{\mathrm{B}}_2\times {t}_i+{\mathrm{B}}_3\times {GS}_i\times {t}_i+{b}_{0i}+{b}_{1i}\times {t}_i+{\varepsilon}_{ij} $$

Where yij denotes the j th observation of the i th subject; GSi is the vector of gene expression measurements for i th subject; Β1 is the vector of fixed effects of the genes on the longitudinal phenotype, with values of 0.05,0.1 and 0.2 for all the subjects; ti is the measurement time vector of the i th subject varying from one subject to another. The length of ti is set at 3,4 and 5 in different simulations, but the time points of measurement were uniformly distributed between 1 and 10. Β2 is the vector of fixed effect of time on phenotype, set at 0.3 for all the subjects. Β3 is the vector of fixed effects of interactions of gene expressions at time and was set at 0.25,0.05 and 0.1 for all subjects in different simulations. b0i~N(0, 1) and b1i~N(0, 2) are the random constant and the random effect of subject i, respectively and are assumed to be independent among subjects. εij is the error term defining the variation of the j th observation of subject i. εij is assumed to be correlated within subjects. In this simulation, the correlation structure of εij is autoregressive and we assumed: \( cor\left({\varepsilon}_k,{\varepsilon}_l\right)={\rho}_{\varepsilon}^{k-l} \) where ρε = 0.2,0.5 or 0.7.

For LLCT simulation, we simulated 1000 gene sets in each run and each p-value was calculated based on 1000 permutations. In simulations of PAVR, the results are based on 50 permutations.

Availability of data and materials

The GAW19 dataset supporting the first application of this article is available to any researcher who requests them from Genetic Analysis Workshops ( The dataset supporting the wound healing application is accessible in the GEO data repository ( under accession number GSE23006.

LLCT package for conducting LLCT analyses was produced by R3.5.3 and is available at



Diastolic blood pressure


Genetic Analysis Workshop


Generalized Estimating Equations


Gene Expression Omnibus


Gene Set Analysis


Genome Wide Association Studies


hypertension status


Individual Gene Analysis


Keyoto Encyclopedia of Genes and Genomes


Latent class growth modeling


Longitudinal linear combination test


Linear Mixed Models


Pathway Analysis via Regression method


Pulse pressure


San Antonio Family Heart Study


Systolic blood pressure


The Cancer Genome Atlas


Variance components


Variance Inflation Factor


  1. 1.

    Tusher VG, Tibshirani R, Chu G. Significance analysis of microarrays applied to the ionizing radiation response. Proc Natl Acad Sci U S A. 2001;98:5116–21.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  2. 2.

    Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, et al. Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci U S A. 2005;102:15545–50.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  3. 3.

    Mootha VK, Lindgren CM, Eriksson K-F, Subramanian A, Sihag S, Lehar J, et al. PGC-1alpha-responsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes. Nat Genet. 2003;34:267–73.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  4. 4.

    Goeman JJ, Bühlmann P. Analyzing gene expression data in terms of gene sets: methodological issues. Bioinforma Oxf Engl. 2007;23:980–7.

    CAS  Article  Google Scholar 

  5. 5.

    Nam D, Kim S-Y. Gene-set approach for expression pattern analysis. Brief Bioinform. 2008;9:189–97.

    PubMed  Article  PubMed Central  Google Scholar 

  6. 6.

    Fan R, Albert PS, Schisterman EF. A discussion of Gene-gene and Gene-environment interactions and longitudinal genetic analysis of complex traits. Stat Med. 2012;31:2565–8.

    PubMed  PubMed Central  Article  Google Scholar 

  7. 7.

    Adewale AJ, Dinu I, Potter JD, Liu Q, Yasui Y. Pathway analysis of microarray data via regression. J Comput Biol. 2008;15:269–77.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  8. 8.

    Conesa A, Nueda MJ, Ferrer A, Talón M. maSigPro: a method to identify significantly differential expression profiles in time-course microarray experiments. Bioinformatics. 2006;22:1096–102.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  9. 9.

    Kerr MK, Churchill GA. Statistical design and the analysis of gene expression microarray data. Genet Res. 2001;77:123–8.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  10. 10.

    Park T, Yi S-G, Lee S, Lee SY, Yoo D-H, Ahn J-I, et al. Statistical tests for identifying differentially expressed genes in time-course microarray experiments. Bioinforma Oxf Engl. 2003;19:694–703.

    CAS  Article  Google Scholar 

  11. 11.

    Turner JA, Bolen CR, Blankenship DM. Quantitative gene set analysis generalized for repeated measures, confounder adjustment, and continuous covariates. BMC Bioinformatics. 2015;16:272.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  12. 12.

    Hejblum BP, Skinner J, Thiébaut R. Time-course gene set analysis for longitudinal gene expression data. PLoS Comput Biol. 2015;11:e1004310.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  13. 13.

    Zhang K, Wang H, Bathke AC, Harrar SW, Piepho H-P, Deng Y. Gene set analysis for longitudinal gene expression data. BMC Bioinformatics. 2011;12:273.

    PubMed  PubMed Central  Article  Google Scholar 

  14. 14.

    Wijsman EM. Family-based approaches: design, imputation, analysis, and beyond. BMC Genet. 2016;17(Suppl 2):9.

    PubMed  PubMed Central  Article  Google Scholar 

  15. 15.

    Amberger J, Bocchini C, Hamosh A. A new face and new challenges for online Mendelian inheritance in man (OMIM®). Hum Mutat. 2011;32:564–7.

    PubMed  Article  Google Scholar 

  16. 16.

    Tomczak K, Czerwińska P, Wiznerowicz M. The Cancer genome atlas (TCGA): an immeasurable source of knowledge. Contemp Oncol. 2015;19:A68–77.

    Google Scholar 

  17. 17.

    Edgar R, Domrachev M, Lash AE. Gene expression omnibus: NCBI gene expression and hybridization array data repository. Nucleic Acids Res. 2002;30:207–10.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  18. 18.

    Kanehisa M, Goto S. KEGG: Kyoto encyclopedia of genes and genomes. Nucleic Acids Res. 2000;28:27–30.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  19. 19.

    Nishimura D. BioCarta. Biotech Softw Internet Rep. 2001;2:117–20.

    Article  Google Scholar 

  20. 20.

    Khatri P, Sirota M, Butte AJ. Ten years of pathway analysis: current approaches and outstanding challenges. PLoS Comput Biol. 2012;8:e1002375.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  21. 21.

    Tian L, Greenberg SA, Kong SW, Altschuler J, Kohane IS, Park PJ. Discovering statistically significant pathways in expression profiling studies. Proc Natl Acad Sci U S A. 2005;102:13544–9.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  22. 22.

    Kearney PM, Whelton M, Reynolds K, Muntner P, Whelton PK, He J. Global burden of hypertension: analysis of worldwide data. Lancet Lond Engl. 2005;365:217–23.

    Article  Google Scholar 

  23. 23.

    Mancia G, Fagard R, Narkiewicz K, Redon J, Zanchetti A, Böhm M, et al. 2013 ESH/ESC guidelines for the management of arterial hypertensionThe task force for the management of arterial hypertension of the European Society of Hypertension (ESH) and of the European Society of Cardiology (ESC). Eur Heart J. 2013;34:2159–219.

  24. 24.

    Chobanian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, et al. Seventh report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure. Hypertens Dallas Tex 1979. 2003;42:1206–52.

    CAS  Google Scholar 

  25. 25.

    Johnson T, Gaunt TR, Newhouse SJ, Padmanabhan S, Tomaszewski M, Kumari M, et al. Blood pressure loci identified with a gene-centric array. Am J Hum Genet. 2011;89:688–700.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  26. 26.

    Johnson JA. Ethnic differences in cardiovascular drug response: potential contribution of Pharmacogenetics. Circulation. 2008;118:1383–93.

    PubMed  PubMed Central  Article  Google Scholar 

  27. 27.

    Almasy L, Amos CI, Bailey-Wilson JE, Cantor RM, Jaquish CE, Martinez M, et al. Genetic Analysis Workshop 13: Analysis of Longitudinal Family Data for Complex Diseases and Related Risk Factors. BMC Genet. 2003;4(Suppl 1):S1.

    PubMed Central  Article  PubMed  Google Scholar 

  28. 28.

    Cupples LA, Beyene J, Bickeböller H, Daw EW, Fallin MD, Gauderman WJ, et al. Genetic analysis workshop 16: strategies for genome-wide association study analyses. BMC Proc. 2009;3:S1.

    PubMed  PubMed Central  Article  Google Scholar 

  29. 29.

    Bickeböller H, Bailey JN, Beyene J, Cantor RM, Cordell HJ, Culverhouse RC, et al. Genetic Analysis Workshop 18: Methods and strategies for analyzing human sequence and phenotype data in members of extended pedigrees. BMC Proc. 2014;8(Suppl 1):S1.

    PubMed  PubMed Central  Article  Google Scholar 

  30. 30.

    Engelman CD, Greenwood CMT, Bailey JN, Cantor RM, Kent JW, König IR, et al. Genetic analysis workshop 19: methods and strategies for analyzing human sequence and gene expression data in extended families and unrelated individuals. BMC Proc. 2016;10(Suppl 7):67–70.

    PubMed  PubMed Central  Google Scholar 

  31. 31.

    Ziki MDA, Mani A. Atherosclerosis. 2017.

    Google Scholar 

  32. 32.

    Tarca AL, Draghici S, Bhatti G, Romero R. Down-weighting overlapping genes improves gene set analysis. BMC Bioinformatics. 2012;13:136.

    PubMed  PubMed Central  Article  Google Scholar 

  33. 33.

    Heusch G, Libby P, Gersh B, Yellon D, Böhm M, Lopaschuk G, et al. Cardiovascular remodelling in coronary artery disease and heart failure. Lancet Lond Engl. 2014;383:1933–43.

    Article  Google Scholar 

  34. 34.

    Brown DI, Griendling KK. Regulation of signal transduction by reactive oxygen species in the cardiovascular system. Circ Res. 2015;116:531–49.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  35. 35.

    Tabas I, García-Cardeña G, Owens GK. Recent insights into the cellular biology of atherosclerosis. J Cell Biol. 2015;209:13–22.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  36. 36.

    Hedman AC, Smith JM, Sacks DB. The biology of IQGAP proteins: beyond the cytoskeleton. EMBO Rep. 2015;16:427–46.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  37. 37.

    Michael SK, Surks HK, Wang Y, Zhu Y, Blanton R, Jamnongjit M, et al. High blood pressure arising from a defect in vascular function. Proc Natl Acad Sci U S A. 2008;105:6702–7.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  38. 38.

    Brozovich FV, Nicholson CJ, Degen CV, Gao YZ, Aggarwal M, Morgan KG. Mechanisms of vascular smooth muscle contraction and the basis for pharmacologic treatment of smooth muscle disorders. Pharmacol Rev. 2016;68:476–532.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  39. 39.

    Jaenisch R, Bird A. Epigenetic regulation of gene expression: how the genome integrates intrinsic and environmental signals. Nat Genet. 2003;33(Suppl):245–54.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  40. 40.

    Kouzarides T. Chromatin modifications and their function. Cell. 2007;128:693–705.

    CAS  Article  Google Scholar 

  41. 41.

    Abou Ziki MD, Mani A. Wnt signaling, a novel pathway regulating blood pressure? State of the art review. Atherosclerosis. 2017;262:171–8.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  42. 42.

    Cheng P-W, Chen Y-Y, Cheng W-H, Lu P-J, Chen H-H, Chen B-R, et al. Wnt signaling regulates blood pressure by Downregulating a GSK-3β–mediated pathway to enhance insulin signaling in the central nervous system. Diabetes. 2015;64:3413–24.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  43. 43.

    Foulquier S, Daskalopoulos EP, Lluri G, Hermans KCM, Deb A, Blankesteijn WM. WNT signaling in cardiac and vascular disease. Pharmacol Rev. 2018;70:68–141.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  44. 44.

    Wain LV, Verwoert GC, O’Reilly PF, Shi G, Johnson T, Johnson AD, et al. Genome-wide association study identifies six new loci influencing pulse pressure and mean arterial pressure. Nat Genet. 2011;43:1005.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  45. 45.

    Adeyemo A, Gerry N, Chen G, Herbert A, Doumatey A, Huang H, et al. A genome-wide association study of hypertension and blood pressure in African Americans. PLoS Genet. 2009;5:e1000564.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  46. 46.

    Iguchi H, Urashima Y, Inagaki Y, Ikeda Y, Okamura M, Tanaka T, et al. SOX6 suppresses Cyclin D1 promoter activity by interacting with β-catenin and histone Deacetylase 1, and its Down-regulation induces pancreatic β-cell proliferation. J Biol Chem. 2007;282:19052–61.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  47. 47.

    Zorn AM, Barish GD, Williams BO, Lavender P, Klymkowsky MW, Varmus HE. Regulation of Wnt signaling by sox proteins: XSox17α/β and XSox3 physically interact with β-catenin. Mol Cell. 1999;4:487–98.

    CAS  Article  Google Scholar 

  48. 48.

    Durik M, Kavousi M, van der Pluijm I, Isaacs A, Cheng C, Verdonk K, et al. Nucleotide excision DNA repair is associated with age-related vascular dysfunction. Circulation. 2012;126:468–78.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  49. 49.

    Xu S, Touyz RM. Reactive oxygen species and vascular remodelling in hypertension: still alive. Can J Cardiol. 2006;22:947–51.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  50. 50.

    Lassègue B, Griendling KK. Reactive oxygen species in hypertension; An update. Am J Hypertens. 2004;17:852–60.

    PubMed  Article  CAS  Google Scholar 

  51. 51.

    Henstell H. The pituitary gland and the maintenance of blood pressure. Yale J Biol Med. 1933;5:531–44.

    CAS  PubMed  PubMed Central  Google Scholar 

  52. 52.

    Das CJ, Baruah MP, Baruah UM. Radiological imaging in endocrine hypertension. Indian J Endocrinol Metab. 2011;15:S383–8.

    PubMed  PubMed Central  Article  Google Scholar 

  53. 53.

    Hunter J, Haist RE. Hormonal hypertension resulting from pituitary imbalance. Can J Physiol Pharmacol. 1965;43:269–78.

    CAS  PubMed  Article  Google Scholar 

  54. 54.

    Mancia G, Grassi G. The autonomic nervous system and hypertension. Circ Res. 2014;114:1804–14.

    CAS  PubMed  Article  Google Scholar 

  55. 55.

    Mayet J, Hughes A. Cardiac and vascular pathophysiology in hypertension. Heart. 2003;89:1104–9.

    PubMed  PubMed Central  Article  Google Scholar 

  56. 56.

    Dirkx E, da Costa Martins PA, De Windt LJ. Regulation of fetal gene expression in heart failure. Biochim Biophys Acta (BBA) - Mol Basis Dis. 2013;1832:2414–24.

    CAS  Article  Google Scholar 

  57. 57.

    Bress AP, Irvin MR, Muntner P. Genetics of blood pressure: new insights into a complex trait. Am J Kidney Dis Off J Natl Kidney Found. 2017;69:723–5.

    Article  Google Scholar 

  58. 58.

    Chiu Y-F, Justice AE, Melton PE. Longitudinal analytical approaches to genetic data. BMC Genet. 2016;17:S4.

    Article  Google Scholar 

  59. 59.

    Iglesias-Bartolome R, Uchiyama A, Molinolo AA, Abusleme L, Brooks SR, Callejas-Valera JL, et al. Transcriptional signature primes human oral mucosa for rapid wound healing. Sci Transl Med. 2018;10:eaap8798.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  60. 60.

    Menke NB, Ward KR, Witten TM, Bonchev DG, Diegelmann RF. Impaired wound healing. Clin Dermatol. 2007;25:19–25.

    PubMed  Article  Google Scholar 

  61. 61.

    Chen L, Arbieva ZH, Guo S, Marucha PT, Mustoe TA, DiPietro LA. Positional differences in the wound transcriptome of skin and oral mucosa. BMC Genomics. 2010;11:471.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  62. 62.

    Nguyen DT, Orgill D, Murphy GF. The pathophysiologic basis for wound healing and cutaneous regeneration. In: Biomaterials for Treating Skin Loss; 2009. p. 25–57.

    Google Scholar 

  63. 63.

    Rieder F, Karrasch T, Ben-Horin S, Schirbel A, Ehehalt R, Wehkamp J, et al. Results of the 2nd scientific workshop of the ECCO (III): basic mechanisms of intestinal healing. J Crohns Colitis. 2012;6:373–85.

    PubMed  Article  Google Scholar 

  64. 64.

    Zhao W, Oskeritzian CA, Pozez AL, Schwartz LB. Cytokine production by skin-derived mast cells: endogenous proteases are responsible for degradation of cytokines. J Immunol. 2005;175:2635–42.

    CAS  PubMed  Article  Google Scholar 

  65. 65.

    Dhuriya YK, Sharma D. Necroptosis: a regulated inflammatory mode of cell death. J Neuroinflammation. 2018;15:199.

    PubMed  PubMed Central  Article  CAS  Google Scholar 

  66. 66.

    Johnson A, Francis M, DiPietro LA. Differential apoptosis in mucosal and dermal wound healing. Adv Wound Care. 2014;3:751–61.

    Article  Google Scholar 

  67. 67.

    Degterev A, Hitomi J, Germscheid M, Ch’en IL, Korkina O, Teng X, et al. Identification of RIP1 kinase as a specific cellular target of necrostatins. Nat Chem Biol. 2008;4:313–21.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  68. 68.

    Qian M, Fang X, Wang X. Autophagy and inflammation. Clin Transl Med. 2017;6.

  69. 69.

    Stout MC, Asiimwe E, Birkenstamm JR, Kim SY, Campbell PM. Analyzing Ras-associated cell proliferation signaling. Methods Mol Biol Clifton NJ. 2014;1170:393–409.

    Article  CAS  Google Scholar 

  70. 70.

    Bhattacharyya S, Wang W, Morales-Nebreda L, Feng G, Wu M, Zhou X, et al. Tenascin-C drives persistence of organ fibrosis. Nat Commun. 2016;7:11703.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  71. 71.

    Jinnin M, Ihn H, Asano Y, Yamane K, Trojanowska M, Tamaki K. Tenascin-C upregulation by transforming growth factor- β in human dermal fibroblasts involves Smad3, Sp1, and Ets1. Oncogene. 2004;23:1656.

    CAS  PubMed  Article  Google Scholar 

  72. 72.

    Mi B, Liu G, Zhou W, Lv H, Zha K, Liu Y, et al. Bioinformatics analysis of fibroblasts exposed to TGF-β at the early proliferation phase of wound repair. Mol Med Rep. 2017;16:8146–54.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  73. 73.

    Bronson RE, Argenta JG, Siebert EP, Bertolami CN. Distinctive fibroblastic subpopulations in skin and oral mucosa demonstrated by differences in glycosaminoglycan content. Vitro Cell Dev Biol J Tissue Cult Assoc. 1988;24:1121–6.

    CAS  Article  Google Scholar 

  74. 74.

    Olczyk P, Mencner Ł, Komosinska-Vassev K. Diverse roles of Heparan sulfate and heparin in wound repair. Biomed Res Int. 2015.

    Article  CAS  Google Scholar 

  75. 75.

    Anderson AA, Ushakov DS, Ferenczi MA, Mori R, Martin P, Saffell JL. Morphoregulation by acetylcholinesterase in fibroblasts and astrocytes. J Cell Physiol. 2008;215:82–100.

    CAS  PubMed  Article  Google Scholar 

  76. 76.

    Kerner B, North KE, Fallin MD. Use of longitudinal data in genetic studies in the genome-wide association studies era: summary of group 14. Genet Epidemiol. 2009;33(Suppl 1):S93–8.

    PubMed  PubMed Central  Article  Google Scholar 

  77. 77.

    Rahmatallah Y, Emmert-Streib F, Glazko G. Gene set analysis approaches for RNA-seq data: performance evaluation and application guideline. Brief Bioinform. 2016;17:393–407.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  78. 78.

    Kent JW. Pathway-based analyses. BMC Genet. 2016;17(Suppl 2).

  79. 79.

    Dinu I, Wang X, Kelemen LE, Vatanpour S, Pyne S. Linear combination test for gene set analysis of a continuous phenotype. BMC Bioinformatics. 2013;14:212.

    PubMed  PubMed Central  Article  Google Scholar 

  80. 80.

    Fitzmaurice GM, Laird NM, Ware JH. Applied Longitudinal Analysis: Wiley; 2012.

  81. 81.

    Schäfer J, Strimmer K. A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics. Stat Appl Genet Mol Biol. 2005;4.

Download references



Availability and requirements

Project name: Longitudinal Linear Combination Test (LLCT)

Project home page:

Operating system(s): Linux, Microsoft Windows

Programming language: R

Other requirements: R > =3.5.3

License: GPL-3

Any restrictions to use by non-academics: No restrictions


In regards with the study conception, literature search, methods development, data analysis, interpretations and writing, this research was partially supported by the Natural Sciences and Engineering Research Council of Canada (RGPIN-2014-06370) through their Discovery Grants program. Infrastructure support for Andrews was provided by the Canada Foundation for Innovation through the John R. Evans Leaders Fund (#35578).

The financial supports of design and data collection of GAW19 are acknowledged as below. The Genetic Analysis Workshop is supported by NIH grant R01 GM031575. The GAW19 exome and whole genome sequence data were provided by the T2D-GENES Consortium, which is supported by NIH grants U01 DK085524, U01 DK085584, U01 DK085501, U01 DK085526, and U01 DK085545. Additional genetic and phenotypic data for GAW19 were provided by the San Antonio Family Heart Study and San Antonio Family Diabetes/Gallbladder Study, which are supported by NIH grants R01 HL0113323, P01 HL045222, R01 DK047482, and R01 DK053889. Additional Starr County genotype and phenotype data were supported by NIH grants R01 DK073541 and R01 HL102830. The VAGES study was supported by a Veterans Administration Epidemiologic grant. The FIND-SA study was supported by NIH grant U01 DK57295.

Author information




EK, JA and ID participated in the conception and design of the study; EK and MH carried out statistical analyses and interpreted the findings; EK, JA and ID drafted the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Irina Dinu.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

The methodology descriptions of the generalizations of LLCT methods for analysis of: (1) Family-based data (2) Time-course microarray data.

Additional file 2.

Results of LLCT examining the differential expressions of different gene sets in association with various measures of blood pressure for UNRELATED subjects in GAW19 dataset.

Additional file 3.

Results of LLCT examining the differential expressions of different gene sets in association with various measures of blood pressure for RELATED subjects in GAW19 dataset.

Additional file 4.

Results of LLCT analysis examining the differential time-course expressions of different gene sets in association with the position of the wound (skin or tongue).

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Khodayari Moez, E., Hajihosseini, M., Andrews, J.L. et al. Longitudinal linear combination test for gene set analysis. BMC Bioinformatics 20, 650 (2019).

Download citation