# MCA: Multiresolution Correlation Analysis, a graphical tool for subpopulation identification in single-cell gene expression data

- Justin Feigelman
^{1, 2}, - Fabian J Theis
^{1, 2}and - Carsten Marr
^{1}Email author

**15**:240

https://doi.org/10.1186/1471-2105-15-240

© Feigelman et al.; licensee BioMed Central Ltd. 2014

**Received: **23 April 2014

**Accepted: **4 July 2014

**Published: **11 July 2014

## Abstract

### Background

Biological data often originate from samples containing mixtures of subpopulations, corresponding e.g. to distinct cellular phenotypes. However, identification of distinct subpopulations may be difficult if biological measurements yield distributions that are not easily separable.

### Results

We present Multiresolution Correlation Analysis (MCA), a method for visually identifying subpopulations based on the local pairwise correlation between covariates, without needing to define an a priori interaction scale. We demonstrate that MCA facilitates the identification of differentially regulated subpopulations in simulated data from a small gene regulatory network, followed by application to previously published single-cell qPCR data from mouse embryonic stem cells. We show that MCA recovers previously identified subpopulations, provides additional insight into the underlying correlation structure, reveals potentially spurious compartmentalizations, and provides insight into novel subpopulations.

### Conclusions

MCA is a useful method for the identification of subpopulations in low-dimensional expression data, as emerging from qPCR or FACS measurements. With MCA it is possible to investigate the robustness of covariate correlations with respect subpopulations, graphically identify outliers, and identify factors contributing to differential regulation between pairs of covariates. MCA thus provides a framework for investigation of expression correlations for genes of interests and biological hypothesis generation.

### Keywords

Multiresolution Correlation Subpopulation identification qPCR analysis## Background

Heterogeneity in cellular populations has been the focus of many recent publications in areas such as embryonic stem cells [1], induced pluripotency [2], transcriptomics [3], and metabolomics [4]. In biological experiments, data often originate from a mixture of qualitatively differing subpopulations corresponding to e.g. distinct phenotypes in assays of cellular populations. For example, whole blood samples contain a mixture of distinct cell lineages which can be identified based on the presence of lineage-specific cell surface markers [5]. Embryonic stem cells have also been shown to exhibit heterogeneous expression of pluripotency factors critical for the maintenance of pluripotency in culture [1, 6]. Indeed, there is increasing evidence for the existence of cellular subpopulations with possible noise-induced transitions between phenotypic attractors [7]. Thus it is clear that traditional techniques, which provide only population averages, may fail to resolve the true population heterogeneity.

Technologies such as flow cytometry, single-cell qPCR, mass cytometry and time lapse fluorescent microscopy are uniquely positioned to answer questions regarding the makeup of cellular populations. Each is able to yield quantitative measurements of cellular state, i.e. mRNA expression or protein copy number, which may be representative of the underlying subpopulations.

If the subpopulations are not already known, various methods exist to attempt to learn them on the basis of the data distribution. Classical techniques such as clustering may be useful for subpopulation identification if the subpopulations are readily separable in terms of expression levels [8]. Alternatively, more sophisticated machine-learning based approaches such as mixture models, (fuzzy) k-means clustering, multilayer perceptrons, self organizing maps, support vector machines, regression trees, and many others have also been applied to subpopulation identification (see Lugli *et al.*[9] and Bashashati *et al.*[10] for a review of subpopulation identification approaches applied to flow cytometry).

However, existing methods for subpopulation identification predominantly rely on heterogenous expression levels. If the distributions overlap, identification of individual subpopulations based on expression alone may be difficult. In the case where subpopulations exhibit differential regulation motifs, they may be identifiable based on their distinctive correlations. Examining the local, state-dependent correlation of covariates provides additional information regarding the underlying distributions attributable to distinct subpopulations. In particular, we expect correlations to change for regions of state space (i.e. the space of possible gene expression levels) containing predominantly samples from a single subpopulation. Correlation analysis in subspaces of high dimensional data have gained attention over the past several years, particularly in the context of data mining e.g. in databases. For instance, algorithms such as MAFIA [11], CURLER [12], *δ*-Clusters [13], ENCLUS [14], etc. have been proposed for automatic identification of clusters using lower-dimensional subspaces. However, automatically identified clusters may be difficult to interpret biologically, and it may be difficult to assess their relative robustness.

We introduce a complementary method, Multiresolution Correlation Analysis (MCA) for systematically examining the dependence of local correlation upon location in state space. Using MCA, the correlations of pairs of variables are examined for regions of state space subdivided with varying granularity. The analysis can be summarized using MCA plots, which provide a visual representation of the pairwise correlation as a function of expression of a third variable.

MCA plots simultaneously visualize the correlations of data subsets of all sizes, centered at all locations in the distribution of a sorting variable, making it possible to distinguish regions with robust correlations which may be indicative of distinct subpopulations. Lastly, they provide the ability to identify observations which contribute disproportionately to the overall correlation structure, and hence skew the estimated correlation of the entire population.

## Results

### MCA reveals differential regulation of subpopulations in simulated gene expression data

*Methods*. In this system,

*Z*activates

*X*and

*X*activates

*Y*(Figure 1A, left) via Hill-type activation functions, and population-level heterogeneity is introduced via the use of stochastic differential equations which approximate the intrinsic noisiness of gene expression [15–17].

The steady state distribution resulting from a typical simulation (Figure 1A, center) shows a significant positive Pearson correlation (*p*<0.05) between *Z* and *X*, and between *X* and *Y* (Figure 1A, right), and no significant correlation between *Z* and *Y*, as would be expected from the underlying regulatory motif.

Similarly, we simulated a biological system for which *Z* activates *X*, but where *X* inhibits *Y* (see Figure 1B, left) and Eq. 7 of *Methods*). The resulting steady state distribution (Figure 1B, center) appears similar to that of the activation model. However, correlation analysis reveals that *Z* and *X* show significant positive correlation, and *X* and *Y* significant negative correlation (Figure 1B, right), in accordance with the underlying biological motif. The Pearson correlation also indicates significant negative correlation between *Y* and *Z* in the inhibition model, an indirect effect.

When combining the steady state distributions from activation and inhibition models (Figure 1C), the net Pearson correlation between *X* and *Y* is significantly negative (Figure 1C, I). Absent of subpopulation analysis, we would conclude that the relationship between expression levels of *X* and *Y* is antagonistic, implying an inhibitory motif.

In contrast, performing the same analysis on the subpopulation with *Z* expression levels in the lowest 30% of the *Z*-distribution (Figure 1C, II) yields a significant positive correlation between *X* and *Y*. Likewise, performing correlation analysis on the samples in the top 30% of the *Z*-distribution shows just the opposite, a significant negative correlation between *X* and *Y* (Figure 1C, III).

We can combine all of the *Z*-sorted subpopulations of varying size together using the MCA plot (Figure 1D), constructed as described in *Methods*. Briefly, the MCA plot shows the correlation of a pair of factors, for subpopulations defined by a sorting variable. The abscissa indicates the median value of the sorting variable for that subpopulation and the ordinate indicates the fraction of the population included in that subpopulation. Thus, higher points indicate larger subpopulations, points to the left indicate low er overall expression of the sorting variable, points to the right higher overall expression, etc. The regions where the computed correlation is statistically significant (*p*<0.05) are indicated.

By systematic inspection via the MCA plot, we can conclude that subpopulations with low *Z* values indeed show significant positive correlation between *X* and *Y* (Figure 1D, blue region), and subpopulations with high *Z* values show significant negative correlation between *X* and *Y* (Figure 1D, red region, see *Methods* for details).

### MCA plots as a diagnostic tool for transcriptomic analysis

MCA plots can be used to provide a multiresolution view of the correlation structure of real transcriptomic data. This allows us to confirm previous conclusions regarding heterogeneous subpopulations, detect potential novel subpopulations, and provides insight into the origin of the observed correlations.

We used MCA to analyze previously published single-cell transcriptomic data obtained from mouse embryonic stem cells (mESCs) [18, 19]. There, microfluidic single-cell qPCR was used to obtain the relative expression of mRNAs for eight transcription factors known to be involved in regulation of pluripotency in mESCs: Fgf5, Nanog, Oct4, Sox2, Rex1, Pecam1, Stella and Gbx2, and Gapdh, a housekeeping gene against which all other transcript copy numbers were normalized. Analysis of subpopulations showed difference in the correlation networks of Nanog+/- and Fgf5+/- subpopulations, as well as clear separation of subpopulations using principal component analysis.

After data cleaning and normalization according to the method of Trott *et al.*[18], we generated the MCA plots for all pairs of genes, for all possible sortings, using Pearson correlation and a significance cutoff of *p*<0.05. All points with *p*>0.05 are colored white in the MCA plot.

#### Detection of robust correlations

#### Outlier detection

Correlation analysis can be sensitive to one or a few samples which substantially alter the estimated correlation of the entire population. In such a case, all subpopulations including these samples show a significant correlation, whereas their exclusion results in no significant correlation or potentially correlation of the opposite sign. MCA plots are able to detect such samples and identify them as sources of the detected correlation. For example, when sorting by Sox2, all subpopulations which do not contain the sample with the highest Sox2 expression do not show statistically significant correlation between Rex1 and Gbx2, whereas all subpopulations that do include this point show significant positive correlation (Figure 2B, top). Upon inspection of the data (Figure 2B, bottom) it is obvious that this single point, indicated by the arrow, is an outlier. Exclusion of this point renders the Rex1, Gbx2 correlation insignificant.

#### Subpopulation identification

MCA plots are useful for identification of interesting subpopulations as shown for synthetic data (Figure 1C). Regions exhibiting a robust correlation may indicate the presence of differential regulation or a distinct cellular phenotype. For instance, sorting by Stella reveals the presence of a large region (the highest 40% of the population) for which the correlation between Nanog and Oct4 is not statistically significant (Figure 2C, top). Conversely, including the cells from the lowest 60% of the Stella distribution is sufficient to induce a significant positive correlation (Figure 2C, top). Inspection of the scatter plot of Nanog and Oct4 (Figure 2C, bottom) confirms that the lower 60% is noticeably more correlated than the top 40%. Hayashi *et al.*[19] note that mESCs with low or absent Stella expression may be more representative of epiblast-derived stem cells, and thus are expected to show differential regulation from the high Stella cells, which are more embryonic stem cell-like. Interestingly, the possibility of antagonistic regulation between Oct4 and Nanog in mESCs has recently also been raised [21].

### MCA provides additional insight into previously described subpopulations

In order to identify subpopulations with different co-expression networks, Trott *et al.*[18] grouped cells according to normalized pluripotency gene expression. Networks are constructed on the basis of significant Pearson correlation between nodes, and subdivided into groups based on the presence of two heterogeneously expressed transcription factors, Nanog and Fgf5. The high Nanog (Nanog+) compartment was defined such that Fgf5 expression is absent for all cells with Nanog expression at or above the minimum level of this compartment.

#### MCA plots confirm differential Gbx2, Sox2 correlation for high Nanog cells

^{ t h }−74

^{ t h }percentile), show no significant correlation between Gbx2 and Sox2 (Figure 3A, II). However, we learn from the MCA plot that in fact only the top 10% contribute to the observed positive correlation; the subset of the high Nanog subpopulation between the 74

^{ t h }and 93

^{ r d }percentile (Figure 3A, III) is not significantly correlated (

*p*=0.57).

#### MCA plots show that Gbx2, Sox2 correlations are not robust for Fgf5- cells

The authors found that the 15 of 83 cells (18%) expressing Fgf5 (Fgf5+ compartment) do not correlate for Gbx2 and Sox2, whereas the remaining 68 Fgf5- cells (82%) show a significant positive correlation [18]. Using an MCA plot we see that this indeed true (Figure 3B, I and II for Fgf5+, Fgf5-, respectively). However it is also evident that the Fgf5+ cells with Fgf5 expression between the 90^{
t
h
} and 100^{
t
h
} percentile of the distribution are in fact positively correlated for Gbx2 and Sox2 (Figure 3B, III). Likewise, the majority of the cells in the Fgf5- compartment are not significantly correlated for Gbx2 and Sox2. Indeed most subpopulations consisting of cells with expression between the 0^{
t
h
} and 75^{
t
h
} percentile of the Fgf5 distribution are not significantly correlated for Gbx2 and Sox2 (*p*>0.05). Thus, MCA provides the means for a detailed and robust subpopulation identification, superior to *ad hoc* compartmentalization.

## Discussion

Fueled by newly developed single-cell technologies such as single-cell transcriptomic [22, 23], genomic [24] and proteomic [25] analysis, many new methods have emerged which attempt to shed light on cellular heterogeneity [26–29].

Previous methods for the detection of heterogeneous subpopulations in biological data have largely focused on grouping observations according to expression level, and thus requires that subpopulations be readily separable. For instance, in FACS cellular subpopulations are often identified with manually determined compartments [30–32]. If the data are easily separated, clustering methods such as Gaussian mixture modeling and k-means clustering have proven well suited to this task [8].

Alternatively, methods such as principal component analysis attempts to identify the principal directions, along which the data are maximally separated [33]. Data which cluster together in the reduced dimensional subspace spanned by the first few principal components are thought to be representative of subpopulations. A similar method was employed by Trott *et al.* when analyzing the Fgf5+/- and Nanog +/- compartments [18]. Non-linear alternatives to PCA including Gaussian Process Latent Variable Modeling have also recently been shown to be useful for the identification of cellular subpopulations [29, 34].

None of the previously mentioned methods utilize correlation information in the identification of cellular subpopulations, with the exception of Gaussian mixture modeling which attempts to learn the correlation matrices of Gaussian distributions thought to have generated the data. However, as shown here, the local correlation structure provides additional insight into the existence of differentially regulated subpopulations and hence should not be disregarded.

To date, relatively few methods have addressed the possibility of local, state-dependent correlations. Chen *et al.*[35] developed a method for analyzing the effect of local non-linear correlations in gene expression data, and applied it to a microarray dataset; a similar method was recently developed by Tjøstheim *et al.*[36] for estimating local Gaussian correlation in the context of econometric data. However, these methods required the definition of a interaction scale for the computation of local correlations or consider only the relative distance between data points and not their absolute levels when computing local correlations.

Recently Cordeiro *et al.*[37], developed a sophisticated algorithm for identifying clusters of arbitrary orientation, also in a multiresolution context. MCA is not as general in that it does not consider clusters aligned along arbitrary projections of the data but provides instead a comprehensive, multiresolution view of the correlation structure according to the measured covariates, preserving expression-level dependencies while not requiring any predefined bandwidth or interaction distance, and thus may provide more biological insight into the role of individual factors in differential regulation motifs.

MCA has the advantage of being easy to compute and intuitively interpretable; it is in effect a moving window correlation analysis simultaneously over many window sizes. The MCA plot provides a graphical diagnostic for detection of subpopulations points that contribute inordinately to the overall correlation, or outliers, and may provide biological insights that serve as hypotheses for further experimentation. Finally, although we have focused on biological data and in particular cellular subpopulations in single-cell transcriptional data, the method is more general and applicable to any multivariate data.

While the simplicity of MCA plots makes them easy to interpret, there are nonetheless shortcomings that must be mentioned. MCA plots are a graphical representation of the interaction of only two factors, sorted by a third. If there are many covariates, many such plots are possible, and it becomes increasingly more difficult to generate and search through all possible plots as the dimension increases. In such cases it is helpful to consider only those plots which may be of biological interest such as sorting variables thought to have a regulatory role, or pairs of factors that are suspected to interact. However, one may also use alternative sorting variables, such as products of covariates representing potential interactions, principal directions as determined by PCA, or even arbitrary non-linear functions of the covariates.

In the case of many variables, one may wish to sort the resultant plots according to arbitrary functions of the estimated correlation structures; i.e. one could filter for only those plots showing large significant regions or for plots for which a significant region of both positive and negative correlation are present. Although preliminary tests with such methods are successful in identifying such interesting plots, the results are not shown here as they are unnecessary when the number of dimensions is still manageable via manual inspection.

The correlation becomes difficult to estimate when the number of samples is small, or when the number of variables is relatively large compared to the number of observations. If the resolution is fine, then the MCA plot will contain many points for which the corresponding subpopulation only contains one or a few observations. Such points are omitted from the plot since the correlation cannot be robustly computed. This can sometimes give rise to small regions near the bottom of the MCA plots for which there are too few observations to compute the subpopulation correlation. These regions do not have biological significance.Similarly, the stochastic nature of the data may give rise to “noise” in small subpopulations, leading to interspersed points on the MCA plot which are not part of a large, significant region. These points typically do not indicate robust subpopulations since a small perturbation away from them leads to a different correlation structure, and can safely be ignored. This “noise” also gives rise to the slight inhomogeneities in the regions identified in Figures 2 and 3.

Lastly, in the case of relatively many variables compared to the number of observations, correlations can be computed using shrinkage-based estimators [38], although this results in a different estimation of statistical significance, and increases computational complexity.

## Conclusion

We have presented a method for the analysis of local correlation structures in subpopulations of multivariate data. MCA provides a multiresolution summary of correlations between pairs of variables as ordered by a third sorting variable. Using MCA, it is possible to detect robust correlations, identify outliers which can bias correlation estimates, and potentially discover new subpopulations or interactions giving rise to novel biological hypotheses.

Future work will focus on the development of methods to automatically identify variable pairs showing differential regulation in conjunction with a sorting variable, alleviating the need to manually search through plots for interesting behaviors.

## Methods

We introduce Multiresolution Correlation Analysis (MCA) as a means for visually analyzing the local correlation structure of pairs of covariates, sorted by a sorting variable.

### Estimation of correlations

*X*,

*Y*:

for a set of realizations *i*=1,…,*M* of *X* and *Y*.

If the data are not multivariate normally distributed, it is preferable to use a more robust measure of statistical correlation. For instance, Spearman’s rank correlation coefficient is defined as in (1), but using the rank-transformed data [39]; it provides a non-parametric measure of correlation between a pair of covariates.

### Multiresolution correlation analysis

as the matrix of observed data, where the rows correspond to individual observations, and columns to measured variables. Note that the data matrix is defined as the transpose of the data matrix employed in some other transcriptomic analysis methods.

Given *D*, we can compute the sample correlation between any pair of variables, for any subset of the total observations. In particular we examine subpopulations defined by different intervals within the distribution of $\overrightarrow{{d}_{s}}$, the *s*^{
t
h
} column of *D*, for any desired sorting variable *s*. For example, we can examine subpopulations for which the value of *s* is in the highest or lowest 30% of its distribution.

*α*

^{ t h }quantile of the sorting variable $\overrightarrow{{d}_{s}}$, and containing

*β*×100

*%*, of the total observations, such that

where *Q* is the quantile function, i.e. *Q*(*x*;*s*) is the *x*^{
t
h
} quantile of the distribution of $\overrightarrow{{d}_{s}}$, and $\overrightarrow{{d}_{q}}(\alpha ,\beta ;s)$ is the subset of the *q*^{
t
h
} column of *D* for which the sorting variable falls between the (*α*−*β*)^{
t
h
} and (*α*+*β*)^{
t
h
} quantile of its distribution.

We define *Ω* to be the set of all pairs (*α*,*β*) for which Eq. 2 is satisfied; for all (*α*,*β*)∉*Ω*, $\widehat{\Sigma}(\alpha ,\beta ;s)$ is undefined. Intuitively, Eq. 2 constrains *α* and *β* such that the subpopulation can extend no lower than the minimum, and no higher than the maximum of the sorting variable.

Although any function could be computed for the subpopulations, we restrict ourselves to Pearson correlation. If there are relatively many variables compared to the number of observations, i.e. *N*>*M*, estimation of the correlation matrix becomes numerically infeasible. In this case, estimation of the correlation can be computed using shrinkage-based approaches such as implemented in the GeneNet R-package [38].

### Construction of MCA plots

We systematically investigate the correlation of the subpopulations defined by (*α*,*β*)∈*Ω*. This information can be condensed into a MCA plot for any pair of variables (*i*,*j*) by plotting the magnitude of the (*i*,*j*)^{
t
h
} entry of $\widehat{\Sigma}(\alpha ,\beta ;s)$, with a color scale mapped to the interval [−1,1].

While $\widehat{\Sigma}(\alpha ,\beta ;s)$ is in principle defined for all (*α*,*β*)∈*Ω*, in practice we choose *β*=1/*R*,…,0.5 and *α*=*β*,*β*+1/*R*,…,1−*β* for some positive odd integer *R*≤*M* which determines the resolution of the MCA plot, i.e. the number of subpopulations examined: the larger *R*, the finer the resolution of the MCA plot.

For each computed subpopulation, a p-value is computed that depends on both subpopulation size and magnitude of the estimated correlation coefficient. Thresholding to retain only small p-values may reveal large subpopulations with strong correlations. However, due to the interdependence of the subpopulations (i.e. the estimated correlation coefficient of a subpopulation is determined by the correlation coefficients of the points below), it is not possibly to directly interpret the p-values as the probability of non-zero correlation.

Lastly, the number of possible MCA plots *N* increases cubically with the number of variables *k*, i.e. *N*=*k*(*k*−1)(*k*−2)/6, rendering fully-automatic analysis difficult. In this case, it is recommended to consider sorting variables which are of potential biological interest, such as those that are known to be heterogeneously expressed.

### Implementation

MCA and the MCA plots were implemented using the R programming language. The routine allows the user to pass a data frame containing observations, select a sorting variable, and a subset of factors whose pairwise correlations are to be analyzed; choose color options, and the number of subpopulations (resolution); specify correlation method (Pearson, partial, or Spearman), enable significance cutoffs with user-specified p-value threshold, and optionally to save resulting plots. The algorithm works by iterating through all subpopulations defined by median quantile of the sorting variable and size of the subpopulation, and computing the corresponding correlations using the built-in routines for correlation and significance estimation. Code is available upon request.

### Stochastic simulation

Synthetic data were generated via simulation of a gene regulatory network, the dynamics of which obey a stochastic differential equation. Two cases were simulated: a three species activation model where of *Z* activates *X*, and *X* activates *Y* (Figure 1A, top); and an inhibition model for which *Z* activates *X* and *X* inhibits *Y* (Figure 1B, top).

where model parameters are not necessarily the same between the activation and inhibition models.

In both cases, the drift of *X* is a sigmoidal function of *Z* and *Z* is an unregulated birth-death process. Each species is subject to linear decay and stochasticity enters through the homogeneous Wiener processes *ξ*_{
X
}(*t*),*ξ*_{
Y
}(*t*),and *ξ*_{
Z
}(*t*) which are independent, with unit variance, and scaled by the factor *σ*.

The two systems were constructed in such a way that the steady state distributions do not fully overlap, but are instead displaced with respect to one another such that the inhibition model shows an approximately 40% increase in *X*, and 20% increase in *Z* with respect to the activation model.

*Δ*

*t*=0.1, implemented in MATLAB. The resulting simulations were allowed to converge to the steady state distribution by discarding the first 300 data points, and subsequently thinned by a factor of 20. Pearson correlations were computed using the corr built-in function of MATLAB.

**Model parameters used for activation model (Figure**
1
**A)**

Parameter | Value | Description |
---|---|---|

| 2 | Hill coefficient of X activation |

| 2 | Hill coefficient of Y activation |

| 900 | Equilibrium constant of X activation |

| 1000 | Equilibrium constant of Y activation |

| 600 | Velocity of X production |

| 600 | Velocity of Y production |

| 450 | Basal production of Z |

| 0.3 | Death rate of X |

| 0.3 | Death rate of Y |

| 0.5 | Death rate of Z |

| 100 | Initial X |

| 100 | Initial Y |

| 100 | Initial Z |

| 0.1 | Time step |

**Model parameters used for inhibition model (Figure**
1
**B)**

Parameter | Value | Description |
---|---|---|

| 2 | Hill coefficient of X activation |

| 2 | Hill coefficient of Y activation |

| 4000 | Equilibrium constant of X activation |

| 1000 | Equilibrium constant of Y inhibition |

| 10000 | Velocity of X production |

| 70 | Velocity of Y production |

| 110 | Basal production of Z |

| 70 | Basal production of Y |

| 0.5 | Death rate of X |

| 0.1 | Death rate of Y |

| 0.1 | Death rate of Z |

| 100 | Initial X |

| 1500 | Initial Y |

| 1000 | Initial Z |

| 0.1 | Time step |

### Analysis of transcriptomic data

Single-cell transcriptomic data from 87 mouse embryonic stem cells were obtained from Trott, *et al.*[18] as an Excel spreadsheet containing qPCR readouts for eight pluripotency factors and one housekeeping gene. The expression of each gene was first adjusted by adding the minimum expression over all genes, 0.0217, and subsequently normalized by dividing by the expression of the gene *Gapdh* on a cell-wise basis.

Two cells were excluded due to the presence of missing data for some factors, and two additional cells were removed because they were thought to be outliers. The remaining 83 cells were subdivided into a Nanog+ compartment (*N*=20), defined as the 20 cells with the highest Nanog expression, and for which no Fgf5 expression was detected, and the complementary Nanog- compartment (*N*=63). The cells were separately divided into a Fgf5+ (*N*=15) compartment, for which Fgf5 expression was detected, and a Fgf5- (*N*=68) compartment with no Fgf5 expression.

Correlation networks were computed using Pearson correlation of the normalized data without any log transformation, and with a significance cutoff of 0.05.

## Authors’ information

Justin Feigelman is a doctoral candidate at the Technische Universität München and the Helmholtz Zentrum München für Gesundheit und Umwelt (HMGU). Carsten Marr is group leader of Quantitative Single Cell Dynamics at HMGU. Fabian J. Theis is Director of the Institute of Computational Biology at HMGU and Professor at the Technische Universität München.

## Declarations

### Acknowledgements

We would like to acknowledge Michael Schwarzfischer, Michael Strasser, Jan Krumsiek, Philipp Angerer, Florian Buettner, Ivo Sbalzarini, Timm Schroeder and Adam Filipzyck for valuable discussions and feedback, and Jamie Trott and Alfonso Martinez-Arias for providing transcriptomic data. Funding was provided by the European Research Council (starting grant LatentCauses), and the Deutsche Forschungsgemeinschaft (SPP 1356 Pluripotency and Cellular Reprogramming).

## Authors’ Affiliations

## References

- Chambers I, Silva J, Colby D, Nichols J, Nijmeijer B: Nanog safeguards pluripotency and mediates germline development. Nature. 2007, 450 (7173): 1230-1234. 10.1038/nature06403.View ArticlePubMedGoogle Scholar
- Narsinh KH, Sun N, Sanchez-Freire V, Lee AS, Almeida P, Hu S, Jan T, Wilson KD, Leong D, Rosenberg J, Yao M, Robbins RC, Wu JC: Single cell transcriptional profiling reveals heterogeneity of human induced pluripotent stem cells. J Clin Invest. 2011, 121 (3): 1217-1221. 10.1172/JCI44635.View ArticlePubMed CentralPubMedGoogle Scholar
- Tischler J, Surani MA: Investigating transcriptional states at single-cell-resolution. Curr Opin Biotechnol. 2012, 24 (1): 69-78.View ArticlePubMedGoogle Scholar
- Rubakhin SS, Lanni EJ, Sweedler JV: Progress toward single cell metabolomics. Curr Opin Biotechnol. 2013, 24 (1): 95-104. 10.1016/j.copbio.2012.10.021.View ArticlePubMed CentralPubMedGoogle Scholar
- Mayle A, Luo M, Jeong M, Goodell MA: Flow cytometry analysis of murine hematopoietic stem cells. Cytometry. 2012, 83A (1): 27-37.View ArticleGoogle Scholar
- Martinez-Arias A, Brickman JM: Gene expression heterogeneities in embryonic stem cell populations origin and function. Curr Opin Cell Biol. 2011, 23 (6): 650-656. 10.1016/j.ceb.2011.09.007.View ArticlePubMedGoogle Scholar
- Chang HH, Hemberg M, Barahona M, Ingber DE, Huang S: Transcriptome-wide noise controls lineage choice in mammalian progenitor cells. Nature. 2008, 453 (7194): 544-547. 10.1038/nature06965.View ArticlePubMedGoogle Scholar
- Murphy RF: Automated identification of subpopulations in flow cytometric list mode data using cluster analysis. Cytometry. 1985, 6 (4): 302-309. 10.1002/cyto.990060405.View ArticlePubMedGoogle Scholar
- Lugli E, Roederer M, Cossarizza A: Data analysis in flow cytometry: the future just started. Cytometry. 2010, 77A (7): 705-713. 10.1002/cyto.a.20901.View ArticleGoogle Scholar
- Bashashati A, Brinkman RR: A survey of flow cytometry data analysis methods. Adv Bioinform. 2009, 2009 (1): 1-19.View ArticleGoogle Scholar
- Goil S, Nagesh H, Choudhary A: MAFIA: Efficient and scalable subspace clustering for very large data sets. Proceedings of the 5th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1999, 443-452.Google Scholar
- Tung AK, Xu X, Ooi BC: Curler: finding and visualizing nonlinear correlation clusters. Proceedings of the 2005 ACM SIGMOD international conference on Management of data. 2005, 467-478.View ArticleGoogle Scholar
- Yang J, Wang W, Wang H, Yu P:
*δ*-clusters: Capturing subspace correlation in a large data set. Proceedings of the 18th International Conference on Data Engineering. 2002, 517-528.View ArticleGoogle Scholar - Cheng C-H, Fu AW, Zhang Y: Entropy-based subspace clustering for mining numerical data. Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining. 1999, 84-93.View ArticleGoogle Scholar
- Li G-W, Xie XS: Central dogma at the single-molecule level in living cells. Nature. 2011, 475 (7356): 308-315. 10.1038/nature10315.View ArticlePubMed CentralPubMedGoogle Scholar
- MacArthur BD, Ma’ayan A, Lemischka IR: Systems biology of stem cell fate and cellular reprogramming. Nat Rev Mol Cell Biol. 2009, 10 (10): 672-681.PubMed CentralPubMedGoogle Scholar
- Glauche I, Herberg M: Nanog variability and pluripotency regulation of embryonic stem cells-insights from a mathematical model analysis. PLoS One. 2010, 5 (6): 11238-10.1371/journal.pone.0011238.View ArticleGoogle Scholar
- Trott J, Hayashi K, Surani A, Babu MM, Martinez-Arias A: Dissecting ensemble networks in ES cell populations reveals micro-heterogeneity underlying pluripotency. Mol Biosyst. 2012, 8 (3): 744-752.l. 10.1039/c1mb05398a.View ArticlePubMedGoogle Scholar
- Hayashi K, Lopes SMCdS, Tang F, Surani MA: Dynamic equilibrium and heterogeneity of mouse pluripotent stem cells with distinct functional and epigenetic states. Cell Stem cell. 2008, 3 (4): 391-401. 10.1016/j.stem.2008.07.027.View ArticlePubMedGoogle Scholar
- Shi W, Wang H, Pan G, Geng Y, Guo Y, Pei D: Regulation of the Pluripotency Marker Rex-1 by Nanog and Sox2. J Biol Chem. 2006, 281 (33): 23319-23325. 10.1074/jbc.M601811200.View ArticlePubMedGoogle Scholar
- Karwacki-Neisius V, Göke J, Osorno R, Halbritter F, Ng JH, Weiße AY, Wong FCK, Gagliardi A, Mullin NP, Festuccia N, Colby D, Tomlinson SR, Ng H-H, Chambers I: Reduced oct4 expression directs a robust pluripotent state with distinct signaling activity and increased enhancer occupancy by oct4 and nanog. Cell Stem Cell. 2013, 12 (5): 531-545. 10.1016/j.stem.2013.04.023.View ArticlePubMed CentralPubMedGoogle Scholar
- Raj A, van Oudenaarden A: Nature, nurture, or chance: stochastic gene expression and its consequences. Cell. 2008, 135 (2): 216-226. 10.1016/j.cell.2008.09.050.View ArticlePubMed CentralPubMedGoogle Scholar
- Marcus JS, Anderson WF, Quake SR: Microfluidic single-cell mRNA isolation and analysis. Anal Chem. 2006, 78 (9): 3084-3089. 10.1021/ac0519460.View ArticlePubMedGoogle Scholar
- Kalisky T, Blainey P, Quake SR: Genomic analysis at the single-cell level. Annu Rev Genet. 2011, 45 (1): 431-445. 10.1146/annurev-genet-102209-163607.View ArticlePubMedGoogle Scholar
- Bandura DR, Baranov VI, Ornatsky OI, Antonov A, Kinach R, Lou X, Pavlov S, Vorobiev S, Dick JE, Tanner SD: Mass cytometry: technique for real time single cell multitarget immunoassay based on inductively coupled plasma time-of-flight mass spectrometry. Anal Chem. 2009, 81 (16): 6813-6822. 10.1021/ac901049w.View ArticlePubMedGoogle Scholar
- Bajikar SS, Fuchs C, Roller A, Theis FJ, Janes KA: Parameterizing cell-to-cell regulatory heterogeneities via stochastic transcriptional profiles. Proc Natl Acad Sci. 2014, 111 (5): 626-35. 10.1073/pnas.1311647111.View ArticleGoogle Scholar
- Wu J, Tzanakakis ES: Biotechnology advances. Biotechnol Adv. 2013, 31 (7): 1047-1062. 10.1016/j.biotechadv.2013.09.001.View ArticlePubMed CentralPubMedGoogle Scholar
- Hensel Z, Feng H, Han B, Hatem C, Wang J, Xiao J: Stochastic expression dynamics of a transcription factor revealed by single-molecule noise analysis. Nat Struct Mol Biol. 2012, 19 (8): 797-802. 10.1038/nsmb.2336.View ArticlePubMedGoogle Scholar
- Moignard V, Macaulay IC, Swiers G, Buettner F, Schütte J, Calero-Nieto FJ, Kinston S, Joshi A, Hannah R, Theis FJ, Jacobsen SE, de Bruijn MF, Gottgens B: Characterization of transcriptional networks in blood stem and progenitor cells using high-throughput single-cell gene expression analysis. Nat Cell Biol. 2013, 15 (4): 363-372. 10.1038/ncb2709.View ArticlePubMed CentralPubMedGoogle Scholar
- Hulett HR, Bonner WA, Barrett J, Herzenberg LA: Cell sorting: automated separation of mammalian cells as a function of intracellular fluorescence. Science. 1969, 166 (3906): 747-749. 10.1126/science.166.3906.747.View ArticlePubMedGoogle Scholar
- Tomer A, Harker LA, Burstein SA: Purification of human megakaryocytes by fluorescence-activated cell sorting. Blood. 1987, 70 (6): 1735-1742.PubMedGoogle Scholar
- Malatesta P, Hartfuss E, Götz M: Isolation of radial glial cells by fluorescent-activated cell sorting reveals a neuronal lineage. Development. 2000, 127 (24): 5253-5263.PubMedGoogle Scholar
- Abdi H, Williams LJ: Principal component analysis. Wiley Interdiscip Rev: Comput Stat. 2010, 2 (4): 433-459. 10.1002/wics.101.View ArticleGoogle Scholar
- Buettner F, Theis FJ: A novel approach for resolving differences in single-cell gene expression patterns from zygote to blastocyst. Bioinformatics. 2012, 28 (18): 626-632. 10.1093/bioinformatics/bts385.View ArticleGoogle Scholar
- Chen YA, Almeida JS, Richards AJ, Müller P, Carroll RJ, Rohrer B: A nonparametric approach to detect nonlinear correlation in gene expression. J Comput Graphical Stat: Joint Publication Am Stat Assoc Inst Math Stat Interface Foundation N Am. 2010, 19 (3): 552-568.View ArticleGoogle Scholar
- Tjøstheim D, Hufthammer KO: Local Gaussian correlation: a new measure of dependence. J Econometrics. 2013, 172 (1): 33-48. 10.1016/j.jeconom.2012.08.001.View ArticleGoogle Scholar
- Cordeiro RLF, Traina AJM, Faloutsos C, Traina C: Halite: fast and scalable multiresolution local-correlation clustering. IEEE Trans Knowl Data Eng. 25 (2): 387-401.Google Scholar
- Schäfer J, Strimmer K: A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics. Stat Appl Genet Mol Biol. 2005, 4 (1): 1-32.Google Scholar
- Kendall MG: Rank correlation methods. 1948, Oxford, England: GriffinGoogle Scholar
- Gardiner CW: Stochastic methods: a handbook for the natural and social sciences. 2009, Berlin, Germany: SpringerGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.