 Methodology article
 Open Access
 Published:
Evaluation of fecal mRNA reproducibility via a marginal transformed mixture modeling approach
BMC Bioinformatics volume 11, Article number: 13 (2010)
Abstract
Background
Developing and evaluating new technology that enables researchers to recover geneexpression levels of colonic cells from fecal samples could be key to a noninvasive screening tool for early detection of colon cancer. The current study, to the best of our knowledge, is the first to investigate and report the reproducibility of fecal microarray data. Using the intraclass correlation coefficient (ICC) as a measure of reproducibility and the preliminary analysis of fecal and mucosal data, we assessed the reliability of mixture density estimation and the reproducibility of fecal microarray data. Using Monte Carlobased methods, we explored whether ICC values should be modeled as a betamixture or transformed first and fitted with a normalmixture. We used outcomes from bootstrapped goodnessoffit tests to determine which approach is less sensitive toward potential violation of distributional assumptions.
Results
The graphical examination of both the distributions of ICC and probittransformed ICC (PTICC) clearly shows that there are two components in the distributions. For ICC measurements, which are between 0 and 1, the practice in literature has been to assume that the data points are from a betamixture distribution. Nevertheless, in our study we show that the use of a normalmixture modeling approach on PTICC could provide superior performance.
Conclusions
When modeling ICC values of gene expression levels, using mixture of normals in the probittransformed (PT) scale is less sensitive toward model misspecification than using mixture of betas. We show that a biased conclusion could be made if we follow the traditional approach and model the two sets of ICC values using the mixture of betas directly. The problematic estimation arises from the sensitivity of betamixtures toward model misspecification, particularly when there are observations in the neighborhood of the the boundary points, 0 or 1. Since betamixture modeling is commonly used in approximating the distribution of measurements between 0 and 1, our findings have important implications beyond the findings of the current study. By using the normalmixture approach on PTICC, we observed the quality of reproducible genes in fecal array data to be comparable to those in mucosal arrays.
Background
Microarray techniques have changed the practice of detecting messenger RNA (mRNA) expression of a single gene to the current stage of simultaneously measuring the expression of thousands of genes. Daily improvement in this technology also stimulates techniques that lead to new bioassays. Among them, and of particular interest, is a recent development that enables the collection of genomic information from exfoliated colonocytes in fecal matter. It is known that early detection of cancerous colon cells results in high cure and survival rates among colon cancer patients. However, people tend to shy away from invasive procedures such as the colonoscopy. Consequently, it is of great interest to develop noninvasive early detection instruments. Although evidence exists in the fecal platform that partially degraded mRNA in fecal samples can produce meaningful measurements[1], and Davidson et al. [2] and Kanaoka et al. [3] suggest that it is possible to isolate intact fecal eukaryotic mRNA, it is unknown whether one can expect the same quality from the large amount of fecal microarray data. The current study, to the best of our knowledge, is the first one that investigates and reports the reproducibility of fecal microarray data. In a proofofprinciple study conducted by human nutrition scientists at Texas A&M University, one main task is to find out whether one can expect the same level of reproducibility in the fecal platform as that observed in the mucosal platform where biological samples were taken from colon cells. Because of biological variation, two gene expression values of the same gene taken from the same subject are most likely not the same. In order to determine if one can successfully obtain the same findings when an experiment is repeated, it is important to investigate whether the gene expression levels of a gene from the same subject behave more similarly to each other than to those of the same gene from different subjects. The signal is strongest and the reproducibility is highest when the outcomes can be perfectly repeated when a different set of measurements are taken from the same subjects. It is expected that due to mRNA degradation, a larger proportion of genes in the fecal platform would possess no or lower reproducibility than those in the mucosal platform. However, it is of interest to understand the quality of those genes which are not degraded in the fecal platform.
Generally, replicates are samples collected from the same subject that are processed separately and independently after sample collection. Our replicates differ because the "same" biological samples are separately processed only right before the hybridization. The former "replicates" are often collected to evaluate the quality of microarray techniques, while we are truly interested in biological reproducibility at the subject level. This subtle difference is particularly important; some genes could be preserved in one sample but are degraded in another even when both samples are from the same subject. It is the genes with low possibility to be degraded that we are interested in. While we focus only on subject to subject variation, we acknowledge that there are other types of replication in gene expression data[4].
In order to assess the agreement between measurements from microarray data collected from the same subject, we use the intraclass correlation coefficient (ICC) as a reliability index. The use of ICC in genomic study was promoted by Carrasco and Jover[5].
Under each platform, we compute a single ICC value for each gene. One key advantage of ICC as a statistical tool for evaluating reproducibility for different platforms/instruments is that it does not require two platforms/instruments to be evaluated under the same treatment design. In most biological experiments, researchers tend to conduct the second experiment with modifications and improvements rather than simply to repeat what has been done before. Consequently, a statistical tool for evaluating reproducibility has to have the flexibility to accommodate this common practice. In order to fulfill this requirement, the ICC values were computed after removing the treatment effects. The single index recorded per gene uses variance components analysis to compare the measurementsimilarity for samples taken from the same subject/rat versus the measurementsimilarity for samples taken from different subjects/rats. We report the methodology for calculating ICC in the Methods subsection.
The larger the value of ICC, the more differentiation among measurements collected from different biological samples relative to that among readings collected from the same biological material. An ICC value near 1 signifies a strong indication of reproducibility and agreement between experiments. If the ICC is near 0, then withinsubject variance is relatively large compared to betweensubject variance and it is likely that one cannot obtain the same expression level in a repeated experiment.
In both the mucosal and the fecal genes, we observe at least a small proportion of genes that always have low reproducibility; their existence results in a mixture model for the distribution of ICC values. It is common practice to use finite mixture modeling in bioinformatics research. The reasons tend to be twofold: to accommodate measurement heterogeneity and to identify potentially meaningful subgroups. The most popular approach is the use of finite normal mixtures [6–9]. Allison et al. and Ji et al. use betamixture modeling to describe distributional properties of different genes' correlation coefficients[10, 11]. Like measurements of ICC, the values of correlation coefficients are between 0 and 1. For the same type of data, McLachlan et al. prefer the use of normalmixture distributions which eliminates the (0,1)range constraint[8].
In a study comparing the fecal and mucosal bioassay platforms, we obtained different proportions for the mixture components when we modeled the probit transformed ICC (PTICC) values with a twocomponent normalmixture distribution and when we modeled the ICC values with a twocomponent betamixture distribution. It was our conjecture that, considering the boundary problem of beta distribution modeling, the normalmixture modeling might be less sensitive toward model misspecification. We observed the lower component of the beta mixture to be strictly decreasing with the density f(yα,β) approaching infinity as y approaches 0. This phenomenon likely caused the maximum likelihood estimate (MLE) of βparameters to be unstable. We conduct a sequence of numerical studies to compare the two approaches.
Our ultimate goal is to select the better of the two systems to ascertain whether the "reproducible" component in the fecal array samples share similar properties to those of the mucosal array samples.
Results
Data sets
Gene expression levels from the colon mucosal and fecal data samples were collected using CodeLink microarrays (30 oligonucleotide target probe, single color labeling system). The main dataset under study here consisted of 2171 genes for the fecal data and 2241 genes for the mucosal data. Due to the fact that the bioassays that were used to extract fecal mRNA were developed later, the mucosal data we used were collected much earlier in a different experiment. In fact, we did not have access to the original muscosal dataset. We were able to use the available summary statistics to produce ICC measurements. All measurements (fecal and mucosal) were collected from Spraque Dawley rats.
Fecal Data
The fecal array data were collected from rat fecal samples in a study designed to explore the effect that diet has on genes being differentially expressed after exposure to carcinogen/radiation. A normalization procedure was developed[12]. Rats in the study were exposed to carcinogen azoxymethane (AOM) and randomly assigned to one of four different treatments resulting from a 2 × 2 factorial design. The two experimental factors were diet  fish oil/pectin (D1) and corn oil/cellulose (D2), and radiation  with radiation exposure (IRT) and without radiation exposure (RCT). Fecal samples were collected 14 weeks after the last exposure to carcinogen AOM. There were 7, 6, 8, and 7 bioarrays collected under IRTD1, IRTD2, RCTD1, and RCTD2, respectively. Genes that were not disqualified with at least 3 usable replicates were kept.
Mucosal Data
Rats used in the study to obtain mucosal array data were randomly assigned in a 3 × 2 × 2 factorial experiment to a treatment with diet, exposure, and time points as factors[13]. Corn oil/n6 polyunsaturated fatty acid (PUFA) or fish oil/n3 PUFA or olive oil/n9 monounsaturated fatty acid (MUFA) was used as the dietary fat source; carcinogen AOM or saline was used as the exposure source; time points were either 12 hours or 10 weeks after the first injection. The units were terminated at the appropriate time point in order to remove the mucosal layer from each colon so that RNA could be extracted from the mucosal samples. The numbers of arrays for corn, fish, and olive oil diets under AOM or saline treatments were (7, 7, 6) and (7, 6, 7), respectively for the 12hour study and were (12, 10, 8) and (7, 9, 7), respectively for the 10week study.
Matched Subset
To address the issue of reproducibility for a finite list of common genes between the platforms, we conducted an additional study referred to as the "matched subset" throughout. We were able to retrieve the NCBI gene information from the mucosal experiments and used them to create a matched subset in which the two subsets (fecal and mucosal) were collected from the same genes. Each subset contains 1029 measurements.
Preliminary Application to the Main Dataset
The original ICC values were fitted with a twocomponent betamixture using an EM algorithm, producing the following density estimation for the fecal and mucosal data, and , respectively:
and
We obtained the following estimated twocomponent normalmixture densities, and , for the probit transformed fecal and mucosal ICC measurements, respectively:
and
The observation of the difference in proportion estimates for fecal and mucosal data leads us to question the accuracy of the two fits. It is unclear what the proportion of reproducible genes (upper component of the two mixtures) for the fecal samples should be, 0.50 or 0.72? Unfortunately, the answer to this question depends on the mixture model we use to fit the data. It is well known that when α < 1 (β < 1), values of the beta distribution strictly increase to infinity at the lower (upper) endpoint. We find α is much smaller than 1 with the lower components of the beta mixtures for both datasets. This phenomenon is easily seen in the graphs displayed in Figure 1 where we plot the fitted betamixture superimposed on the histogram of ICC values for the fecal and mucosal data. Because the beta distribution has such a boundary issue, we suspect that a simple violation of the distributional assumption near the boundary could have profound effects on maximum likelihood estimates. In comparison, the fitted normalmixture superimposed on the histogram of PTICC values is plotted in Figure 2. It is worth noting that the visual evaluation of Figures 1 and 2 might not be helpful to the comparisons of these two modeling approaches. We investigate the veracity of the comparisons with numerical studies. In light of the numerical outcomes from our Monte Carlo investigation, we plotted three estimated density functions in Figure 3. The solid curves in each plot of Figure 3 provide the kernel estimated density functions of the fecal and mucosal PTICC values. The estimated density functions based on the normalmixture models are given by the dashed lines. Finally, the estimated density function calculated using the transformation theory gave the estimated density functions of PTICC values shown by the dotted lines. Even though not perfectly, the kernel density estimates and the normalmixture based estimates correspond roughly well with each other. However, the transformed betamixture based density estimates misfit the lower mixture component for the mucosal data. For fecal data, this approach almost concluded that there was a single component  a feature which could not be clearly seen in Figure 1.
Monte Carlo Assessments
To investigate the sensitivity of each of the two mixture modeling approaches to distributional misspecification, we conduct Monte Carlo simulation studies to mimic what we observed in the fecal and mucosal microarray data sets. Simulation for the fecal data is described as follows:
Simulation scenario #1: Data Generated from Betamixtures, Fit with Normalmixtures
(1) Generate Y_{1}, ..., Y_{ n }from = 0.7 Beta(2.6, 1.7) + 0.3 Beta(0.2, 0.8).
(2) Transform Y_{1}, ..., Y_{ n }using the probit transformation and fit the PTICC measurements with a twocomponent normalmixture model.
Simulation scenario #2: Data Generated from Normalmixtures, Fit with Betamixtures
(1) Generate X_{1}, ..., X_{ n }from = 0.7 N (0.04, 0.8) + 0.3 N (3.5, 0.07).
(2) Transform X_{1}, ..., X_{ n }using the inverse probit transformation and fit the ICC data with a twocomponent betamixture model.
We repeated each simulation s = 250 times for sample size n = 1600 and used the EM algorithm to obtain the estimates of corresponding parameters. The steps above were repeated for the mucosal dataset where the beta random variables were generated from = 0.8 Beta(2.3, 2.3) + 0.2 Beta(0.3, 1.3) and the normal random variables were generated from = 0.8 N (0.3, 0.6) + 0.2 N (3.3, 0.1).
We could not compare the outcomes of simulations #1 and #2 directly when the estimated parameters were for normalmixtures and betamixtures, respectively. To ease the comparisons, we chose to transform the resulting estimates in simulation #2 so that the outcomes correspond to means and variances of distributions that would give observations on the whole real line, and then produced the Monte Carlo statistics corresponding to the two components. Summary statistics for simulation scenarios #1 and #2 are presented in Tables 1 and 2, respectively. We identified the targeted parameter values in each scenario as "Truth" and reported the Monte Carlo mean, bias, standard deviation, and squareroot of mean squared error (RMSE) of the estimates. When comparing the true parameters with the estimates obtained from the fit of the assumed distribution, we find that summary statistics from fitting transformed normal random variables with a betamixture closely resemble the phenomenon observed when analyzing the fecal and mucosal data. Namely, it is the case that although the true proportions for the upper components of the fecal and mucosal data are 0.7 and 0.8, respectively, estimates of π_{ U }resulting from the fit of twocomponent beta distribution average 0.5. In contrast, modeling the simulated PTICC by normalmixtures when the ICC values were generated from the betamixtures, as described in simulation scenario #1, is much less sensitive toward the distributional misspecification. This led us to believe that the use of the twocomponent normalmixture model on PTICC is the more reliable approach of the two. We further analyzed the simulated outcomes and compared the sensitivity of each modeling approach toward distributional misspecification through performing goodnessoffit tests against assumed models.
Precisely, for each simulated data set, we let the null hypothesis, H_{0}, be that the observed ICC (or PTICC) values were from the assumed model. We then compared the observed and expected counts of observations within K bins, where K = 5, 8, and 12, using Pearson's chisquare goodnessoffit test with significance level α = 0.05 and k  1 degrees of freedom. The exact procedure of the test is described in the Methods subsection. Analysis of goodnessoffit test statistics resulting from the simulation studies are given in Table 3. Ideally, if the H_{0} was true, there should be no more than 5% chance to reject the H_{0} when α = 0.05. Except when K = 5, the proportions of tests that rejected H_{0} with normalmixture modeling are all less than the nominal level of 0.05. Further, in all cases, the outcomes obtained by normalmixture modeling were comparable between the two (assumed) true underlying distributions. The same did not hold for betamixture modeling. When the data were not generated according to the betamixture scheme, the goodnessoffit tests were rejected close to or equal to 100% throughout. That is, the best fits of betamixtures still could not provide sufficiently close approximations that could pass the goodnessoffit tests under simulation scenario #1.
ICC Comparisons of Fecal and Mucosal Data
Since our findings from the simulation studies suggested that we use a twocomponent normalmixture to fit the probit transformed ICC values, we adopted this strategy and utilized it to compare reproducibility under the fecal and mucosal array platforms. We associate the two components of high (and low) ICC values with reproducible (and irreproducible) genes; see the Discussion subsection for more considerations.
We also let, for the fecal and mucosal data, π_{ LF }and π_{ LM }be the proportions of the mixture components consisting of irreproducible genes, and μ_{ UF }and μ_{ UM }be the means of the mixture component with higher ICC values. We reported two main studies that were conducted for the purpose of exploring the extent of the distributional differences between the two platforms. Throughout, we used bootstrap methods described in the Methods subsection. The first bootstrap analysis is designed to find the 95% confidence interval for the difference in the proportion of irreproducible genes contained in each data set, π_{ LF } π_{ LM }. In the second analysis, we identify the 95% confidence interval for the average difference in the mixture components with higher ICC values, μ_{ UF } μ_{ UM }. The bootstrapped 95% confidence intervals for the two studies were (0.06,0.10) for π_{ LF } π_{ LM }, and (0.27,0.40) for μ_{ UF } μ_{ UM }. As a result, we concluded that while the fecal array had a higher proportion of irreproducible genes, its average ICC values for the reproducible component of genes was a little higher than that obtained from the mucosal platform.
Outcomes for Analysis of Matched Subset
We now repeat the numerical investigation above but replace the main dataset by the matched subset in which fecal and mucosal measurements were collected from the same genes. The ICC measurements from the matched subset were fitted with a twocomponent betamixture using an EM algorithm, producing the following density estimation for the fecal and mucosal data, and , respectively:
and
where the additional upper index "s" stands for "subset." We also obtained the following estimated twocomponent normalmixture densities, and , for the probit transformed fecal and mucosal ICC measurements from the matched subset, respectively:
and
There were two immediate observations from this substudy. First, even though the proportions of two components differ from those in the main study, for the PTICC values, the estimated parameters correspond fairly well to those from the main study. That is, we obtained almost the same lower and upper components in the normalmixture modeling as in the main study. On the other hand, the estimated parameter values changed quite dramatically for the betamixture modeling. Second, for the mucosal subset, the estimated proportions for the two approaches are almost identical whether the data was fitted by a betamixture or a normalmixture. In fact, by producing a figure equivalent to Figure 3, in Figure 4 we note that the two estimation procedures reach the same conclusion for this estimation (see Figure 4(b)). However, the outcomes produced by betamixture modeling remains to be unsatisfactory for the fecal samples. We also obtained the bootstrapped 95% confidence intervals for and , where the parameters were equivalently defined as in the main study. The two 95% confidence intervals were (0.02, 0.31) and (0.31, 0.63), respectively. They further confirm that, for this matched subset, while the fecal array had a higher proportion of irreproducible genes, its average ICC values for the reproducible component of genes was a little higher than that obtained from mucosal samples.
Discussion
There are a few points worth making here. The key problem behind the instability of betamixture modeling is that one might attempt to estimate the worst component of the mixture distribution with a small proportion of data observed on the boundary. The specifics of simulation scenarios #1 and #2 were based on our analysis of the original subset of ICC values. We expect the same difficulties would be encountered in the betamixture modeling if we have a high density of ICC values close to 1 at the upper component. To investigate this conjecture, we conducted an additional simulation study and report the outcomes in the "Additional File 1." We found that the betamixture less accurately fit the transformed normal data when the mixture had a high density of values near 1. However, the betamixture had no problems fitting transformed normal data resulting from a betamixture with no asymptotes at the boundary. There was less distinction between the quality of the fits when the normalmixture was used to fit PTICC data. Again, suggesting that twocomponent normalmixture modeling on PTICC is a more reliable approach.
Although it is not obvious to interpret the meaning of the estimated parameters, from the normal mixture modeling in Figures 3 and 4, the cutoff between the two mixture components is around 2. This roughly corresponds to the scenario of an ICC = 5%. By pure randomness, even though the true correlation could be zero, one could observe a nonzero sample correlation of 5% or less. From our numerical analyses on the fecal microarray data, the proportion of ICC values less than 5% range from 20% to 28%. The proportion of genes with ICC values less than 5% for the fecal and mucosal samples are 25% and 20%, respectively in the main study, and are 22% and 18%, respectively for the matched study. These numbers again match better with the outcomes from the normalmixture modeling.
Finally, we conducted another simulation study using the estimated parameters from the matched subset. The exact setup and outcomes are reported in "Additional File 2." For the mucosal subset of ICC values, we find equivalent results between the betamixture approach and the normalmixture approach. However, results from the simulation study show unsatisfactory performances under the scenario of "Data Generated from Normalmixtures, Fit with Betamixtures". Our mucosal matched subset is most likely betamixture distributed.
Conclusion
In this study we have demonstrated that when analyzing ICC values of gene expression levels, it is a better strategy to first probittransform the ICC values onto the (8, 8) domain and then to model the PTICC values with a normalmixture model. Through this practice, we were able to obtain outcomes that were less sensitive toward distributional assumptions. We avoided the problem of estimating parameters for a beta distribution which increases to infinity at the boundary. Our investigations suggested that even though there tended to be a higher proportion of genes that had low reproducibility in the fecal array data than in the mucosal array data, the average ICC values for those genes which possessed relatively high ICC values in the fecal data was even a bit higher than the corresponding average observed in the mucosal platform. We also note that the probit transformation strategy enables us to easily adopt the mixture of normal modeling approach that can be carried out by MCLUST packages in R or Splus.
Methods
Obtaining ICC Values for Genes on a Microarray Chip
We define a data observation, , to be the gene expression level for gene g, subject i, treatment j, and array k. The model for is given by
for i = 1, 2, ..., I, j = 1, 2, ..., J, and k = 1, 2, ..., K_{ ij }. This describes a microarray experiment where we consider I subjects, J treatments, and K_{ ij }arrays for subject i under treatment j. Also, μ_{ j } is the overall mean for the j^{th}treatment, is the random effect due to the different subjects, and is the i.i.d random error. The ICC value for gene g, ICC_{ g }, is characterized as
where G is the number of genes.
The Probit Transformation
The probit function[14] is the inverse cumulative distribution function (CDF) of the standard normal distribution. The CDF of the standard normal distribution is often denoted by Φ(z), where z ∈ (∞, ∞) and the range is (0,1). Specifically,
For X in the range of (0,1), the probit transformed values, Y, of X, are defined as Y = Φ^{1}(X), thereby converting (0,1) values to the real line.
Twocomponent mixture models
The numerical investigations of ICC and PTICC values clearly show that the data comes from a mixture of two populations. When data is modeled by a mixture of two distributions we postulate it as though an observation comes from distribution 1 with probability p and from distribution 2 with probability 1  π .
We define Z_{ i }, a random indicator variable of the i th observation, as
Let W_{ i }denote the i th observation from the mixture distribution, and assume that
where f_{1} and f_{2} are the probability density functions of distributions 1 and 2, respectively. The joint distribution of (W,Z) is f(w, z) = f(wz)f(z) and the marginal distribution of W is
That is, for observations {W_{ i }i = 1, ..., n}, the likelihood function is
Parameter estimation using expectationmaximization (EM) algorithm
The expectationmaximization (EM) algorithm[15] is an iterative approach for estimation of incomplete data problems. Given starting values of the model parameters, the EM algorithm iteratively updates the estimates until a specified convergence is reached.
Mixture of Betas
Ji et al. [11] advocate modeling correlation coefficients with betamixtures and outline the subsequent EM algorithm. Suppose y_{1}, . . . y_{ n }are n independent observations from f_{ Y }(yθ_{ B }), where f_{ Y }is the density of a beta distribution and θ_{ B }= (π, α_{1}, α_{2}, β_{1}, β_{2}). Let the random vector X = (Z, Y) = {z_{ i }, y_{ i }}, where z_{ i } is a 01 indicator variable that tells which distribution, the first or the second, the i th observation comes from.
In the algorithm, we iteratively perform the "E" and "M" steps with the 'complete' data likelihood function, L(θ_{ B }y_{ i }), for θ_{ B }being
and the corresponding loglikelihood being
In the Estep, z is updated with its conditional expectation given the observed data y. Consequently,
where the superindex, k, denotes the estimates at the k th iteration.
In the Mstep of the EM algorithm, we use to estimate the mixing proportion, where
and obtain the maximum likelihood estimates of , , , and accordingly. The E and Msteps are iterated until the convergence criteria is met.
The starting values for α_{1}, α_{2}, β_{1}, and β_{2} were set to 0.01 and {z_{ i }} was initialized by setting one half of the indicator variables equal to 0 and the other half equal to 1 so that = 0.50. We utilized the 'optim' function in R to obtain parameter estimates for the two beta density functions. The procedure was repeated until we observed a negligible change in the value of the loglikelihood given in (7).
Mixture of Normals
Let x_{1}, ..., x_{ n }be n iid observations from f_{ X }(xθ_{ N }), where f_{ X }is the density of a normal distribution and . In order to estimate the parameters for a twocomponent normal mixture, we use the MCLUST software package for R[16]. MCLUST implements the EM algorithm, equivalent to what what was described for the mixture of betas to carry out the computations of a maximum likelihood approach for normalmixture models. For model selection, MCLUST determines the number of clusters and the clustering model by maximizing the Bayesian Information Criterion (BIC)[17]. See[16, 18] for more details regarding the MCLUST software package.
Distribution of transformed random variables
Generate from Beta, Fit with Normal
Let Y be a random observation from a twocomponent betamixture model with the density function f_{ B }given by
where 0 < π < 1 and
is the beta density function with shape parameters α_{ i }, β_{ i }, for i = 1, 2. Transform the observations using the probit transformation by letting X = g(Y) and g(·) = Φ^{1}(·). Then the range of X becomes (∞, ∞) and its density function is given by the expression
Generate from Normal, Fit with Beta
Let X be a random variable from a twocomponent normalmixture model with the density function f_{ N }given by
where 0 < π < 1 and φ (x; μ_{ i }, ) is the density function of normal random variable with mean μ_{ i }and variance , i = 1, 2. We define the inverse probit transformation as Y = Φ (X). The density function of Y is given by
Chisquare goodness of fit
Let X_{1}, ..., X_{ n }be an observed dataset. We divide the range of the data into k bins. By comparing the number of observations that fall into a given bin with the expected number of observations for that bin, we are able to use the Pearson's chisquare, χ^{2}, goodnessoffit test to assess how well the proposed distribution fits the observed data. The χ^{2} statistic for testing the null hypothesis H_{0}: The data follow the specified distribution, is
where O_{ i }and E_{ i }are the observed and expected, respectively frequencies for bin i.
To ensure that the expected frequency count is never zero at the tails, we let the first and the last bins to be {xx < X_{(0.025)}} and {xx = X_{(0.975)}}, respectively where X_{(0.025)} and X_{(0.975)} are the 2.5th and 97.5th percentiles of the data rounded up and down to the nearest whole numbers. The equal distance bins correspond to the disjoint intervals in between.
If a dataset is fit with a mixture of normal distributions, then the density function defined in (10) is used to determine the expected frequencies. Likewise, we use (9) to calculate expected frequencies when a dataset is fit with a mixture of betas.
Bootstrap Analysis
We apply bootstrap techniques[19] in order to construct confidence intervals for assessing distributional differences between the fecal and mucosal array platforms. Let π_{ LF } and π_{ LM } be the proportion of irreproducible genes for the fecal and mucosal datasets. The procedure to construct a bootstrap confidence interval for π_{ LF } π_{ LM }is as follows:

1.
Generate bootstrap samples of size n_{1} and n_{2} by sampling with replacement from the original n_{1} observations of fecal and n_{2} observations of mucosal ICC values.

2.
Use MCLUST to estimate the parameters of a twocomponent normalmixture fitted to each bootstrap sample.

3.
Compute .

4.
Repeat steps 1 through 3 for I = 299 times, computing .
Once the are obtained, a (1  α)% bootstrap confidence interval is defined by , where (α/2) and (1  α/2) are the α/2 and (1  α/2) percentiles of . If we let μ_{ UF }and μ_{ UM }be the means of the reproducible genes for the fecal and mucosal datasets, then the process for constructing a bootstrap confidence interval for μ_{ UF } μ_{ UM }mimics the above procedure, replacing step 3 with "Compute .
References
 1.
Schoor O, Weinschenk T, Hennenlotter J, Corvin S, Stenzl HG, Aand Rammensee, Stevanović S: Moderate degragradation does not preclude micoarray analysis of small amounts of RNA. BioTechniques 2003, 35: 1192–1201.
 2.
Davidson L, Lupton J, Miskovsky E, Fields A, Chapkin R: Quantification of human intestinal gene expression profiles using exfoliated colonocytes: a pilot study. Biomarkers 2003, 8: 51–61. 10.1080/1354750021000042268
 3.
Kanaoka S, I YK, Miura N, Sugimura H, Kajimura M: Potential usefulness of detecting cyclooxygenase 2 messanger RNA in feces for colorctal cancer screening. Gastroenterology 2004, 127: 422–427. 10.1053/j.gastro.2004.05.022
 4.
Nguyen D, Arpat A, Wang N, Carroll R: DNA microarray experiments: biological and technological aspects. Biometrics 2002, 58: 701–717. 10.1111/j.0006341X.2002.00701.x
 5.
Carrasco J, Jover L: Estimating the generalized concordance correlation coefficient through varince components. Biometrics 2002, 59: 849–858. 10.1111/j.0006341X.2003.00099.x
 6.
Pan W, Lin J, Le JT: A mixture model approach to detecting differentially expressed genes with microarray data. Functional & Integrative Genomics 2003, 3: 117–124.
 7.
Dean N, Raftery AE: Normal uniform mixture differential gene expression detection for cDNA microarrays. BMC Bioinformatics 2005, 6: 173–187. 10.1186/147121056173
 8.
McLachlan G, Bean R, BenTovin Jones L: A simple implementation of a normal mixture approach to differential gene expression in multiclass microarrays. Bioinformatics 2006., 22(13): 10.1093/bioinformatics/btl148
 9.
Ghosh D, Chinnaiyan AM: Genomic outlier profile analysis: mixture models, null hypotheses, and nonparametric estimation. Biostatistics 2009, 10: 60–69. 10.1093/biostatistics/kxn015
 10.
Allsion D, Gadbury G, Heo M, Fernandez J, Lee C, Prolla T, Weindruch R: A mixture model approach for the analysis of microarray gene expression data. Computational Statistics and Data Analysis 2002, 39: 1–20. 10.1016/S01679473(01)000469
 11.
Ji Y, Wu C, Liu P, Wang J, Coombes K: Applications of betamixture models in bioinformatics. Bioinformatics 2005, 21(9):2118–2112. 10.1093/bioinformatics/bti318
 12.
Liu L, Wang N, Lupton J, Turner N, Chapkin R, Davidson L: A twostage normalization method for partially degraded mRNA microarray data. Bioinformatics 2005, 21: 4000–4006. 10.1093/bioinformatics/bti661
 13.
Davidson L, Nguyen D, Hokanson R, Callway E, Isett R, Turner N, Dougherty E, Wang N, Lupton J, Carroll R: Chemopreventive n 3 polyunsaturated fatty acids reprogram genetic signatures during colon cancer initiation and progression in the rat. Cancer Research 2004, 64: 6797–684. 10.1158/00085472.CAN041068
 14.
Finney D: Probit Analysis. 3rd edition. Cambridge, UK: Cambridge University Press; 1971.
 15.
Dempster A, Laird N, Rubin D: Maximum likelihood for incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society Series B 1977, 39: 1–38.
 16.
Fraley C, Raftery A: Software for modelbased cluster analysis and discriminant analysis. In Tech Rep 342. University of Washington; 1999.
 17.
Schwartz G: Estimating the dimension of a model. The Annals of Statistics 1978, 6(2):461–464. 10.1214/aos/1176344136
 18.
Fraley C, Raftery A: Modelbased clustering, discriminant analysis, and density estimation. Journal of the American Statistical Association 2002, 97(458):611–631. 10.1198/016214502760047131
 19.
Efron B, Tibshirani R: An Introduction to the Bootstrap. London: Chapman and Hall; 1973.
Acknowledgements
This work is supported by grants from US NCI CA74552, CA59034, CA129444 and NSBRI (NASA NCC 958).
Author information
Affiliations
Corresponding author
Additional information
Authors' contributions
NG and NW performed the statistical investigations and prepared the first draft of the manuscript. JRL and NDT are PI and CoPI, respectively on the grant which resulted in this data set. They were responsible for the design, implementation, and interpretation of the data. RSC's laboratory was responsible for generating the microarrays and LAD was responsible for optimizing the protocol for fecal microarray analysis. All authors read and approved the final version of the manuscript.
Electronic supplementary material
Simulation scenarios #3 and #4
Additional file 1: . These two simulation studie s were designed to show that difficulties would be encountered in a betamixture modeling if we have a high density of ICC values close to 1 at the upper component. Scenario #3 represents such a situation while scenario #4 represents a situation where no asymptote is present. (PDF 97 KB)
Simulation scenario mimicking the matched subset data
Additional file 2: . These simulation studies were designed to evaluate the study of the matched subsets in which fecal and mucosal measurements were collected from the same genes. Throughout, we let the proportions for the "reproducible" mixture component of the fecal and mucosal datasets to be 0.8 and 0.9, respectively. Otherwise, the mixture parameters reflect those obtained from fitted estimates of the matched subset data. (PDF 98 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
George, N.I., Lupton, J.R., Turner, N.D. et al. Evaluation of fecal mRNA reproducibility via a marginal transformed mixture modeling approach. BMC Bioinformatics 11, 13 (2010). https://doi.org/10.1186/147121051113
Received:
Accepted:
Published:
Keywords
 Intraclass Correlation Coefficient
 Beta Distribution
 Mixture Modeling Approach
 High Intraclass Correlation Coefficient
 Estimate Density Function