 Methodology article
 Open Access
 Published:
Sample size calculation based on exact test for assessing differential expression analysis in RNAseq data
BMC Bioinformatics volume 14, Article number: 357 (2013)
Abstract
Background
Sample size calculation is an important issue in the experimental design of biomedical research. For RNAseq experiments, the sample size calculation method based on the Poisson model has been proposed; however, when there are biological replicates, RNAseq data could exhibit variation significantly greater than the mean (i.e. overdispersion). The Poisson model cannot appropriately model the overdispersion, and in such cases, the negative binomial model has been used as a natural extension of the Poisson model. Because the field currently lacks a sample size calculation method based on the negative binomial model for assessing differential expression analysis of RNAseq data, we propose a method to calculate the sample size.
Results
We propose a sample size calculation method based on the exact test for assessing differential expression analysis of RNAseq data.
Conclusions
The proposed sample size calculation method is straightforward and not computationally intensive. Simulation studies to evaluate the performance of the proposed sample size method are presented; the results indicate our method works well, with achievement of desired power.
Background
Next generation sequencing (NGS) technology has revolutionized genetic analysis; RNAseq is a powerful NGS method that enables researchers to discover, profile, and quantify RNA transcripts across the entire transcriptome. In addition, unlike the microarray chip, which offers only quantification of gene expression level, RNAseq provides expression level data as well as differentially spliced variants, gene fusion, and mutation profile data. Such advantages have gradually elevated RNAseq as the technology of choice among researchers. Nevertheless, the advantages of RNAseq are not without computational cost; as compared to microarray analysis, RNAseq data analysis is much more complicated and difficult. In the past several years, the published literature has addressed the application of RNAseq to multiple research questions, including abundance estimation [13], detection of alternative splicing [46], detection of novel transcripts [6, 7], and the biology associated with gene expression profile differences between samples [810]. With this rapid growth of RNAseq applications, discussion of experimental design issues has lagged behind, though more recent literature has begun to address some of the relevant principles (e.g., randomization, replication, and blocking) to guide decisions in the RNAseq framework [11, 12].
One of the principal questions in designing an RNAseq experiment is: What is the optimal number of biological replicates to achieve desired statistical power? (Note: In this article, the term “sample size” is used to refer to the number of biological replicates or number of subjects.) Because RNAseq data are counts, the Poisson distribution has been widely used to model the number of reads obtained for each gene to identify differential gene expression [8, 13]. Further, [12] used a Poisson distribution to model RNAseq data and derive a sample size calculation formula based on the Wald test for singlegene differential expression analysis. It is worth noting that a critical assumption of the Poisson model is that the mean and variance are equal. This assumption may not hold, however, as read counts could exhibit variation significantly greater than the mean [14]. That is, the data are overdispersed relative to the Poisson model. In such cases, one natural alternative to Poisson is the negative binomial model. Based on the negative binomial model, [14, 15] proposed a quantileadjusted conditional maximum likelihood procedure to create a pseudocount which lead to the development of an exact test for assessing the differential expression analysis of RNAseq data. Furthermore, [16] provided a Bioconductor package, edgeR, based on the exact test.
Sample size determination based on the exact test has not yet been studied, however. Therefore, the first goal of this paper is to propose a sample size calculation method based on the exact test.
In reality, thousands of genes are examined in an RNAseq experiment; differential expression among those genes is tested simultaneously, requiring the correction of error rates for multiple comparisons. For the highdimensional multiple testing problem, several such corrected measures have been proposed, such as familywise error rate (FWER) and false discovery rate (FDR). In highdimensional multiple testing circumstances, controlling FDR is preferable [17] because the Bonferroni correction for FWER is often too conservative [18]. Many methods have been proposed to control FDR in the analysis of highdimensional data [17, 19, 20]. Those concepts have been extended to calculate sample size for microarray studies [2125]. To our knowledge, however, the literature does not address determination of sample size while controlling FDR in RNAseq data. Therefore, the second purpose of this paper is to propose a procedure to calculate sample size while controlling FDR for differential expression analysis of RNAseq data.
In sum, in this article, we address the following two questions: (i) For a singlegene comparison, what is the minimum number of biological replicates needed to achieve a specified power for identifying differential gene expression between two groups? (ii) For multiple gene comparisons, what is the suitable sample size while controlling FDR? The article is organized as follows. In the Method section, a sample size calculation method is proposed for a singlegene comparison. We then extend the method to address the multiple comparison test issue. Performance comparisons via numerical studies are described in the Results section. Two real RNAseq data sets are used to illustrate sample size calculation. Finally, discussion follows in the Conclusions section.
Method
Exact test
In an RNAseq experiment, the total number of reads, also referred to as library size, mapped to the genome are different among the samples. In such cases, the counts in each group are not identically distributed, and it is difficult to develop an exact test for assessing the differential expression analysis of RNAseq data. To handle this issue, [14, 15] proposed a quantileadjusted conditional maximum likelihood procedure to create pseudocounts which are approximately identically distributed and which lead to the development of an exact test. In the following, the proposed sample size calculation method is based the exact test for a singlegene comparison. Let Y_{ ij } be the random variable corresponding to the pseudocount, with y_{ ij } being the observed value of Y_{ ij }, of the jth (j = 1,2,…,n_{ i }) sample of the ith (i = 0,1) group where n_{0} and n_{1} are the numbers of samples from the control and treatment group, respectively. Assume pseudocount Y_{ ij } can be modeled as a negative binomial (NB) distribution, NB(d_{ ij }γ_{ i },ϕ). Here, γ_{ i } represents the normalized gene expression level of group i, d_{ ij } represents a normalization factor for the total number of reads mapped in the jth sample of the ith group, and ϕ is the dispersion. We use the NB parameterization where the mean is μ_{ ij } = d_{ ij }γ_{ i } and variance is {\mu}_{\mathit{\text{ij}}}(1+{\mu}_{\mathit{\text{ij}}}^{2}\varphi ). Because the question of interest is to identify the differential gene expression between two groups, the corresponding testing hypothesis is
Because the pseudocounts in each group have an approximately identical negative binomial distribution [14, 15], the sum of pseudocounts of each group, {Y}_{i}=\sum _{j=1}^{{n}_{i}}{Y}_{\mathit{\text{ij}}}, has a negative binomial distribution NB({n}_{i}{d}_{i}^{\ast}{\gamma}_{i},\varphi /{n}_{i}) where {d}_{i}^{\ast} is the geometric mean of normalization factors in group i. Under the null hypothesis (1), the sum of the total pseudocount, Y_{1}+Y_{0}, follows a negative binomial distribution. In analogy with Fisher’s exact test, [14, 15] proposed an exact test for replacing the hypergeometric probabilities with negative binomial probabilities. Because [16] developed a Bioconductor software package edgeR which is an implementation of methodology developed by [14, 15], the pvalue can be easily calculated for conducting the exact test.
In the following simulation and application sections, we used edgeR version 3.0.6 for estimating model parameters and performing the exact test.
Sample size calculation for controlling type I error rate
In this section, we focus on sample size calculation based on the exact test for a singlegene comparison as described in the test statistics section. For simplicity, we assume the RNAseq experiment uses a balanced design (i.e., n_{0} = n_{1} = n), which is a special but common case. The following method could be easily extended to the unbalanced case (i.e. let n_{0} = n and n_{1} = k n where k is a predetermined ratio of the sample size of the control group to the treatment group). In order to perform sample size calculations, it is necessary to construct a power function for the testing described above. The power of a test is the probability that the null hypothesis is rejected when the alternative hypothesis is true. Since the distribution of the exact test statistic under the alternative hypothesis is unknown, however, it is difficult to derive a closedform expression of the power function. Instead of deriving the distribution of test statistic under the alternative hypothesis, [26] proposed a method to calculate the power for the exact test based on a given pvalue. Here, we borrow their concept to calculate power. For a given pvalue, p(y_{1},y_{0}) where y_{0} and y_{1} are the observed pseudosums, described in the previous section, the power can be expressed as
where w={d}_{1}^{\ast}/{d}_{0}^{\ast} is the ratio of the geometric means of normalization factors between two groups, ρ = γ_{1} / γ_{0} is the fold change, {\mu}_{0}={d}_{0}^{\ast}{\gamma}_{0} is the average number of reads in the control group, f(μ,ϕ) is the probability mass function of the negative binomial distribution with mean μ as well as dispersion ϕ, α is the the level of significance, and I(.) denotes the indicator function. For a given desired power 1β, the power of the test can be represented as the function of sample size in the form
Thus, the required sample size n to attain the given power 1β at level of significance α can then be calculated by solving (2) through a numerical approach, such as a gradientsearch or bisection procedure.
Sample size calculation for controlling false discovery rate
In reality, thousands of genes are examined in an RNAseq experiment, and those genes are tested simultaneously for significance of differential expression. In such cases, the sample size calculation for a singlegene comparison discussed above cannot be applied directly. Jung, 2005 [23] incorporated FDR controlling based on a twosample ttest under the Gaussian distribution assumption. In this section, we borrowed their concept to incorporate FDR controlling based on the test statistics described in the test statistics section.
For the multiple testing problem, [19] suggested the use of false discovery rate (FDR) which is defined as the expected proportion of false discoveries among rejected null hypotheses. Storey, 2002 [17] further proposed an improvement to FDR to achieve higher power, in the form
where R_{0} is the number of false discoveries and R is the number of results declared significant (i.e., rejections of the null hypothesis).
To calculate the sample size for microarray data analysis, [23] proposed an FDRcontrolled method which is based on the expression of FDR under independence (or weak dependence) among test statistics, as
[17, 27], where m_{0} is the number of true null hypotheses and E(R_{1}) is the expected number of true rejections. By borrowing their concepts, the expected number of true rejections for RNAseq data can be calculated as
where ρ_{ g } is the fold change, ϕ_{ g } is the dispersion, and μ_{0g} is the average read count in the control group for gene g∈M_{1} (the set of prognostic genes), respectively. Thus, to guarantee an expected number of true rejections, say r_{1}, and control FDR at a specified level f, we have
and
By solving equation (3) with respect to α, we have
where α^{∗} is the marginal type I error level for the expected number of true rejections r_{1} at a given FDR f. Replacing α with α^{∗} in (4), we have the function with respect to n as
Then, by solving g_{1}(n) = 0 via a numerical approach, the required sample size for controlling FDR at level f can be obtained.
To calculate the sample size, we have to estimate all of the fold changes ρ_{ g }, dispersions ϕ_{ g }, and average read counts μ_{0g} of gene g for the set of prognostic genes g∈M_{1} prior to the RNAseq experiment. However, we may not have enough information to estimate all of those parameters in practice. To address this issue, we propose the following method to obtain a conservative estimate of the required sample size. Because the power increases as  log2(ρ_{ g }) or μ_{0g} increases and ϕ_{ g } decreases, we suggest using a common {\rho}^{\ast}=arg\underset{g\in {M}_{1}}{min}\left\{\right\underset{2}{log}\left({\rho}_{g}\right)\left\right\} minimum fold change, {\mu}_{0}^{\ast}=\underset{g\in {M}_{1}}{min}\left\{{\mu}_{0g}\right\} minimum average read count, and {\varphi}^{\ast}=\underset{g\in {M}_{1}}{max}\left\{{\varphi}_{g}\right\} maximum dispersion to estimate each ρ_{ g }, μ_{0g}, and ϕ_{ g }, respectively. In such cases, it gives a more conservative estimate of the required sample size.
When we use ρ^{∗}, {\mu}_{0}^{\ast}, and ϕ^{∗} to estimate each ρ_{ g }, μ_{0g}, and ϕ_{ g }, g∈M_{1}, in the multiple testing context, α^{∗} and β^{∗} can be calculated as r_{1}f/(m_{0}(1f)) and 1r_{1}/m_{1}, respectively, where m_{1} is the number of prognostic genes. In other words, the power function (2) can be applied in the case of multiple gene comparison, with the replacement of α and β with α^{∗} and β^{∗}.
The procedures for sample size calculation detailed in this section can be summarized as follows:

1.
Specify the following parameters: m : total number genes for testing; m_{1} : number of prognostic genes; r_{1} : number of true rejections; f : FDR level; w : ratio of normalization factors between two groups; {μ_{0g},g∈M_{1}} : average read counts for prognostic gene g in control group; {ρ_{ g },g∈M_{1}} : fold changes for prognostic genes g in control group; {ϕ_{ g },g∈M_{1}} : dispersion for prognostic genes g in control group;

2.
Calculate sample size:

(a)
If all the parameters μ_{0g}, ρ_{ g }, and ϕ_{ g } for each prognostic gene g are known, use a numerical approach to solve the equation below with respect to n.
{r}_{1}=\sum _{g\in {M}_{1}}\xi (n,{\rho}_{g},{\mu}_{0g},{\varphi}_{g},w,{\alpha}^{\ast}),where α^{∗} = r_{1}f/(m_{0}(1f)) and m_{0} = mm_{1};

(b)
Otherwise,

(I)
specify a desired minimum fold change ρ^{∗}, a minimum average read count {\mu}_{0}^{\ast}, and a maximum dispersion ϕ^{∗};

(II)
replace ρ = ρ^{∗}, {\mu}_{0}={\mu}_{0}^{\ast}, ϕ = ϕ^{∗}, α = r_{1}f/(m_{0}(1f)), and β = 1r_{1}/m_{1} in equation (2) and solve it with respect to n.

(I)

(a)
Results
Numerical studies
In this section, we conducted simulation studies to evaluate the accuracy of the proposed sample size formula. The parameter settings in simulation studies are based on empirical data sets.
We set the total number of genes for testing to be m = 10000 and the number of statistically significant prognostic genes m_{1} = 100. We wanted to detect the expected number of true rejections r_{1} = 80, which corresponds to a power of 80% (i.e. β^{∗} = 0.2). All parameters μ_{0g}, ρ_{ g }, and ϕ_{ g } (g = 1,…,10000) were assumed to be unknown. Thus, we used a minimum fold change ρ^{∗} and a minimum average read count {\mu}_{0}^{\ast} and a maximum dispersion ϕ^{∗} to estimate each ρ_{ g }, μ_{0g}, and ϕ_{ g }, g = 1…,10000. We varied {\mu}_{0}^{\ast}=1 or 5; log_{2}fold changes log2(ρ^{∗}) = 0.5,1.0,1.5,2.0 or 2.5; and ϕ^{∗} = 0.1, or 0.5. With these settings, α^{∗} = 8.162×10^{5},4.253×10^{4}, and 8.979×10^{4}, which correspond to controlling FDR at level 1%, 5%, and 10%, respectively.
Then, we substituted α^{∗} and β^{∗} into the formulas (2) and calculated sample size by solving this equation. In addition, for each design setting, we generated 5000 samples from independent negative binomial distributions based on the calculated sample size n; for the control group, the count of each gene is generated by R program from a negative binomial distribution with mean {\mu}_{0}^{\ast} and dispersion ϕ^{∗}; for the treatment group, the count of each gene is generated from a negative binomial distribution with mean {\rho}^{\ast}{\mu}_{0}^{\ast} and dispersion ϕ^{∗}. Then, edgeR is used to estimate model parameters and perform the exact test. The number of true rejections was counted using the qvalue procedure proposed by [20]. The expected number of true rejections was estimated as the sample mean of the number of rejections of the 5000 simulation samples ({\widehat{r}}_{1}).
In Table 1, we showed the calculated sample size with corresponding {\widehat{r}}_{1} in parentheses under the case w = 1. For a fixed log_{2}fold change, dispersion, and FDR, sample size increases when μ_{0} decreases. This result is as expected; a small average read count provides less information, such that a larger sample size is required to detect the difference. For a fixed {\mu}_{0}^{\ast}, ϕ^{∗}, and FDR, sample size increases when log2(ρ^{∗}) decreases (i.e. the smaller log_{2}fold changes requires greater sample sizes with all else being equal). This result is as expected; a larger sample size is required for detecting a smaller difference. For a fixed {\mu}_{0}^{\ast}, log2(ρ^{∗}), and FDR, sample size increases when ϕ^{∗} increases. This result, also, is as expected; the variation increases when dispersion increases, such that a larger sample size is required to detect the difference. Note that all {\widehat{r}}_{1} in Table 1 are close to the prespecified number of true rejections (r_{1}=80); thus, the proposed method estimated a sample size that achieves correct power at the specified FDR level.
Applications
Liver and kidney RNAseq data set
To identify differentially expressed genes between human liver and kidney RNA samples, [8] explored an RNAseq data set containing 5 human kidney samples and 5 human liver samples. In the following, we used this data set as pilot data for designing a new study with the same study objective. For the purpose of demonstration, we assumed that the human kidney is the control group. After filtering genes with no more than 5 total reads in liver samples or kidney samples, there were 17306 genes left. We assumed that the top 175 (≈ 1% of 17306) genes are prognostic. From the pilot data, the minimum average read counts among the prognostic genes in the control group were estimated as {\mu}_{0}^{\ast}=5, the maximum dispersion was estimated as ϕ^{∗} = 0.0029, and the ratio of the geometric mean of normalization factors between the two groups was estimated as w = 0.9 using edgeR. Suppose we want to identify 80% of the prognostic genes (i.e. r_{1} = 0.8×175 = 140), while controlling FDR at 1% (i.e. f = 0.01). Based on the pilot data, we set m = 17306, m_{1} = 175, m_{0} = 17131, r_{1} = 140, and f = 0.01. In this case, we have
and
After substituting those parameters into equation (2) and solving it with respect to n, the required sample size can be obtained. In the second column from the left of Table 2, we report the sample size while controlling FDR at 1% under various desired minimum fold changes ρ^{∗} = 0.10,0.25,0.50,0.75,1.25,1.50,2.00,2.50, and 3.0. From Table 2, we found that the original RNAseq experiment described in [8] with sample size 5 in each group can identify 80% of the prognostic genes at FDR =1% if the desired minimum fold change ρ^{∗} is 3.0.
Li, 2013 [28] proposed several sample size calculation methods for RNAseq data under the Poisson model. To compare the difference in sample size calculation between the negative binomial method and Poisson method, in the last six right columns of Table 2 we report the sample size calculation based on Poisson model (i.e. the sample size based on the Wald test n_{ w }, score test n_{ s }, log transformation of Wald statistic n_{ lw }, log transformation of score statistic n_{ ls }, transformation of Poisson n_{ tp }, and likelihood ratio test n_{ lr }) with the same settings as the negative binomial method. As we can see, the sample size calculation based on the negative binomial and Poisson methods are similar. This result is as expected since the data set explored by [8] has technical and not biological replicates (i.e. the maximum dispersion estimated from the liver and kidney RNAseq data set is close to zero). Thus, it is not surprising that the results of the negative binomial and Poisson methods are similar when the dispersion parameter is close to zero. Moreover, in Table 2, the estimated sample size is about the same size for very small fold changes (ρ^{∗} = 0.10) and very large fold changes (ρ^{∗} = 3.0). This result is expected since it tends to the same conclusion no matter what statistical model is used when the treatment effect is very large (i.e. the fold change is very large or small).
Transcript regulation data set
Blekhman, 2010 [29] used RNAseq to study transcript regulation in humans, chimpanzees, and rhesus macaques using liver RNA samples from three males and three females from each species. For the purpose of demonstration, we assumed that the goal of the study is to identify differential gene expression between male and female in humans and that the female is considered the control group. There were 13267 genes in the data set after performing quality control analyses. Suppose that the top 133 (≈ 1% of 13267) genes are prognostic. After filtering genes with no more than 5 total reads in male samples or female samples, there were 7658 genes left. Those genes are considered pilot data, and we assessed the differential expression by using edgeR. From the pilot data, the minimum average read counts among the prognostic genes in the control group were estimated as {\mu}_{0}^{\ast}=1.67, ϕ^{∗} = 0.6513, and the ratio of the geometric mean of normalization factors between the two groups was estimated as w = 1.08. Suppose we want to identify 80% of the prognostic genes (i.e. r_{1} = 0.8×133 = 107), while controlling the FDR at 10%. Based on the pilot data, we set m = 13267, m_{1} = 133, m_{0} = 13134, r_{1} = 107 and f = 0.1. In this case, we have α^{∗} = 9.0512×10^{4} and β^{∗} = 0.2. In the second column from the left of Table 3, we report the required sample sizes under various desired minimum fold changes while controlling the FDR at 10% under the negative binomial distribution. We also report the required sample size based on the Poisson model proposed by [28] under the same settings in the last six columns on the right of Table 3. As we can see, the required sample size based on the negative binomial method is greater than the Poisson method. In the transcript regulation data set, the maximum dispersion was estimated as ϕ^{∗} = 0.6513>0. This indicates that the read counts in this data set exhibit overdispersion. In such a situation, it is inappropriate to model this data set based on the Poisson, and the sample size calculation based on the Poisson model will be underestimated due to underestimation of variance (i.e. the study based on the corresponding sample size will be underpowered).
Discussion
In this research, we assume independent gene expression levels; however, this assumption may not hold in reality. For correlated RNAseq gene expression data, evaluation of the accuracy of our method is an important future research question; however, generating a negative binomial distribution for correlated highdimensional data will be a challenge. Moreover, most of the major R packages dedicated to RNAseq differential analyses (edgeR, DESeq, etc.) are now starting to enable multigroup comparisons. However, the proposed method is developed for comparing twogroup means. Thus, the sample size calculation for multigroup comparisons would be an interesting research topic for us in the future. In addition, it has already been noted that typical RNAseq differential analyses have very low power; see for example the simulation studies in [30], where power for edgeR was always less than 60%, or [31], where power ranged from about 45% to 55% (both with 10 samples per condition). In our simulation and application sections, the minimum sample sizes required to achieve 80% power would be prohibitively large for RNAseq experiments in practice, given their current cost. In such situations, the findings in [30, 31] can provide useful information for specifying achievable power. It is well known that low study power will decrease the reproducibility of scientific research. We hope that this paper can benefit researchers by allowing them to understand their study power.
Conclusions
In recent years, RNAseq technology has emerged as an attractive alternative to microarray studies, due to its ability to produce digital signals (counts) rather than analog signals (intensities), and to produce more highly reproducible results with relatively little technical variation [32, 33]. With a large sample size, RNAseq can become costly; on the other hand, insufficient sample size may lead to unreliable answers to the research question of interest. To manage the tradeoff between cost and accuracy, sample size determination is a critical issue for RNAseq experimental design. For comparing the differential expression of a single gene, we have proposed a sample size calculation method based on an exact test proposed by [14, 15]. To address multiple testing (i.e., multiple genes), we further extended our proposed method to incorporate FDR control. Our methods are not computationally intensive for pilot data or other relevant data with a specified desired minimum fold change, minimum average read count, and maximum dispersion. To facilitate implementation of the sample size calculation, R code is available from the corresponding author.
References
Jiang H, Wong WH: Statistical inferences for isoform expression in RNASeq. Bioinformatics. 2009, 25 (8): 10261032. 10.1093/bioinformatics/btp113.
Li B, Ruotti V, Stewart RM, Thomson JA, Dewey CN: RNASeq gene expression estimation with read mapping uncertainty. Bioinformatics. 2010, 26 (4): 493500. 10.1093/bioinformatics/btp692.
Wu Z, Wang X, Zhang X: Using nonuniform read distribution models to improve isoform expression inference in RNASeq. Bioinformatics. 2011, 27 (4): 502508. 10.1093/bioinformatics/btq696.
Griffith M, Griffith OL, Mwenifumbo J, Goya R, Morrissy AS, Morin RD, Corbett R, Tang MJ, Hou YC, Pugh TJ, Robertson G, Chittaranjan S, Ally A, Asano JK, Chan SY, Li HI, McDonald H, Teague K, Zhao Y, Zeng T, Delaney A, Hirst M, Morin GB, Jones SJM, Tai IT, Marra MA: Alternative expression analysis by RNA sequencing. Nat Methods. 2010, 7 (10): 843847. 10.1038/nmeth.1503.
Wang L, Xi Y, Yu J, Dong L, Yen L, Li W: A statistical method for the detection of alternative splicing using RNAseq. PLoS One. 2010, 5: e852910.1371/journal.pone.0008529.
Trapnell C, Williams BA, Pertea G, Mortazavi A, Kwan G, van Baren MJ, Salzberg SL, Wold BJ, Pachter L: Transcript assembly and quantification by RNASeq reveals unannotated transcripts and isoform switching during cell differentiation. Nat Biotechnol. 2010, 28 (5): 511515. 10.1038/nbt.1621.
Robertson G, Schein J, Chiu R, Corbett R, Field M, Jackman SD, Mungall K, Lee S, Okada HM, Qian JQ, Griffith M, Raymond A, Thiessen N, Cezard T, Butterfield YS, Newsome R, Chan SK, She R, Varhol R, Kamoh B, Prabhu AL, Tam A, Zhao Y, Moore RA, Hirst M, Marra MA, Jones SJM, Hoodless PA, Birol I: De novo assembly and analysis of RNAseq data. Nat Methods. 2010, 7 (11): 909912. 10.1038/nmeth.1517.
Marioni JC, Mason CE, Mane SM, Stephens M, Gilad Y: RNAseq: an assessment of technical reproducibility and comparison with gene expression arrays. Genome Res. 2008, 18 (9): 15091517. 10.1101/gr.079558.108.
Cloonan N, Forrest ARR, Kolle G, Gardiner BBA, Faulkner GJ, Brown MK, Taylor DF, Steptoe AL, Wani S, Bethel G, Robertson AJ, Perkins AC, Bruce SJ, Lee CC, Ranade SS, Peckham HE, Manning JM, McKernan KJ, Grimmond SM: Stem cell transcriptome profiling via massivescale mRNA sequencing. Nat Methods. 2008, 5 (7): 613619. 10.1038/nmeth.1223.
Pickrell JK, Marioni JC, Pai AA, Degner JF, Engelhardt BE, Nkadori E, Veyrieras JB, Stephens M, Gilad Y, Pritchard JK: Understanding mechanisms underlying human gene expression variation with RNA sequencing. Nature. 2010, 464 (7289): 768772. 10.1038/nature08872.
Auer PL, Doerge RW: Statistical design and analysis of RNA sequencing data. Genetics. 2010, 185 (2): 405416. 10.1534/genetics.110.114983.
Fang Z, Cui X: Design and validation issues in RNAseq experiments. Brief Bioinform. 2011, 12 (3): 280287. 10.1093/bib/bbr004.
Wang L, Feng Z, Wang X, Wang X, Zhang X: DEGseq: an R package for identifying differentially expressed genes from RNAseq data. Bioinformatics. 2010, 26: 136138. 10.1093/bioinformatics/btp612.
Robinson MD, Smyth GK: Smallsample estimation of negative binomial dispersion, with applications to SAGE data. Biostat. 2008, 9 (2): 321332.
Robinson MD, Smyth GK: Moderated statistical tests for assessing differences in tag abundance. Bioinformatics. 2007, 23 (21): 28812887. 10.1093/bioinformatics/btm453.
Robinson MD, McCarthy DJ, Smyth GK: edgeR: a Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics. 2010, 26: 139140. 10.1093/bioinformatics/btp616.
Storey JD: A direct approach to false discovery rates. J R Stat Soc Ser B. 2002, 64 (3): 479498. 10.1111/14679868.00346.
Hirakawa A, Sato Y, Sozu T, Hamada C, Yoshimura I: Estimating the false discovery rate using mixed normal distribution for identifying differentially expressed genes in microarray data analysis. Cancer Inform. 2007, 3: 140148.
Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 1995, 57: 289300.
Storey JD, Tibshirani R: Statistical significance for genomewide studies. Proc Natl Acad Sci USA. 2003, 100 (16): 94409445. 10.1073/pnas.1530509100.
Pounds S, Cheng C: Sample size determination for the false discovery rate. Bioinformatics. 2005, 21 (23): 42634271. 10.1093/bioinformatics/bti699.
Hu J, Zou F, Wright FA: Practical FDRbased sample size calculations in microarray experiment. Bioinformatics. 2005, 21: 32643272. 10.1093/bioinformatics/bti519.
Jung SH: Sample size for FDRcontrol in microarray data analysis. Bioinformatics. 2005, 21 (14): 30973104. 10.1093/bioinformatics/bti456.
Pawitan Y, Michiels S, Koscielny S, Gusnanto A, Ploner A: False discovery rate, sensitivity and sample size for microarray studies. Bioinformatics. 2005, 21: 30173024. 10.1093/bioinformatics/bti448.
Liu P, Hwang JTG: Quick calculation for sample size while controlling false discovery rate with application to microarray analysis. Bioinformatics. 2007, 23 (6): 739746. 10.1093/bioinformatics/btl664.
Krishnamoorhy K, Thomson J: A more powerful test for comparing two Poisson means. J Stat Plan Infer. 2004, 119: 2335. 10.1016/S03783758(02)004081.
Storey JD, Tibshirani R: Estimating false discovery rates under dependence, with applications to DNA microarrays. Technical Report. CA: Department of Statistics, Standford University, 20012001.
Li CI, Su PF, Guo Y, Shyr Y: Sample size calculation for differential expression analysis of RNAseq data under Poisson distribution. Int J Comput Biol Drug Des. 2013, 6 (4): 358375. 10.1504/IJCBDD.2013.056830.
Blekhman R, Marioni JC, Zumbo P, Stephens M, Gilad Y: Sexspecific and lineagespecific alternative splicing in primates. Genome Res. 2010, 20 (2): 180189. 10.1101/gr.099226.109.
Soneson C, Delorenzi M: A comparison of methods for differential expression analysis of RNAseq data. BMC Bioinformatics. 2013, 14: 9110.1186/147121051491. [http://dx.doi.org/10.1186/147121051491],
Dillies M, Rau A, Aubert J, HennequetAntier C, Jeanmougin M, Servant N, Keime C, Marot G, Castel D: A comprehensive evaluation of normalization methods for Illumina highthroughput RNA sequencing data analysis. Brief Bioinform. 2013, 14 (6): 671683. 10.1093/bib/bbs046.
Mortazavi A, Williams BA, McCue K, Schaeffer L, Wold B: Mapping and quantifying mammalian transcriptomes by RNASeq. Nat Methods. 2008, 5 (7): 621628. 10.1038/nmeth.1226.
Hashimoto Si, Qu W, Ahsan B, Ogoshi K, Sasaki A, Nakatani Y, Lee Y, Ogawa M, Ametani A, Suzuki Y, Sugano S, Lee CC, Nutter RC, Morishita S, Matsushima K: Highresolution analysis of the 5’end transcriptome using a next generation DNA sequencer. PLoS One. 2009, 4: e410810.1371/journal.pone.0004108.
Acknowledgements
This work was partly supported by NIH grants P30CA068485, P50CA095103, P50CA098131, and U01CA163056. The authors wish to thank Margot Bjoring for editorial work on this manuscript.
Author information
Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
Authors CIL, and PFS were involved in the development of the models. CIL and PFS wrote the manuscript. SY generated the original idea and guided and supervised the research. All authors read and approved the final version of this manuscript.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Li, CI., Su, PF. & Shyr, Y. Sample size calculation based on exact test for assessing differential expression analysis in RNAseq data. BMC Bioinformatics 14, 357 (2013). https://doi.org/10.1186/1471210514357
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1471210514357
Keywords
 False Discovery Rate
 Sample Size Calculation
 Poisson Model
 Negative Binomial Distribution
 Differential Expression Analysis