 Methodology article
 Open Access
 Published:
Impact of adaptive filtering on power and false discovery rate in RNAseq experiments
BMC Bioinformatics volume 23, Article number: 388 (2022)
Abstract
Background
In RNAsequencing studies a large number of hypothesis tests are performed to compare the differential expression of genes between several conditions. Filtering has been proposed to remove candidate genes with a low expression level which may not be relevant and have little or no chance of showing a difference between conditions. This step may reduce the multiple testing burden and increase power.
Results
We show in a simulation study that filtering can lead to some increase in power for RNAsequencing data, too aggressive filtering, however, can lead to a decline. No uniformly optimal filter in terms of power exists. Depending on the scenario different filters may be optimal. We propose an adaptive filtering strategy which selects one of several filters to maximise the number of rejections. No additional adjustment for multiplicity has to be included, but a rule has to be considered if the number of rejections is too small.
Conclusions
For a large range of simulation scenarios, the adaptive filter maximises the power while the simulated False Discovery Rate is bounded by the predefined significance level. Using the adaptive filter, it is not necessary to prespecify a single individual filtering method optimised for a specific scenario.
Background
In next generation RNAsequencing experiments (RNAseq), thousands of genomic features (typically genes) are investigated to study differential expression levels among several experimental conditions. Often the number of replicates per condition is small. When testing each gene individually, multiple testing procedures have to be applied to avoid an increase in false positive results and the power to detect truly differentially expressed (DE) genes between conditions is often low.
It has been shown that data filtering can increase the number of rejections or the power, respectively, of highthroughput experiments [1,2,3]. Filtering removes genes with, e.g., low counts or small variation in the pooled sample, or genes whose counts are so poorly measured, that their expression level cannot be determined. In RNAseq, genes with low counts across all replicates or samples (also called libraries) are assumed to provide little evidence for differential expression as a gene must be expressed at some minimum level before it is likely to be transformed to a protein or to be biologically important [4]. On the other hand, genes with low variation in the pooled sample and which therefore have small chance of showing a significant differential expression in the final analysis, are removed. Only genes that pass a prespecified filter are part of the final analysis and are considered in the multiple testing procedure. With a lower number of genes, a less stringent multiplicity adjustment can be applied and thus the probability to detect truly DE genes is increased.
Several methods for filtering were proposed for RNAseq data, e.g., filtering based on the maximum or the mean of the observed counts across all groups (e.g., treatment conditions) for each gene, with varying thresholds for the selection. It has been shown that filtering should be based on blinded data, i.e., independent of the groups, to avoid inflation of the Type I error rate (for details, see [5]). However, there is no consensus or rule on the choice of the filtering process or the threshold values. E.g., the vignette of the bioconductor package EdgeR [4] states: ’As a rule of thumb, genes are kept if they are expressed in at least one condition. Users can set their own definition of genes being expressed.’ Thus, in practice, a user may apply various filtering strategies and chose the rule leading to the ’best’ result for the final analysis. However, it has not been investigated, how this approach affects the Type I error rate and the power.
In this paper, we propose an adaptive filter for RNAseq data which selects one out of several filtering methods aimed at maximising the number of rejections. In a large range of simulation scenarios, practically no impact on the False Discovery Rate (FDR) is observed, if several filters are considered and the filter leading to the largest number of rejections is selected. No additional adjustment for multiplicity for the number of considered filters has to be included. The only additional rule that has to be considered is that if the number of rejections is too small (and lies below a specified filter parameter), a previously defined reference filter has to be chosen for the final analysis. Otherwise the FDR may be inflated. In the next section, we show that no uniformly optimal filter in terms of multiple power exists and that the proposed adaptive filter leads to the largest power without inflation of the FDR for many different simulation scenarios. The merits of the new adaptive filter procedure are illustrated using simulated and real data. In the Methods section, we review the data processing steps for RNAseq data and define the adaptive filter.
Results
We first perform simulation studies to compare filtering methods from the literature with regard to multiple power, defined as the proportion of correctly rejected false null hypotheses under all false null hypotheses, i.e. the proportion of correctly identified truly DE genes under all DE genes (hereinafter denoted as power). Since there is no consensus rule on the choice of the filtering process, we propose the new adaptive filter approach which searches for the best filter in terms of the number of identified genes (as described in more detail in the Methods section). We then analyse the impact of the adaptive filter on the multiple power and the FDR.
Simulation settings
In the simulation study, we consider experiments comparing two groups of independent samples with \(m=10000\) twosided null hypotheses \(H_{0i}\), \(i=1,\dots ,m\) (corresponding to genes or features, hereinafter referred to as genes). The two groups are of sizes \(n_1=n_2=10\), and we consider different proportions \(\pi _0\) of true null hypotheses, i.e. nonDE genes, in the range from 0.5 to 1. To simulate RNAseq data, we consider a wide range of strategies (see Table 1 and Additional file 1).
Filtering was performed in two steps: We first filtered the raw counts and removed genes with only zero counts in both groups. This filter is denoted as the basic filter. Based on the remaining genes, the data were normalised and for each gene a pvalue for group comparison was calculated (see Methods section). Next, one of the filters listed in Table 2 was applied to the raw counts. The unadjusted pvalues of the hypotheses selected by the two filters (the basic filter and the chosen additional filter) were then adjusted for multiplicity. In our simulations we examined and discussed two methods for multiplicity adjustment, the local False Discovery Rates (lfdr) [14, 15] and the BenjaminiHochberg (BH) procedure [16]. The significance threshold \(\alpha\) was set to 0.05 (for alternative analysis pipelines, see the Methods and the additional files). For the adaptive filter strategy, all filters in Table 2 are applied separately and the method that leads to the largest number of rejections is selected as the actual filter. Note that in the simulations we also considered the options to perform no filtering at all and the option to perform no further filtering step after the basic filter (these options are in the following referred to as ’none’ and ’basic’). The considered filters (Table 2) are parameterised by thresholds with the exception of the Jaccard filter, which has no parameter. For each of these filters we considered a range of thresholds. Such thresholds can be specified as absolute constants (e.g. a minimum mean count) or as percentile percentages (e.g. the 5% percentile of the observed mean counts). For mean and maxbased filtering, we chose thresholds based on percentile percentages and for CPM and zerobased filtering a fixed set of thresholds is used. For the comparisons in Figs. 1 and 2, the corresponding proportions of filtered genes (i.e. removed genes) in the respective scenario are plotted and computed after removing genes with only zero counts. Note that also for methods based on percentiles percentages, the actually observed proportions plotted in the Figures may differ from the nominal percentages due to ties.
All simulations were performed with R version 3.6.0 or higher [17]. At least 1000 simulation runs were performed for each scenario.
Comparison of individual filtering strategies
We first compare the individual filtering methods with regard to the power. A comparison with the adaptive filtering approach is reported in the next section.
For several simulation settings, the power of each filter as a function of the proportions (across all simulation runs) of filtered genes among the set of genes selected by the basic filter is shown in Figs. 1 and 2 for the lfdr adjustment and \(\pi _0=0.8\). The corresponding results for \(\pi _0=0.5\) and 0.99, simulations based on other real data sets, and for the BH procedure can be found in Additional file 2: Figs. S1, S2, S13–S15. For a better comparison of filtering methods in the plots, the thresholds are transformed to the corresponding proportions of filtered genes. Only the proportion of selected genes reported for the basic filter is based on the total number of hypotheses m, the proportion of no filtering is always 0.
It can be seen that in many scenarios mean and maxbased filters maximise the power, however, the optimal percentile percentage depends very sensitively on \(\pi _0\), the simulation setting and the multiplicity adjustment. Often the optimal filter is not unique, as several methods/percentile percentages lead to the same or very similar power values. For example, for NB data simulation more than half of the genes should be removed to maximise power and the larger \(\pi _0\), the more genes should be removed by the filter. For the NB simulation with distributed dispersion and mean parameters, however, optimal power values are achieved for much lower percentile percentages. The basic filter (which in this simulation setting is equivalent to no filtering as zero counts in the whole sample are very unlikely) as well as all other filters with very low percentile percentages show a good performance in all considered scenarios. In other scenarios, e.g., SimSeq simulations with counts based on the mouse or Bottomly data sets, the max and meanbased filters have higher power values if the percentile percentage of filtered genes is approx. between 10% and 20%. However, the advantage in terms of power is only small (between 0.3 and 0.6 percentage points). In contrast, for the SimSeq simulation based on the Kidney data set, hardly any genes should be filtered (see Fig. 1 and in Additional file 2: Figs. S1, S2, S13–S15). Note that, as expected, the resulting power of the BH adjusted simulations is larger. Apart from that the curves look rather similar and optimal percentile percentages are comparable.
The PROPER simulations show rather flat power curves near the optimum, the power is increased by 0.5 to 2 percentage points in comparison to the basic filter. As this simulation generates many zero genes, the advantage of the basic filter compared to no filtering is very pronounced. The optimal power is observed with the maxbased and the zero filter and lies between the 10% (for \(\pi _0=0.5\)) and 20% percentile (for \(\pi _0=0.99\)). Figure 2 shows the results of the simulation study with fixed sequencing depths = 5m, 10m, and 50m for the lfdr method. As expected, power increases with sequencing depth. Optimal power values can be found for the zero and the maxbased filter, the optimal percentile percentage decreases for an increasing sequencing depth from 0.24 to 0.12.
For the simplistic simulation settings such as NB sim and NB sim distributed, the ’none’ filter often shows similar power values as the basic filter. However, for the SimSeq and the PROPER simulations, large power increases of more than 20% can be found. Moreover, as can be seen in Additional file 2: Figs. S4–S7 and 1719, in many scenarios the FDR of the ’none’ filter option is increased.
None of the filters is uniformly optimal across all considered scenarios, however, in many scenarios, mean and maxbased filters with low thresholds, zero filter with high thresholds, the Jaccard or the basic filter generate the highest power values. However, huge differences in power of more than 60% can be observed if inefficient thresholds are chosen. Note again, that the optimal filter and/or threshold is unknown in practice.
A modified order of data processing, where filtering was performed before normalisation and data analysis (order (b)) as described in the Methods section), can be found in the Additional file 2: Figs. S22 and S23 (multiplicity adjustment with lfdrs). The results emphasise the conclusion that the optimal filter depends on the simulation scenario.
Adaptive filter
Since none of the considered filters is uniformly optimal, the adaptive filter may be a useful option to avoid the risk of choosing an inefficient filter in terms of power. In this section, the simulation studies presented above are extended and the performance of the adaptive filter is investigated. The adaptive filter incorporates all filters as described in Table 2 and finally applies the filter which leads to the largest number of rejections. To avoid an increase in the FDR under the global null hypothesis where \(\pi _0=1\), a filter parameter l was introduced and a reference filter was defined in advance. l was set to 5, i.e. in case of 5 or less rejections, the reference filter and not the adaptive filter is applied. Otherwise an inflation of the FDR under the global null hypothesis may be observed. In our simulation study, the Jaccard filter was specified as the reference filter.
Figures 3 and 4 show the differences in power of the filters compared to no filtering as a function of \(\pi _0\), m, or \(n_1=n_2\) for multiplicity adjustment with lfdrs (Additional file 2: Fig. S16 for the BH procedure). The parameters \(\pi _0\), m, or \(n_1=n_2\) are either varying on the xaxis or are fixed at \(\pi _0=0.8\), \(m=10000\), \(n_1=n_2=10\) (simulations for \(\pi _0=0.99\) or based on other data sets, can be found in Additional file 2). The adaptive filter incorporates all thresholds from Table 2; however, the Figures only show the results for a selection of the considered thresholds: mean and maxbased filters with the 1% and the 90% percentile, the zerobased filter with threshold \(u=8\), and the Jaccard filter. In addition, the adaptive filter with filter parameter \(l=5\) is plotted. Note that we use different scales on the yaxis to provide information on the methods with high power values in detail. Therefore, on some plots, filtering methods with very low power and large power differences are not visible. In most scenarios, this concerns the mean and maxbased filter with the 90% percentile. Additional file 2: Figs. S3 and S16 show results for the NB simulation with distributed parameters according to the Bottomly data set, the second row for SimSeq simulation (Kidney data), and row 3 for the PROPER simulation. In Fig. 4, further NB sim distributed, SimSeq and PROPER simulations with varying sequencing depth as a function of \(\pi _0\) are shown.
It can be seen that the improvement in power for the adaptive filter is only moderate compared to some of the individual filtering methods with a large number of rejections. However, the adaptive filter gives a larger power in all scenarios while individual filters perform well in tailored settings only. For instance, the Jaccard filter shows a good performance in a lot of scenarios, while for PROPER simulations with sequencing depth = 5m and \(\pi _0=0.5\) (lfdr adjustment), the gain in power for the adaptive filter is up to 22 percentage points compared to the Jaccard filter, for \(\pi _0=0.99\) the gain is only 0.7 percentage points. For the SimSeq Bottomly simulations, it is up to approximately 9 percentage points.
We investigated the FDR of the adaptive filter in the above simulation scenarios. In most scenarios with \(m\ge 2500\) the simulated FDR was below the nominal level 0.05, if the filter parameter l is 5 or larger. This holds also under the global null hypothesis (see Additional file 2: Figs. S8–S11, S20, S21). For some simulation scenarios based on SimSeq several of the individual (nonadaptive) filter methods showed an inflated FDR (see Additional file 2: Fig. S7). For these simulations, especially filters that select only a small percentage of genes for testing inflate the FDR. As a consequence, also the FDRs of the adaptive filter are increased (see Additional file 2: Figs. S9 and S19): For lfdr adjustment, the observed maximum FDR for the SimSeq simulation based on the Bottomly data is 0.098 (\(\pi _0=1\)), for the mouse data 0.17 (\(\pi _0=1\)). For the latter, the FDR of \(\pi _0=0.95\) and 0.99 is also increased to 0.1 and 0.16. For the PROPER simulations and the BH procedure the simulated FDR of the adaptive filtering (\(l=5\)) is inflated for \(\pi _0=1\) and 0.99 to a maximum of 0.069 and 0.071 for large values of \(m \ge 1000\) (Additional file 2: Fig. S21), no increase is observed for the lfdr method (Additional file 2: Fig. S11). However, as above, the increase in FDR for these scenarios is already observed for the individual (nonadaptive) filtering methods (see [18] for a detailed discussion of FDR control for count data). This increase causes also the inflation of the FDR of the adaptive filter.
In Additional file 2: Figs. S11 and S21 we also investigate the influence of smaller \(m=\{100, 500\}\) on the FDR. For the lfdr method, for filter parameter \(l=5\), the observed FDR is lower than \(\alpha =0.05\) for all scenarios and all values of m. For the BH method, however, for \(l=5\) and \(m=100\) or \(m=500\), the simulated FDR is larger than 0.05 in some scenarios with a maximum inflation of 0.062 for the PROPER simulation (\(m=100\) and \(\pi _0=0.8\)). Small increases are also observed for NB distributed simulations and \(m=100\) (maximum inflation 0.053). However, for these scenarios, for some of the individual filtering methods the observed FDR is larger than \(\alpha\).
Real data application
We applied the adaptive filtering method to several RNAseq data sets from the literature. We used the Bottomly, mouse mammary, Kidney and Sultan data sets which we had already used in the data simulations. Additionally, we reanalysed the Airway dataset (library airway, [19]) and a random sample of this data set with halved sample sizes per group to generate an application with potentially lower power (Airway 2). Real data analyses were further conducted for a random sample of 10 samples per group from the Kidney data set (in order to have similar group sizes as in the simulation study) and the Yuen data set from an experiment with de novo assembled transcriptome as a reference for gene counting (see Table 3, additional information on the data sets can be found in Additional file 1). R source code can be found in Additional file 4.
In the reanalyses first all genes with only zero counts were removed (basic filter). Second, the filtering strategies as described in Table 2 were applied. The number of rejections was calculated (\(\alpha =0.05\)) as well as the proportion of the filtered genes. Again, filtering was performed after data analysis (see order (a) in Methods section), in addition, we performed a second data analysis where filtering was performed before normalisation and data analysis (order (b), Additional file 2: Table S1).
Table 4 shows the resulting maximum number of rejections for the filtering method and the corresponding observed proportion of filtered genes (for the basic filter based on all m genes, for other filters based on the nonzero genes) for multiplicity adjustment with lfdr (in Additional file 2: Fig. S12 shows histograms of estimated lfdrs and Table S2 shows results for the BH procedure). The adaptive filter with the highest number of rejections is highlighted in bold. It can be seen that, in most cases, the maxbased filter leads to the largest number of rejections, however, with differing proportions (between 4 and 80 for lfdr adjustment and 2 and 70 for BH procedure). In at least one example, the meanbased, zerobased and Jaccard filters also lead to the highest number of rejections. The ordering of the data preprocessing (Additional file 2: Table S1) has quite a large impact on the number of rejections. Whether it is better to filter at the very beginning or at the end depends on the data set and on the filtering method.
Discussion
In this manuscript we investigate an adaptive filtering procedure where several filtering methods are considered and the filter leading to the largest number of rejections is chosen. The proposed strategy may mimic the actual practise. The more important it is to investigate the impact of such a procedure on the Type I error rate and power, as it is not selfevident that such a strategy is sound and does not lead to biased hypothesis tests. For example, it has been shown that in multiple testing problems where the familywise error rate is controlled, an adaptive approach without strict rules may generate a high inflation of the error rate (e.g., [21, 22]). In this manuscript we thus give some justification for the proposed strategy when a large number of hypotheses is tested controlling the FDR and investigate by simulations under which conditions (e.g, with regard to the number of hypotheses tested) FDR control holds.
It can be seen that the improvement in power for the adaptive filter is only moderate compared to some of the individual filtering methods with a large number of rejections. However, which filtering methods and thresholds lead to large power values is in practice unknown and compared to any particular filtering method the increase in power by the adaptive filter can be very large. The adaptive filtering method selects the best filtering method (in terms of rejections) without the need to prespecify a single individual filtering method and therefore avoids the choice of an inappropriate filter leading to a large loss in power. We suggest to consider each filtering method with several thresholds covering a broad range in the adaptive filter. For example, in the simulation study we included the thresholds given in Table 2.
In this manuscript, we chose the maximum number of rejections R as the criterion for the adaptive filter. This criterion may be replaced by, e.g., a posthoc power estimator [23]. Here, after data analysis for each filter the posthoc power defined as the proportion of truly rejected null hypotheses is estimated. The filtering method with the highest posthoc power is then chosen as the adaptive filter.
To adjust for multiple testing we consider two different approaches, the lfdr and the BH method. Our results reveal that for both methods the adaptive filtering strategy is well applicable. The BH method might have the advantage of higher power values but less robustness, e.g., when genes are correlated and the pvalue distribution does not follow a uniform distribution under the null hypothesis. Thus we do not recommend a specific method for multiplicity control but a researcher has to decide individually based on the experiment which method should be used. The BH and lfdr method are in fact two different concepts to control for multiplicity when several simultaneous hypothesis tests are performed. Control of the FDR at significance level \(\alpha\) essentially means that the expected value of the proportion of false rejections under all rejections is equal to or smaller than \(\alpha\). Control of the FDR is an overall characteristic of the multiple testing procedure, which does not distinguish between rejected hypotheses. In contrast, lfdr is computed for each hypothesis and can be interpreted as the posterior probability that the null hypothesis is true, conditional on the observed test statistic or pvalue. It has been shown (e.g., [14] or [24]), that these concepts are related, as the FDR essentially corresponds to an average of the lfdrs of rejected hypotheses. Therefore when controlling the lfdr at level \(\alpha\), the FDR is controlled at a level smaller than \(\alpha\). See also the discussions on the concepts and methods to control the lfdr and FDR in, e.g., [25,26,27].
For the analysis of RNAseq data, several approaches have been proposed [28], e.g, based on the Poisson or the NB distribution, but no “optimal” method has been defined. Popular methods include, e.g., limma/voom [29], EdgeR [4], Deseq2 [30], or the nonparametric SAMseq method [31]. Adaptive filtering is equally applicable for all of these methods. It has, however, been shown [18, 32], that scenarios exist, where some of the proposed methods might not control the FDR. For our simulations we applied the limma/voom method, as, e.g., suggested by [18]. The results in Additional file 2: Figs. S8–S11, S20, S21 show that in most scenarios the FDR of the adaptive filter is maintained at level \(\alpha\) for \(l=5\) or even \(l=0\). Still, there exist some scenarios where the FDR is increased. However, this is not due to the adaptive filtering but due to fact that some of the individual (nonadaptive) filters do not control the FDR. In these cases the limma/voom procedure or the method for multiplicity adjustment (lfdr or BH) might not be appropriate. If the FDR is increased for one or several individual filters, it consequently might be increased when many filters are considered for the adaptive filter.
The properties of the filtering methods depend on the distribution of the collected data and thus on the applied technology. Here, we focus on RNAseq data; however, the proposed adaptive filter approach can also be applied for other types of highdimensional data, such as, e.g. for microarray data.
Conclusions
In RNAseq studies, filtering is an important processing step; however, there is no consensus on the choice of the filtering process or the threshold values. We investigated different simulation strategies and showed that it is not possible to identify a filter which is optimal for all simulation scenarios. Depending on the distributional scenario, mean or maxbased filters with adequate thresholds, the Jaccard, or zerobased filters maximise the number of rejections. In many scenarios, the basic filter alone may be a good choice. This holds for many NB simulations with distributed parameters and is in line with the findings of Rau et al. (2013) [2]. However, for simulations, where the dependence structure between genes and distribution of dispersion and mean parameter is based on real data, and the real data analyses, a distinct improvement in the number of rejected hypotheses is observed if more advanced filtering methods are applied.
The proposed adaptive filtering procedure has practically no impact on the FDR in many simulation scenarios, if the filter leading to the largest number of rejections is selected and no additional adjustment for multiplicity for the number of considered filters is performed. If, however, the proposed adaptive procedure rejects only a small number of hypotheses, the researcher has to stick to a previously defined reference filter to avoid FDR inflation. For small number of hypotheses m we have no theoretical proof that FDR control of the procedure can be guaranteed. We show by simulations, that for finite l, FDR control can be achieved by choosing a larger threshold l if m is small. Exceptions were observed for some scenarios of the SimSeq, PROPER and NB distributed simulations. However, for these, some of the (nonadaptive) filters do not control the FDR, and thus also the adaptive filter inflates the level (as explained in the Discussion). Note that choosing a larger threshold l comes at the cost that the procedure becomes less adaptive, because only filters can be chosen, where more than l hypotheses are rejected. While we cannot provide analytical formulas to guide the choice of l, we show by simulations that, in the considered scenarios, for \(m \ge 1000\) and \(l=5\), no inflation of the FDR by the adaptive filter is observed, even under the global null hypothesis. For \(l=3\) FDR control is observed in these scenarios when \(m\ge 2500\).
Methods
We consider an RNAseq experiment comparing two groups of n independent samples with m null hypotheses \(H_{0i}\), \(i=1,\dots ,m\). The two groups are of size \(n_1\) and \(n_2\) with \(n_1+n_2=n\). The read count for gene i in sample j, \(j=1,\dots ,n\), and group g, \(g\in \{1,2\}\), is denoted by \(C_{ijg}\). We focus on twosided hypotheses \(H_{0i}: \mu _{1i}=\mu _{2i}\) versus \(H_{1i}: \mu _{1i}\ne \mu _{2i}\), where \(\mu _{1i}\) and \(\mu _{2i}\) denote the expected counts in groups 1 and 2 of the ith gene. For all simulated data sets, the trimmed mean of Mvalues normalisation method (TMM) was applied where reads are scaled by weighted logfoldchange values of a reference sample [13]. For the data analysis, we transformed the count data via the voom function and applied a linear model for each gene with the limma package in Bioconductor [29, 33]. The voom function converts the discrete read counts to continuous log2counts per million and the estimated variances are used as weights for weighted least square regression. To adjust for multiple testing, we show results for two different strategies: For one part of the simulations, the lfdr is estimated for each gene and all hypotheses with lfdr lower than the significance threshold \(\alpha =0.05\) are rejected. The lfdr for hypothesis i is defined as the posterior probability in a Bayesian mixture model that for hypothesis i the null hypothesis holds (for detailed explanations, see [15, 34]). For the calculation of the lfdrs the Rpackage fdrtool [35] was applied to the vector of pvalues with cutoff method false nondiscovery rate and using a modified Grenander approach for density estimation [15]. Second, we performed simulations where the BH procedure was applied to adjust for multiplicity and to control the FDR of the experiment at level \(\alpha =0.05\).
The order of data processing (filtering, normalisation and data analysis) is not definite. Normalisation is performed before the data analysis, yet, there are different approaches on when to apply the filtering step in the analysis pipeline [2, 28]. In the simulations and real data applications, we apply the following analysis pipelines: (a) normalise the data, perform the analysis and then perform the filtering step using the raw or the normalised data to reduce the set of genes. The multiple testing procedure is performed with the reduced set of genes after filtering; (b) first filter the raw data, then normalise them and perform the analysis.
Adaptive filter
We propose a new filtering strategy which combines several filtering methods:

1
First, a set of F different filters, \(F>0\), is defined, where one of the filtering methods is specified as reference filter. An integer filter parameter l is specified.

2
For a given data set, the F filters are applied. Each filter generates a set of candidate genes of different magnitude and for each set the data analysis is performed (or has been performed before, if preprocessing order (a) has been chosen). Then, multiple testing procedures are applied for each of the F sets of pvalues and the resulting numbers of rejected hypotheses \(R_1,...,R_F\) are calculated. \(R_f\), \(f=1,\dots ,F\), denotes the number of rejected hypotheses for filtering method f.

3
To determine the definite final analysis, the filtering method k is chosen where the largest number of hypotheses are rejected,
$$\begin{aligned} k=\text {arg max}_{f=1,\dots , F} R_f. \end{aligned}$$However, if \(R_k<l\), only the results of the reference filter may be applied.
The adaptive filter chooses the filtering strategy with the largest number of rejections; however, the multiple testing procedure  in our case lfdr or BH procedure, adjusts only for the number of genes but not for the number of filtering strategies. Thus, in principle, the FDR may be increased when the filtering method leading to the largest number of rejections is selected. However, we showed in the simulations, that the observed FDR applying the adaptive filter is below \(\alpha\) in many scenarios, as long as the FDR for each filter individually is below \(\alpha\). Hereafter we give a heuristic, asymptotic argument based on earlier work on sequential multiple tests controlling the FDR [36, 37], focusing on the BH procedure (which is more liberal than the lfdr controlling procedure). We assume that for each filtering method the FDR is controlled and consider two scenarios. First, assume that for a positive fraction of hypotheses the alternative holds (\(\pi _0<1\)). Then, if for each filter the selected test statistics are sufficiently independent and additional technical conditions apply [36], the BH procedure asymptotically controls the false discovery proportion (FDP), defined as the fraction of erroneously rejected hypotheses among all rejected hypotheses, and not only the FDR, its expected value (see, e.g., [38]). Thus, as the number of hypotheses increases, the FDPs for each filtering method are bounded almost surely by \(\alpha\). Consequently, this also holds for the maximum FDP across all considered filters. Therefore, the level of the multiple test using the adaptive filter is asymptotically bounded by \(\alpha\) (compare Theorem 1 in [36]). In the second scenario, under the global null hypothesis (\(\pi _0=1\)), the BH procedure does not control the FDP (as it is either 0 or 1 in this case) and the above argument cannot be applied. However, in this case asymptotic FDR control follows because the adaptive filter chooses the reference filter if none of the filters leads to more than l rejections: Choosing \(l_m=q m,\) for some \(q>0\) and assuming that the filtered pvalues are independent, it follows, that the probability that more than \(l_m\) hypotheses are rejected by the BH procedure, converges to 0. In this case the adaptive filter selects almost surely the reference filter. As the multiple test based on the reference filter controls the FDR, this follows also for the adaptive filter (see Theorem 2 in [36]).
It has been shown [18] that for some analysis methods as, e.g., limma/voom, EdgeR, or Deseq2, scenarios exist, where after adjustment for multiplicity the actual FDR level is not maintained at the predefined level \(\alpha\) for each filter individually. In this case, also the adaptive filter might not control the FDR at level \(\alpha\).
Availability of data and materials
For the simulation studies and the real data application the following data sets were used (all of them publicly available, only the Yuen data were provided by the authors): Kidney [6]: Data obtained from Rpackage SimSeq [9]. Bottomly [7]: Available at http://bowtiebio.sourceforge.net/recount/. We obtained the data from the Rpackage dexus [39]. Mouse mammary [10]: Available at https://figshare.com/s/1d788fd384d33e913a2a. Sultan [8]: Available at http://bowtiebio.sourceforge.net/recount/. Airway: Data obtained from Rpackage airway [19]. Yuen [20]: Raw data provided by the authors. Cheung [12]: Data obtained from Rpackage PROPER [11].
Abbreviations
 BH:

Benjamini–Hocberg
 CPM:

counts per million
 DE:

differentially expressed
 FDP:

False discovery proportion
 FDR:

False discovery rate
 lfdr:

Local false discovery rate
 NB:

Negative binomial
 RNAseq:

RNA sequencing
 TMM:

trimmed mean of Mvalues normalization
References
Kim S, Schliekelman P. Prioritizing hypothesis tests for high throughput data. Bioinformatics. 2016;32(6):850–8.
Rau A, Gallopin M, Celeux G, Jaffrézic F. Databased filtering for replicated highthroughput transcriptome sequencing experiments. Bioinformatics. 2013;29(17):2146–52.
van Iterson M, Boer J, Menezes R. Filtering, FDR and power. BMC Bioinformatics. 2010;11(450):1–11.
Robinson M, McCarthy D, Smyth G. edger: a bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics. 2010;26(1):139–40.
Bourgon R, Gentleman R, Huber W. Independent filtering increases detection power for highthroughput experiments. PNAS. 2010;107(21):9546–51.
The Cancer Genome Atlas Research Network. Comprehensive molecular characterization of clear cell renal cell carcinoma. Nature. 2013;499:43–9.
Bottomly D, Walter N, Hunter J, Darakjian P, Kawane S, Buck K, Searles R, Mooney M, McWeeney S, Hitzemann R. Evaluating gene expression in C57BL/6J and DBA/2j mouse striatum using RNASeq and microarrays. PLoS ONE. 2011;6(3):1–8.
Sultan M, Schulz M, Richard H, Magen A, Klingenhoff A, Scherf M, Seifert M, Borodina T, Soldatov A, Parkhomchuk D, Schmidt D, O’Keeffe S, Haas S, Vingron M, Lehrach H, Yaspo M. A global view of gene activity and alternative splicing by deep sequencing of the human transcriptome. Science. 2008;15:956–60.
Benidt S, Nettleton D. Simseq: a nonparametric approach to simulation of RNAsequence datasets. Bioinformatics. 2015;31:2131–40.
Fu N, Rios A, Pal B, Soetanto R, Lun A, Liu K, Beck T, Best S, Vaillant F, Bouillet P, Strasser A, Preiss T, Smyth GK, Lindeman G, Visvader J. EGFmediated induction of Mcl1 at the switch to lactation is essential for alveolar cell survival. Nat Cell Biol. 2015;17(4):365–75.
Wu H, Wang C, Wu Z. Proper: comprehensive power evaluation for differential expression using RNAseq. Bioinformatics. 2015;31(2):233–41.
Cheung V, Nayak R, Wang I, Elwyn S, Cousins S, Morley M, Spielman R. Polymorphic cis and transregulation of human gene expression. PLoS Biol. 2010;8(9):1–14.
Robinson M, Oshlack A. A scaling normalization method for differential expression analysis of RNAseq data. Genome Biol. 2010;11(R25):1–9.
Efron B. Size, power and false discovery rates. Ann Stat. 2007;35:1351–77.
Strimmer K. A unified approach to false discovery rate estimation. BMC Bioinform. 2008;9:303–17.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B. 1995;57:289–300.
R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria.2018; R Foundation for Statistical Computing. http://www.Rproject.org
Soneson C, Delorenzi M. A comparison of methods for differential expression analysis of RNAseq data. BMC Bioinform. 2013;14(91):1–18.
Himes E, Jiang X, Wagner P, Hu R, Wang Q, Klanderman B, Whitaker M, Duan Q, LaskySu J, Nikolos C, Jester W, Johnson M, Panettieri A, Tantisira G, Weiss T, Lu Q. Rnaseq transcriptome profiling identifies crispld2 as a glucocorticoid responsive gene that modulates cytokine function in airway smooth muscle cells. PLoS ONE. 2014;9(6):1–13.
Yuen B, Polzin J, Petersen J. Organ transcriptomes of the lucinid clam Loripes orbiculatus (Poli, 1791) provide insights into their specialised roles in the biology of a chemosymbiotic bivalve. BMC Genomics. 2019;20:820.
Bauer P, Koenig F, Brannath W, Posch M. Selection and biastwo hostile brothers. Stat Med. 2010;29(1):1–13.
Graf A, Bauer P, Glimm E, Koenig F. Maximum type 1 error rate inflation in multiarmed clinical trials with adaptive interim sample size modifications. Biom J. 2014;56(4):614–30.
Zehetmayer S, Posch M. Post hoc power estimation in largescale multiple testing problems. Bioinformatics. 2010;26(8):1050–6.
Efron B, Tibshirani R. Empirical bayes methods and false discovery rates for microarrays. Genet Epidemiol. 2002;23(1):70–86.
Efron B. Correlation and largescale simultaneous significance testing. J Am Stat Assoc. 2007;102:93–103.
Qiu X, Brooks AI, Klebanov L, Yakovlev A. The effects of normalization of the correlation structure of microarray data. BMC Bioinform. 2005;6:1–11.
Korthauer K, Kimes P, Duvallet C, Reyes A, Subramanian A, Teng M, Shukla C, Alm E, Hicks S. A practical guide to methods controlling false discoveries in computational biology. Genome Biol. 2019;20(118):1–21.
Lin Y, Golovnina K, Chen Z, Lee H, Negron Y, Sultana H, Oliver B, Harbison S. Comparison of normalization and differential expression analyses using RNAseq data from 726 individual drosophila melanogaster. BMC Genom. 2016;17(28):1–20.
Ritchie M, Phipson B, Wu D, Hu Y, Law C, Shi W, Smyth G. Limma powers differential expression analyses for RNAsequencing and microarray studies. Nucleic Acids Res. 2014;43(7):1–13.
Love M, Huber W, Anders S. Moderated estimation of fold change and dispersion for RNAseq data with deseq2. Genome Biol. 2014;15(550):1–21.
Li J, Tibshirani R. Finding consistent patterns: a nonparametric approach for identifying differential expression in RNAseq data. Stat Methods Med Res. 2013;22(5):519–36.
Burden C, Qureshi S, Wilson S. Error estimates for the analysis of differential expression from RNAseq count data. Peer J. 2014;2:1–26.
Law C, Chen Y, Shi W, Smyth GK. voom: Precision weights unlock linear model analysis tools for RNAseq read counts. Genome Biol. 2014;15(R29):1–17.
Efron B, Tibshirani R. On testing the significance of sets of genes. Annals Appl Stat. 2007;1:107–29.
Klaus B, Strimmer, K. Fdrtool: Estimation of (Local) False Discovery Rates and Higher Criticism. 2021; https://CRAN.Rproject.org/package=fdrtool
Posch M, Zehetmayer S, Bauer P. Hunting for significance with the false discovery rate. J Am Stat Assoc. 2009;104(486):832–40.
Zehetmayer S, Graf A, Posch M. Sample size reassessment for a twostage design controlling the false discovery rate. Stat Appl Genet Mol Biol. 2015;15(5):429–42.
Storey JD. A direct approach to false discovery rates. J R Stat Soc B. 2002;64:479–98.
Klambauer G, Unterthiner T, Hochreiter S. Dexus: identifying differential expression in RNAseq studies with unknown conditions. Nucleid Acids Res. 2013;41(21):198–198.
Acknowledgements
Not applicable.
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
SZ performed the simulation studies and real data applications, interpreted the results and drafted the manuscript. MP supervised the project, interpreted the results and revised the manuscript. AG contributed to the design of the simulation studies, interpreted the results and revised the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent to publish
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
Additional information on simulation strategies and on real data is presented.
Additional file 2.
Extension of the simulation studies from the manuscript (additional data sets, parameters and modified order of data processing, BH procedure, values of simulated FDRs and influence of filter parameter l; distribution of lfdrs in real data).
Additional file 3.
Data example for the Rcode from Additional file 4.
Additional file 4.
Example code for real data example for programming language R.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Zehetmayer, S., Posch, M. & Graf, A. Impact of adaptive filtering on power and false discovery rate in RNAseq experiments. BMC Bioinformatics 23, 388 (2022). https://doi.org/10.1186/s1285902204928z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s1285902204928z
Keywords
 Next generation sequencing
 Gene expression
 Multiple testing
 Gene filter