 Research article
 Open access
 Published:
Differential expression analysis using a modelbased gene clustering algorithm for RNAseq data
BMC Bioinformatics volume 22, Article number: 511 (2021)
Abstract
Background
RNAseq is a tool for measuring gene expression and is commonly used to identify differentially expressed genes (DEGs). Gene clustering is used to classify DEGs with similar expression patterns for the subsequent analyses of data from experiments such as timecourses or multigroup comparisons. However, gene clustering has rarely been used for analyzing simple twogroup data or differential expression (DE). In this study, we report that a modelbased clustering algorithm implemented in an R package, MBCluster.Seq, can also be used for DE analysis.
Results
The input data originally used by MBCluster.Seq is DEGs, and the proposed method (called MBCdeg) uses all genes for the analysis. The method uses posterior probabilities of genes assigned to a cluster displaying nonDEG pattern for overall gene ranking. We compared the performance of MBCdeg with conventional R packages such as edgeR, DESeq2, and TCC that are specialized for DE analysis using simulated and real data. Our results showed that MBCdeg outperformed other methods when the proportion of DEG (P_{DEG}) was less than 50%. However, the DEG identification using MBCdeg was less consistent than with conventional methods. We compared the effects of different normalization algorithms using MBCdeg, and performed an analysis using MBCdeg in combination with a robust normalization algorithm (called DEGES) that was not implemented in MBCluster.Seq. The new analysis method showed greater stability than using the original MBCdeg with the default normalization algorithm.
Conclusions
MBCdeg with DEGES normalization can be used in the identification of DEGs when the P_{DEG} is relatively low. As the method is based on gene clustering, the DE result includes information on which expression pattern the gene belongs to. The new method may be useful for the analysis of timecourse and multigroup data, where the classification of expression patterns is often required.
Background
RNAseq is commonly used to obtain genomewide expression data for genes [1, 2] and to identify differentially expressed genes (DEGs) for different groups or conditions [3, 4]. To date, several methods to enable the analysis of RNAseq data have been developed, including normalization [5,6,7,8,9,10], various R packages [11,12,13,14,15,16], and graphical user interfaces (GUI) [17,18,19]. Research on more efficient and accurate methods to identify DEGs continues, and new findings continue to be reported by researchers [20,21,22,23,24,25].
Obtaining a ranked gene list for the degree of differential expression (DE) is a starting point for gaining biological insights into the groups being compared [26]. Several analysis methods such as gene ontology and the construction of coexpression networks have been used to examine the biological mechanisms underlying DEGs [25]. Additionally, gene clustering based on the similarity of expression patterns has been widely used to group and classify DEGs [27,28,29]. Gene clustering has also been used for timecourse and multigroup data in which several expression patterns may exist. However, the method is usually not used to classify DEGs obtained by twogroup comparisons which is the minimum size for a comparative analysis and is used even less to identify DEGs.
In this study, we propose the use of modelbased clustering algorithms for the identification of DEGs from RNAseq count data. Although various sophisticated algorithms for gene clustering are available [30,31,32], we focus our analysis on the R package MBCluster.Seq [28], as its framework is compatible with DE analysis and it is comparable with other R packages dedicated to detecting DEGs. We describe the application of the modelbased gene clustering method and the incorporation of a robust normalization algorithm called DEGES [7, 14] for detecting DEGs. Next, we compare the method with other competing packages dedicated to DE analysis such as edgeR [11], DESeq2 [15], and TCC [14] using simulated data and real data. Further, we discuss the potential limitations of the method and present a set of guidelines for practical use.
Results
Proposed method for identification of DEGs based on gene clustering
In this study, we devised a new analysis method that uses the functionalities of the MBCluster.Seq package. Therefore, for consistency and clarity, we used notations that were similar to those described in the original paper [28]. First, we outlined a method to describe the input/output relationship. We denote an input count matrix as one where each row indicates a gene g (= 1, …, G), each column a replicate j (= 1, …, n_{i}) of group i (= 1, …, I), and each cell the number of counts. Here, G is the number of genes, I is the number of compared groups, and n_{i} is the number of replicates for the group i. MBCluster.Seq clusters gene vectors β_{g} = (β_{g1}, …, β_{gI}), where β_{gi} indicates the count of gene g in the group i relative to the overall mean on a logscale. Therefore, the summation of β_{gi} for a gene g across all compared groups was 0. β_{g} can be described as the log foldchange (FC) between compared groups. Given a preselected number of clusters K, MBCluster.Seq gives two results as an output. One is the center for cluster k, μ_{k} = (μ_{k1}, …, μ_{kI}) for k = 1, …, K, and the other is the posterior probability (PP) that gene g belongs to the kth cluster, p_{g} = (p_{g1}, …, p_{gK}) for g = 1, …, G.
A ranked gene list for a cluster mainly consisting of nonDEGs can be obtained via MBCluster.Seq by using the assigned PPs. To identify the nonDEG cluster, we consider the L^{2} Norm of μ_{k} for each cluster center across groups, μ_{k}_{2} = (μ_{k1}^{2} + ⋯ +μ_{kI}^{2})^{1/2}. A smaller value of the norm for cluster k indicates a smaller degree of DE across groups for the cluster. Accordingly, we can regard the probability of a gene being located in the kth column as that in the nonDEG cluster, where k = argmin(μ_{1}_{2}, …, μ_{K}_{2}). A lower value of the PP for gene g in the kth cluster (i.e., p_{gk}) indicates a higher degree of DE between the compared groups. For simplicity, we call the proposed method based on MBCluster.Seq as “MBCdeg”.
MBCluster.Seq employs a scaling normalization algorithm [33] as the default, where the upper quartile (i.e., 75th percentile) counts for individual samples are used as the scaling factors to obtain equal values for upper quartile counts across all samples after the normalization. This type of conventional normalization algorithm assumes that the proportion of DEGs (P_{DEG}) in the data is small (e.g., less than 5%) or that the proportion of genes upregulated in individual groups in the DEGs is approximately balanced (i.e., P_{1} ≈ P_{2} when comparing groups 1 and 2; P_{1} + P_{2} = 1) [34,35,36]. However, in practice, these assumptions are invalid in certain cases, such as when P_{DEG} ≈ 60% [37] and P_{1} > > P_{2} [38]. To investigate the effect of various normalization algorithms on the data analysis, we employed a competing method (called DEGES) [7, 14]. The main arguments in its favor are (1) DEGES was originally designed to manipulate such scenarios (~ 25% of P_{DEG} with P_{1} > > P_{2}), (2) it can be applied to ~ 60% of P_{DEG} [35], and (3) the output (i.e., normalization factors) can easily be applied to the framework of MBCluster.Seq. Henceforth, we refer to MBCdeg using the default normalization algorithm and with the DEGES normalization algorithm as “MBCdeg1” and “MBCdeg2”, respectively.
Analysis of simulated data for a twogroup comparison
We show an example of MBCdeg based analysis for simulated data for two groups: G = 10,000, n_{1} = n_{2} = 3, P_{DEG} = 0.25, P_{1} = 0.9 (or P_{2} = 0.1), and FC = 4. We performed a run for MBCdeg with K = 3, assuming three expression patterns: upregulated in group 1 (“DEG1” pattern), upregulated in group 2 (“DEG2”), and consistent in both groups (“nonDEG”). Using this approach, we ideally obtain the centers for the cluster k (= 1, 2, 3) as μ_{1} = (0.69, − 0.69), μ_{2} = (− 0.69, 0.69), and μ_{3} = (0.00, 0.00), with log_{e}(2) = 0.69. Clearly, the third cluster has the smallest L^{2} Norm (i.e., μ_{3}_{2} = 0). We therefore regard this cluster as containing many nonDEGs and used the PPs assigned to this cluster for estimating the overall degree of DE.
Here, MBCdeg1 gives the output μ_{1} = (0.56, − 0.56), μ_{2} = (− 0.14, 0.14), and μ_{3} = (− 0.81, 0.81) and uses the PPs of the second cluster displaying the smallest norm (μ_{2}_{2} = 0.195) for gene ranking. Meanwhile, MBCdeg2 outputs μ_{1} = (0.68, − 0.68), μ_{2} = (− 0.69, 0.69), and μ_{3} = (− 0.02, 0.02) and uses the PPs of the third cluster displaying the smallest norm (μ_{3}_{2} = 0.027) for gene ranking. The expression patterns for the cluster centers from MBCdeg2 were closer to the ideal patterns than those from MBCdeg1. This result suggests that the DEGES normalization may be useful in the framework for MBCdeg, at least in similar scenarios.
Next, we evaluated the performance of the overall gene ranking using the area under the receiver operating characteristic (ROC) curve (i.e., AUC). The AUC enables data comparisons without a tradeoff in sensitivity and specificity because the ROC curve is created by plotting the true positive rate (i.e., sensitivity) against the false positive rate (1 − specificity) obtained for each possible threshold value [39,40,41]. Therefore, an accurate method should provide high AUC values. We compared five methods: two clusteringbased methods (MBCdeg1 and MBCdeg2) and three conventional methods (edgeR [11], DESeq2 [15], and TCC [14]). The edgeR and DESeq2 packages are widely used [25]. TCC is used as the main alternative to MBCdeg as it utilizes the DEGES normalization algorithm.
Figure 1 shows the AUC values for the five methods using various simulations: P_{DEG} = 0.05 and 0.25, with P_{1} = 0.5, 0.7, 0.9, and 1.0. A higher P_{1} value indicates a higher degree of upregulated DEGs in group 1, ranging from symmetric (P_{1} = 0.5) to completely asymmetric (P_{1} = 1.0) conditions. The AUC values for the two MBCdeg methods were higher than those from the conventional DE methods. TCC showed the best among the three conventional methods because the simulated data was generated using this package and the DEGES normalization algorithm in TCC was originally designed to manipulate such asymmetric scenarios (i.e., P_{1} > 0.5). Therefore, the high performance of MBCdeg over TCC is an interesting result.
The performance of MBCdeg does not appear to depend on whether the simulation scenario is symmetric or asymmetric. Most of the trials of MBCdeg showed AUC values of 0.93, and the range of P_{1} from 0.5 to 0.9, suggesting that the framework of MBCdeg is intrinsically robust for both symmetric and asymmetric data. As indicated above, we confirmed that MBCdeg2 tends to have lower norm values for nonDEG clusters (i.e., μ_{k}_{2} with k = argmin(μ_{1}_{2}, …, μ_{K}_{2})) than MBCdeg1 in scenarios with P_{1} > 0.5. This can be explained by the use of DEGES in the MBCdeg2 algorithm.
The overall performance of MBCdeg2 was very similar to that of MBCdeg1 although the former performs better than the latter in completely asymmetric scenarios (i.e., P_{1} = 1.0). We hypothesized that the key to accurate gene ranking may be to identify nonDEG cluster, and not to make the ideal nonDE pattern. This trend was also observed when the number of replicates per group was increased to n_{1} = n_{2} = 6, 9, and 12 (Additional file 1). In a comparison of the performance of each method using different numbers of replicates (Fig. 1 and Additional file 1), we observed that AUC values tend to increase as the number of replicates increases and this trend is consistent with a previous report [20].
Effect on different numbers of clusters
We noted that MBCdeg tends to increase the variation in AUC between trials in association with an increase in P_{1} values, and this effect was greatest at P_{1} = 1.0. For example, the AUC values for MBCdeg1 and MBCdeg2 were less than 0.8 for ten and three trials, respectively, when P_{DEG} = 0.05 (Fig. 1). The relatively poor performance of MBCdeg at P_{1} = 1.0 than with other values of P_{1} can be explained by the difference between the true number of clusters (i.e., K_{truth} = 2) in this condition and the number of clusters that were used (K = 3). The simulated data obtained with P_{1} = 1.0 has two expression patterns; “DEG1” and “nonDEG”, and does not have the “DEG2” pattern.
To demonstrate the effect of using MBCdeg on a predefined number of clusters, we investigated the AUC values for MBCdeg with K = 2–4 (Fig. 2). Our results showed that the AUC values were the highest when K = K_{truth}. The highest AUC values for P_{1} = 0.5, 0.7, 0.9, and 1.0 were obtained using K = 3, 3, 3, and 2, respectively (indicated by the downward arrow in light blue). This result suggests that the use of an accurate number of clusters is important when performing an analysis using MBCdeg. The distributions of the AUC values indicate the K values that should be used in practice. At P_{1} = 0.5 and 0.7 (i.e., K_{truth} = 3), the results for K > K_{truth} (i.e., K = 4) were more accurate than those with K < K_{truth} (i.e., K = 2). Further, this trend was observed when the number of replicates per group was increased to n_{1} = n_{2} = 6, 9, and 12 (Additional file 2).
In practice, it may be safe to adopt a larger K value. For twogroup comparisons, the user would only need to run MBCdeg with K ≥ 3. Although the frequency of trials that result in a low performance of gene ranking is relatively high at larger P_{1} values, the probability of obtaining extremely asymmetric results such as P_{1} = 1.0 is low, and may at most indicate P_{1} = 0.9. Therefore, both methods (MBCdeg1 and MBCdeg2) may be useful in scenarios that are similar to the conditions investigated.
Although the probability of extremely low performance at P_{1} ≤ 0.9 is at most 2%, we should discuss the reasons. For example, the use of MBCdeg2 with K = 3 outputs one such result (AUC = 0.634) with P_{DEG} = 0.25 and P_{1} = 0.5. As this simulated data consists of 1250 DEG1, 1250 DEG2, and 7500 nonDEG patterns, almost all trials with high AUC values (> 0.92) gave three clusters, each of which consisted of many genes that resembled one of the three patterns, and having one predominant pattern (Table 1a). However, for the trial with low AUC value (0.634), the numbers of genes in the three clusters were 1299, 8670, and 31, respectively (Table 1b). Of these, the first cluster consisted of the most genes showing the DEG2 pattern, i.e., 12 DEG1, 935 DEG2, and 352 nonDEG patterns. The second cluster consisted of a great majority of genes with nonDEG patterns, i.e., 1238 DEG1, 289 DEG2, and 7143 nonDEG patterns. As this nonDEG cluster contains 1238/1250 = 99.0% of the genes with a true DEG1 pattern, these ranking inaccuracies may be responsible for the low AUC values obtained. As per our analysis, most low AUC values result due to the incorporation of DEGs (i.e., the DEG1 or DEG2 patterns) into the nonDEG clusters.
The third cluster shown in Table 1b had very few genes (i.e., 26 DEG2 and 5 nonDEGs). These results indicate that the first two clusters determine the performance of the trial. The results from using K = 2 with the same simulation conditions (i.e., P_{DEG} = 0.25 and P_{1} = 0.5 in Fig. 2) indicate that the distribution of AUC values located around 0.63 may thus be reasonable. Similar inferences can be made for other results, for example, with P_{DEG} = 0.25 and P_{1} = 0.7. As the simulated data consists of 1750 DEG1, 750 DEG2, and 7500 nonDEG patterns, MBCdeg with K = 2 tends to output one cluster that is mainly composed of nonDEG and DEG2 genes, with the second cluster mainly composed of DEG1 genes. The median AUC values (≈ 0.77) when using MBCdeg with K = 2 at P_{1} = 0.7 are higher than those (≈ 0.63) at P_{1} = 0.5, and this can be explained by the smaller number of true DEG patterns (750 < 1250) contained in the nonDEG cluster. As this phenomenon was observed using both MBCdeg1 and MBCdeg2, it does not result due to the differences in the normalization algorithms. MBCdeg determines clusters stochastically, and therefore an output of results that appear as outliers will be obtained with a certain probability.
Effect on different degrees of DE
For the simulation analysis described above, the degree of DE was fixed at fourfold (i.e., FC = 4), which limits the expression pattern of genes upregulated in a group to one, which is favorable when using MBCdeg. However, in practice, the degree of DE would differ for genes. Therefore, we performed simulations using different degrees of DE [7], where the FCs for DEGs were randomly sampled from “1.2 + a gamma distribution with shape = 2.0 and scale = 0.5.” Accordingly, the minimum and mean foldchange were approximately 1.2 and 2.2 (= 1.2 + 2.0 × 0.5), respectively.
The results of the analysis indicated that greater variability in the performance of MBCdeg is observed compared to the results obtained using fixed FC, as shown in Fig. 1 (Additional file 3). AUC values are lower overall than those from the fixed FC comparison (Fig. 1) in the same condition, and this can be explained by the lower degree of DE (fourfold → 2.2fold). Though MBCdeg gave superior results than other packages (edgeR, DESeq2, and TCC) with P_{DEG} = 0.25, it did not perform as well using P_{DEG} = 0.05. This may occur due to the small number of DEGs (10,000 × 0.05 = 500 genes) under the conditions used for analysis and the resulting instability of clusters that mainly consisted of DEG1 or DEG2 patterns. As the total number of DEGs is relatively large with P_{DEG} = 0.25, clusters containing more DEG1 or DEG2 patterns are more likely to result and are probably more stable.
Notably, the AUC values for MBCdeg are not always the highest when K = K_{truth} (Additional file 4). With P_{DEG} = 0.25 and P_{1} = 0.9, the AUC values tend to increase as the number of clusters K increases. This may occur because the simulated data contains more expression patterns than K_{truth}. In the conditions used here, K_{truth} = 3 was used for convenience. However, genes upregulated in a group may show various degrees of DE, such as 2.1fold and 2.7fold, and allowing the formation of separate clusters would have reduced the possibility of the inclusion of these genes in the nonDEG cluster.
Effect on larger P_{DEG} values
The results described above were obtained with P_{DEG} ≤ 0.25 and K = 3, and it may be reasonable to expect the largest cluster to consist of many nonDEGs for P_{DEG} < 0.5. However, there may be instances where P_{DEG} > 0.5 [37, 42], and we investigated the effect of P_{1} = 0.5, 0.7, 0.9, and 1.0 on larger P_{DEG} values (= 0.45–0.75) (Fig. 3). Our results showed that MBCdeg gave high AUC values in most trials with P_{DEG} ≤ 0.55 and P_{1} ≤ 0.9. However, its performance was decreased drastically in other conditions (e.g., P_{1} ≥ 0.9 and P_{DEG} ≥ 0.65).
Overall, the performance of MBCdeg was similar to TCC, and there were few differences between the performance of MBCdeg1 and MBCdeg2. However, MBCdeg1 is superior to both TCC and MBCdeg2 for P_{DEG} = 0.75 and P_{1} = 0.7. This may be explained by the failure of DEGES normalization that was used in TCC and MBCdeg2. The DEGES normalization works well in the conditions where P_{DEG} ≤ 0.45 and P_{1} ≤ 1.0, P_{DEG} ≤ 0.55 and P_{1} ≤ 0.9, P_{DEG} ≤ 0.65 and P_{1} ≤ 0.7, and P_{DEG} ≤ 0.75 and P_{1} ≤ 0.5. However, the performance of the normalization decreases in other conditions, and these results are similar to those reported by Evans et al. [35].
Table 2 shows a representative result for MBCdeg for P_{DEG} = 0.75, and P_{1} = 0.7. In this condition, 5250 DEG1, 2250 DEG2, and 2500 nonDEG patterns were observed. MBCdeg1 gave three clusters, each of which consisted of many genes that resembled one of the three patterns, with a particular pattern predominating. In the trial shown in Table 2a, MBCdeg1 successfully identified the third cluster displaying the minimum norm value (= 0.3145) as the nonDEG cluster and produced an accurately ranked gene list with a high AUC value (= 0.9329). However, in the same trial shown in Table 2b, MBCdeg2 incorrectly determined the third cluster displaying the minimum norm value (= 0.0762) as the nonDEG cluster and produced an inaccurately ranked gene list with a low AUC value (= 0.2421). As the third cluster mainly consists of genes with the DEG1 pattern (4942/5637 = 87.7%), genes that belong to the first and second clusters will be located at the top of the ranked gene list. The AUC value (= 0.2421) may result due to genes in the first cluster showing predominantly DEG2 patterns (1979/2436 = 81.2%) that are correctly ranked at the top.
In the scenario where MBCdeg1 is inferior to MBCdeg2, we observed 22% of trials (= 11/50) with extremely low AUC values (< 0.2) for MBCdeg1 with P_{DEG} = 0.45 and P_{1} = 1.0. As this condition has 4500 DEG1 and 5500 nonDEG patterns, the accurate number of clusters is two (i.e., K_{truth} = 2). Table 3 shows the representative case of an MBCdeg trial with K = 3. We observed that MBCdeg1 incorrectly determined the third cluster that displayed the minimum norm value (0.4100) as nonDEG one and produced an inaccurately ranked gene list with an extremely low AUC value (= 0.1195). As this condition does not contain any DEG2 pattern, the failure to identify nonDEG cluster results in a nonideal and incorrectly ranked gene list. This produces several extremely inferior results (11/50 = 22% of trials) when using MBCdeg1. A greater number of successful trials using MBCdeg1 (39/50 = 78% of trials) with P_{DEG} = 0.45 and P_{1} = 1.0 may result due to the number of nonDEG patterns being greater than DEG1 patterns (i.e., 55:45). Similar explanations for the fewer successful cases using MBCdeg with P_{DEG} = 0.55 and P_{1} = 1.0 may be valid as the number of nonDEG patterns is fewer than the number of DEG1 patterns (i.e., 45:55). MBCdeg2 shows stable and relatively accurate performance for P_{DEG} ≤ 0.45, regardless of the value of P_{1} and it may be useful in these conditions. This trend was also observed when the number of replicates per group was increased to n_{1} = n_{2} = 6, 9, and 12 (Additional file 5).
Threegroup simulated data
Next, we investigated the performance of MBCdeg in a multigroup comparison. Tang et al. [43] evaluated the performance of 12 DE pipelines available across nine R packages (TCC [14], edgeR [11], DESeq [44], DESeq2 [15], limma [45], samr [46], PoissonSeq [47], baySeq [12], and EBSeq [13]) and recommended the use of TCC when performing threegroup count data. Therefore, we followed the conditions where TCC performed the best in the previous simulation analysis and investigated whether MBCdeg could exceed TCC as well as the other two methods (i.e., edgeR and DESeq2).
As in the evaluation study described [43], we focused on a threegroup data with equal numbers of replicates (i.e., three replicates per group; n_{1} = n_{2} = n_{3} = 3). The other simulation conditions were G = 10,000, P_{DEG} = 0.25, and FC = 4. For the proportion of upregulated DEGs in individual groups (P_{1}, P_{2}, P_{3}), we prepared a total of four conditions: (1/3, 1/3, 1/3), (0.6, 0.2, 0.2), (0.5, 0.5, 0.0), and (1.0, 0.0, 0.0). The numbers of true clusters K_{truth} for these conditions were 4, 4, 3, and 2, respectively. The first two conditions are the same as those used in the previous study, and the other two conditions were used to examine the effect on different K_{truth} values (i.e., 3 and 2). We compared a total of four K values (K = 2, 3, 4, and 5) when performing an analysis using MBCdeg. For the three packages (edgeR, DESeq2, and TCC), gene ranking was performed based on an ANOVAlike pvalue, where a low pvalue for a gene indicates a high degree of DE in at least one of the groups compared.
Figure 4 shows the boxplots of AUC values using these methods in the four conditions described. We observed that the AUC values were the highest when K = K_{truth} and that the performances with K > K_{truth} were higher than those with K < K_{truth}. Further, this trend was observed when the number of replicates per group was increased to n_{1} = n_{2} = n_{3} = 6, 9, and 12 (Additional file 6). However, for simulated data with variable FC values, AUC values for MBCdeg with K ≥ K_{truth} tended to be higher than those with K = K_{truth} (Additional file 7). This is consistent with the results of the twogroup data (Additional file 4). Together, these results indicate that MBCdeg yields better performance with larger K values (e.g., K > I + 1) when using real data with a group number I.
Twogroup real data
We examined the performance of MBCdeg for a real count dataset available from the recount2 database [48]. As with previous analyses, we compared a total of five methods: edgeR, DESeq2, TCC, MBCdeg1, and MBCdeg2. For the first three packages, genes with a false discovery rate (FDR) of 0.1 or higher were defined as nonDEGs. The other genes were identified as having DEG1 or DEG2 patterns in the direction of DE. Some may argue that this cutoff (10% FDR) is somewhat looser than the commonly used ones (e.g., 1% or 5%). However, we empirically know that even with such a loose threshold of 10% FDR, the number of genes satisfying the threshold will be lower than the true number of DEGs [20]. Hence, we decided that it is more reasonable to use the default TCC threshold of 10% FDR for the sake of comparison in the context of the MBCdeg results. For MBCdeg, we investigated the effect on different K values (= 3, 4, and 5). As previously described, genes belonging to the cluster with the smallest L^{2} Norm were considered as nonDEGs. The other genes were identified as having DEG1 or DEG2 patterns in the direction of DE, regardless of the cluster to which the genes belonged. As the true DE results are not known, we focus our attention on the similarities between the methods.
The real dataset (called “Pickrell”) consisting of 51,910 × 69 samples was designed to compare the expression levels of lymphoblastoid cell lines between 40 females and 29 males [49]. This dataset has been widely used for validation purposes [50]. Table 4 shows the results of the gene classification into one of the three patterns. Overall, MBCdeg1 with K = 5 showed (i) the maximum P_{DEG} value of (1291 + 3433)/51,910 = 0.0910, and (ii) the maximum degree of asymmetry, defined as max(P_{1}, P_{2}), of 3433/(1291 + 3433) = 0.7267. These values are within the range used in the simulation analysis (see Additional files 2 and 4). The values in parentheses indicate the average log_{2}(FC) values for the genes. Our results showed that the values for DEG1 and DEG2 are approximately 1.8 (i.e., the average FC is about 2^1.8 = 3.5), which is within the values of FC = 2.5 and 4 introduced in the current simulation analysis.
DESeq2 and TCC showed similar results (99.8% concordance), and edgeR and MBCdeg also showed similar results (> 97% concordance). Even the lowest concordance rate was found between DESeq2 and MBCdeg1 with K = 5 at 90.86% (see “Sheet1” in Additional file 8). This high concordance rate (≥ 90.86%) among the methods is reasonable as the maximum P_{DEG} value is 9.10% (i.e., mostly determined as nonDEGs). We observed a high similarity between the results from six MBCdeg methods, where the lowest concordance rate was found between MBCdeg1 with K = 5 and MBCdeg2 with K = 4 at 97.26%. This suggests that a cluster of DEG1 (or DEG2) patterns obtained by K = 3 is divided into subclusters when K = 4 or 5. Indeed, MBCdeg1 with K = 4 produced two clusters (containing 1939 genes and 1454 genes, respectively) assigned to the DEG2 pattern (see “Sheet2” in Additional file 8). Of a total of 3393 genes, 2713 genes were included in the 3298 DEG2 genes obtained by MBCdeg1 with K = 3 (Table 4).
Similar to the analysis using MBCdeg1 with K = 4, MBCdeg2 with K = 4 produced two clusters (containing 60 genes and 1291 genes, respectively) assigned to the DEG1 pattern (“Sheet2” in Additional file 8). Interestingly, the 1291 genes in the second cluster were identical to the 1291 DEG1 genes obtained using MBCdeg2 with K = 3, and 1290 of the 1291 genes were the same as those obtained using MBCdeg1 with K = 3–4. In the results obtained using MBCdeg2 with K = 4, we found that the representative expression patterns for the remaining 60 genes assigned to the DEG1 pattern (the cluster centers μ = (0.184, − 0.184)) were very similar to those assigned to the nonDEG pattern (μ = (0.014, − 0.014)) than the other 1291 genes to the DEG1 pattern (μ = (3.117, − 3.117)), given the degrees of DE. These 60 genes were assigned to nonDEG pattern at K = 3. Although we defined only one cluster with the smallest L^{2} Norm as of nonDEG, it may be better to define the clusters with low L^{2} Norm as of nonDEGs and to consider their assignments when using other K values.
In the results with K = 5, we observed that MBCdeg2 gave two DEG1 clusters containing 38 and 1291 genes, and two DEG2 clusters containing 1938 and 1364 genes. Additionally, MBCdeg1 gave one DEG1 cluster containing 1291 genes and three DEG2 clusters containing 1923, 39, and 1471 genes, respectively. As described earlier, the 1291 DEG1 genes obtained by MBCdeg2 with K = 5 were identical to those obtained by MBCdeg2 with K = 3–4 and 1290 out of the 1291 DEG1 genes were the same as those obtained by MBCdeg1 with K = 3–5. The degrees of DE in the three DEG2 clusters obtained when using MBCdeg1 were sorted in descending order of the clusters consisting of 1923, 39, and 1471 genes (“Sheet2” in Additional file 8). The 1962 genes from the first two DEG2 clusters were included in the DEG2 cluster containing 3298 genes, that was obtained by using MBCdeg1 with K = 3. However, 751 (or 720) of the remaining 1471 genes with the lowest degree of DE from the last DEG2 cluster, were included alone in the DEG2 (or nonDEG) cluster obtained by using MBCdeg1 with K = 3. These results suggest that the use of MBCdeg for DE analysis should take into account the fluctuation of expression patterns in clusters obtained at various K values, as well as the PPs assigned to each gene.
Discussion
Gene clustering has been used to classify DEGs with similar expression patterns. The MBCluster.Seq package was originally developed to be used as a postDE analysis tool. In this study, we propose the use of this modelbased gene clustering algorithm for DE analysis itself (i.e., the identification of DEGs). Although the creators of MBCluster.Seq have not envisioned this possibility, the DE framework based on the package (called MBCdeg) outperformed three other packages (edgeR, DESeq2, and TCC) dedicated to DEG identifications in many DE scenarios with P_{DEG} < 50%.
Several bioinformatics studies have made comparisons with typical conventional analysis methods and claimed about superior results by using the methods of interest [51]. However, a typical package may not be the best suited for the analysis. As demonstrated in this study, the less wellknown TCC package gave better results in our analysis than the typical packages (edgeR and DESeq2). The main contribution of this study is the demonstration that clusteringbased DE framework (MBCdeg) performed better than TCC under the scenarios for which TCC performed well.
MBCdeg2 (MBCdeg with robust DEGES normalization) was slightly more stable and accurate than MBCdeg1 (MBCdeg with the default normalization) when using the simulation analysis employed in our study. A common disadvantage of the MBCdeg is that in datasets with a very large proportion of DEGs (P_{DEG} ≥ 50%), the identification of the nonDEG cluster, which is the key to the framework proposed here, fails frequently and results in incorrect rankings. Therefore, conventional methods must be used in conjunction with MBCdeg to ensure that the overall similarities in the rankings are maintained. Additionally, it is necessary to verify various K values to investigate the clusterwise fluctuations for DEGs and the number of clusters identified as optimal by MBCdeg. While the current simulation analysis was done with TCC, there are several other simulation frameworks available (e.g., polyester [52] and countsimQC [53]). The proposed method requires (i) evaluation based on those simulation frameworks, (ii) real data with various experimental settings and organisms, and (iii) additional finetuning described above.
Conclusions
The modelbased gene clustering allowed by the MBCluster.Seq package is a promising tool for both the identification and classification of DEGs in one step. The proposed procedure, MBCdeg, can be used in the context of RNAseq count data in which the percentage of DEGs is less than half (P_{DEG} < 50%).
Methods
All analyses were performed using CRAN/R (ver. 3.6.3) [54] and Bioconductor [55]. The versions of the major R packages used were MBCluster.Seq ver. 1.0 [28], TCC ver. 1.26.0 [14], edgeR ver. 3.28.1 [11], DESeq2 ver. 1.26.0 [15], ROC ver. 1.6.3, and recount ver. 1.12.1. The Rcodes leading to the results described in this paper are available on GitHub (https://github.com/takosa/MBCdegpaper). A twogroup sample data and Rcodes (MBCdeg1 and MBCdeg2) for data execution are also provided.
Simulated data
The simulated data for two and threegroup comparisons were generated using the simulateReadCounts function in TCC [14]. The number of genes (G = 10,000) was given in the Ngene option. The number of replicates for individual groups (i.e., n_{1}, n_{2}, …, n_{I} for Igroup comparison) were specified in the replicates option. The proportion of DEGs (P_{DEG}) was given in the PDEG option. The assignment of DEGs upregulated in individual groups (i.e., P_{1}, P_{2}, …, P_{I}, and P_{1} + P_{2} + … + P_{I} = 1) was specified in the DEG.assign option. The fixed degrees of DE (FC = 4) were specified in the DEG.foldchange option. To generating different degrees of DE, the makeFCMatrix function was used, and the output object was used as the input for the fc.matrix option in the simulateReadCounts function. The output of the simulateReadCounts function was stored in the TCC class object with information about the simulation conditions and is therefore readytoanalyze in the DE analysis.
Real data
Pickrell’s real data was obtained by searching the recount2 database with the accession number “SRP001540”. The original count matrix (58,037 genes × 160 samples) consists of human data obtained from two different sequencing centers; one from Yale and the other from Argonne [48, 49]. Since both datasets have been found to show similar results [50], we analyzed the Yale count data of 79 samples alone. The matrix was collapsed by summing the data for technical replicates, resulting in a reduced number of columns/samples (79 → 69). Genes with a count of zero in all samples were excluded (58,037 → 51,910). DE analysis was performed using 40 female samples vs. 29 male samples.
DE analysis
DE analysis using edgeR was performed by applying the following functions with the default options in the sequence indicated: DGEList, calcNormFactors, estimateDisp, glmQLFit, glmQLFTest, and topTags. The pvalues for individual genes were obtained by the output of the topTags function. The genes were ranked in ascending order based on the pvalues and the ranks were used to calculate the AUC values. The AUC values were calculated using the AUC function in the ROC package. The pvalues were adjusted for multiple testing by using the Benjamini–Hochberg procedure [56]. The adjusted pvalues (qvalues) were obtained using the p.adjust function with the method = ”BH” option. Genes that had a qvalue greater than 0.1 were defined as having a nonDEG pattern. The log_{2}(FC) values for individual genes were obtained from the output of the topTags function (the logFC column in the table slot). Genes that showed a qvalue less than 0.1, and genes with log_{2}(FC) values less (or greater) than 0 were defined as having a DEG1 (or DEG2) pattern.
DE analysis using DESeq2 [15] was performed by applying the following functions with default options in the sequence indicated: DESeqDataSetFromMatrix, DESeq, and results. The pvalues for individual genes were obtained by using the output of the results function (the pvalue column). The adjusted pvalues (qvalues) were obtained from the output of the results function (the padj column). The other procedures followed were the same as those described in edgeR.
DE analysis using TCC was performed by using the following functions with default options in the sequence indicated: new, calcNormFactors, estimateDE, and getResult. The gene ranking information and qvalues were obtained directly from the output of the getResult function. The other procedures were the same as those described in edgeR. The normalization factors assigned for individual samples were obtained from the output of the calcNormFactors function in TCC. The normalization factors were converted to size factors, and the logtransformed values were used in the Normalizer option in the RNASeq.Data function when using MBCdeg2.
The DE analysis based on the MBCluster.Seq method [28] (i.e., MBCdeg) was performed by applying the following functions in sequence: RNASeq.Data, KmeansPlus.RNASeq, and Cluster.RNASeq. The Normalizer = NULL option in the RNASeq.Data function was used when performing an analysis using MBCdeg1 as it corresponds to the default normalization algorithm [33] employed in MBCluster.Seq. The preselected number of clusters K was introduced in the nK option in the KmeansPlus.RNASeq function. The negative binomial model (“nbinom”) was used in the model option in both KmeansPlus.RNASeq and Cluster.RNASeq functions. The output of the KmeansPlus.RNASeq function was used as the initial cluster center when executing the Cluster.RNASeq function. The expectation–maximization (EM) algorithm was used to iteratively update the estimates of clusters and their centers. This corresponds to the method = “EM” option in the Cluster.RNASeq function. The centers for K clusters (k = 1, …, K) across I groups (i = 1, …, I), μ_{ki}, were used to calculate the L^{2} Norm values μ_{k}_{2} for individual clusters. The information for cluster centers and the PPs for individual genes (g = 1, …, G) across clusters were obtained as the outputs of the Cluster.RNASeq function. Genes in a cluster that had the smallest L^{2} Norm value were regarded as nonDEGs. The other genes were determined to have DEG1 or DEG2 patterns in the direction of DE when performing a twogroup comparison (I = 2). The overall gene ranking was performed based on the PPs assigned to the nonDEG cluster.
Availability of data and materials
The dataset (SRP001540) analyzed during the current study is available in the recount2 website, [https://jhubiostatistics.shinyapps.io/recount/]. The Rcodes leading to the results described in this paper are available on GitHub, [https://github.com/takosa/MBCdegpaper]. A twogroup sample data and Rcodes (MBCdeg1 and MBCdeg2) for data execution are also provided.
Abbreviations
 ANOVA:

Analysis of variance
 AUC:

The area under the receiver operating characteristic curve
 β _{ gi } :

Count of gene g in group i relative to the overall mean on logscale
 DE:

Differential expression
 DEG:

Differentially expressed gene
 DEG1:

Expression pattern upregulatd in group 1
 DEG2:

Expression pattern upregulatd in group 2
 EM:

Expectationmaximization
 FC:

(Degree of) foldchange
 G:

Number of genes
 GUI:

Graphical user interface
 I :

Number of compared groups
 K :

Preselected number of clusters
 K _{ truth } :

True number of clusters
 MBCdeg:

The proposed DEG identification procedure basedon gene clustering with MBCluster.Seq
 MBCdeg1:

MBCdeg with default normalization algorithm
 MBCdeg2:

MBCdeg with a robust normalization algorithm called DEGES
 μ _{ k } :

Center for cluster k
 n _{ i } :

Number of replicates for group i
 nonDEG:

No differential expression pattern between groups
 p _{ gk } :

Posterior probability (PP) of gene g belonging to the kth cluster
 P _{ i } :

Proportion of upregulated DEGs in group i
 P _{ DEG } :

Proportion of DEG
 PP:

Posterior probability
 ROC:

Receiver operating characteristic
References
Mortazavi A, Williams BA, McCue K, Schaeffer L, Wold B. Mapping and quantifying mammalian transcriptomes by RNASeq. Nat Methods. 2008;5:621–8.
Marioni JC, Mason CE, Mane SM, Stephens M, Gilad Y. RNAseq: an assessment of technical reproducibility and comparison with gene expression arrays. Genome Res. 2008;18:1509–17.
Kudo A, Shigenobu S, Kadota K, Nozawa M, Shibata TF, Ishikawa Y, et al. Comparative analysis of the brain transcriptome in a hyperaggressive fruit fly Drosophila prolongata. Insect Biochem Mol Biol. 2017;82:11–20.
Ohde T, Morita S, Shigenobu S, Morita J, Mizutani T, Gotoh H, et al. Rhinoceros beetle horn development reveals deep parallels with dung beetles. PLoS Genet. 2018;14:e1007651.
Robinson MD, Oshlack A. A scaling normalization method for differential expression analysis of RNAseq data. Genome Biol. 2010;11:R25.
Risso D, Schwartz K, Sherlock G, Dudoit S. GCcontent normalization for RNAseq data. BMC Bioinform. 2011;12:480.
Kadota K, Nishiyama T, Shimizu K. A normalization strategy for comparing tag count data. Algorithms Mol Biol. 2012;7:5.
Li J, Witten DM, Johnstone IM, Tibshirani R. Normalization, testing, and false discovery rate estimation for RNAsequencing data. Biostatistics. 2012;13:523–8.
Maza E, Frasse P, Senin P, Bouzayen M, Zouine M. Comparison of normalization methods for differential gene expression analysis in RNAseq experiments: a matter of relative size of studied transcriptomes. Commun Integr Biol. 2013;6:e25849.
Tran DT, Bhaskara A, Kuberan B, Might M. A graphbased algorithm for RNAseq data normalization. PLoS ONE. 2020;15:e0227760.
Robinson MD, McCarthy DJ, Smyth GK. edgeR: a bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics. 2010;26:139–40.
Hardcastle TJ, Kelly KA. baySeq: empirical Bayesian methods for identifying differential expression in sequence count data. BMC Bioinform. 2010;11:422.
Leng N, Dawson JA, Thomson JA, Ruotti V, Rissman AI, Smits BMG, et al. EBSeq: an empirical Bayes hierarchical model for inference in RNAseq experiments. Bioinformatics. 2013;29:1035–43.
Sun J, Nishiyama T, Shimizu K, Kadota K. TCC: An R Package for comparing tag count data with robust normalization strategies. BMC Bioinform. 2013;14:219.
Love MI, Huber W, Anders S. Moderated estimation of fold change and dispersion for RNAseq data with DESeq2. Genome Biol. 2014;15:550.
Gao Z, Zhao Z, Tang W. DREAMSeq: an improved method for analyzing differentially expressed genes in RNAseq data. Front Genet. 2018;9:588.
Russo F, Righelli D, Angelini C. Advancements in RNASeqGUI towards a reproducible analysis of RNAseq experiments. Biomed Res Int. 2016;2016:7972351.
Su W, Sun J, Shimizu K, Kadota K. TCCGUI: a shinybased application for differential expression analysis of RNAseq count data. BMC Res Notes. 2019;12:133.
Reyes ALP, Silva TC, Coetzee SG, Plummer JT, Davis BD, Chen S, et al. GENAVi: a shiny web application for gene expression normalization, analysis and visualization. BMC Genom. 2019;20:745.
Zhao S, Sun J, Shimizu K, Kadota K. Silhouette scores for arbitrary defined groups in gene expression data and insights into differential expression results. Biol Proced Online. 2018;20:5.
Alessandrì L, Arigoni M, Calogero R. Differential expression analysis in singlecell transcriptomics. Methods Mol Biol. 2019;1979:425–32.
Osabe T, Shimizu K, Kadota K. Accurate classification of differential expression patterns in a bayesian framework with robust normalization for multigroup RNAseq count data. Bioinform Biol Insights. 2019;13:1177932219860817.
Nguyen Y, Nettleton D. rmRNAseq: differential expression analysis for repeatedmeasures RNAseq data. Bioinformatics. 2020;36:4432–9.
Yu L, Fernandez S, Brock G. Power analysis for RNASeq differential expression studies using generalized linear mixed effects models. BMC Bioinform. 2020;21:198.
Ueda Y, Ohtsuki N, Kadota K, Tezuka A, Nagano AJ, Kadowaki T, et al. Gene regulatory network and its constituent transcription factors that control nitrogendeficiency responses in rice. New Phytol. 2020;227:1434–52.
Han Y, Gao S, Muegge K, Zhang W, Zhou B. Advanced applications of RNA sequencing and challenges. Bioinform Biol Insights. 2015;9(Suppl 1):29–46.
Li P, Ponnala L, Gandotra N, Wang L, Si Y, Tausta SL, et al. The developmental dynamics of the maize leaf transcriptome. Nat Genet. 2010;42:1060–7.
Si Y, Liu P, Li P, Brutnell TP. Modelbased clustering for RNAseq data. Bioinformatics. 2014;30:197–205.
Fu Y, Dong T, Tan L, Yin D, Zhang M, Zhao G, et al. Identification of shoot differentiationrelated genes in Populus euphratica Oliv. Genes (Basel). 2019;10:1034.
Li J, Bushel PR. EPIGSeq: extracting patterns and identifying coexpressed genes from RNASeq data. BMC Genomics. 2016;17:255.
Silva A, Rothstein SJ, McNicholas PD, Subedi S. A multivariate Poissonlog normal mixture model for clustering transcriptome sequencing data. BMC Bioinform. 2019;20:394.
Erola P, Bjorkegren JLM, Michoel T. Modelbased clustering of multitissue gene expression data. Bioinformatics. 2020;36:1807–13.
Bullard JH, Purdom E, Hansen KD, Dudoit S. Evaluation of statistical methods for normalization and differential expression in mRNASeq experiments. BMC Bioinform. 2010;11:94.
Dillies MA, Rau A, Aubert J, HennequetAntier C, Jeanmougin M, Servant N, et al. A comprehensive evaluation of normalization methods for Illumina highthroughput RNA sequencing data analysis. Brief Bioinform. 2013;14:671–83.
Evans C, Hardin J, Stoebel DM. Selecting betweensample RNASeq normalization methods from the perspective of their assumptions. Brief Bioinform. 2018;19:776–92.
Vieth B, Parekh S, Ziegenhain C, Enard W, Hellmann I. A systematic evaluation of single cell RNAseq analysis pipelines. Nat Commun. 2019;10:4667.
Zeisel A, MuñozManchado AB, Codeluppi S, Lönnerberg P, La Manno G, Juréus A, et al. Brain structure. Cell types in the mouse cortex and Hippocampus revealed by singlecell RNAseq. Science. 2015;347:1138–42.
Lin CY, Lovén J, Rahl PB, Paranal RM, Burge CB, Bradner JE, et al. Transcriptional amplification in tumor cells with elevated cMyc. Cell. 2012;151:56–67.
Kadota K, Nakai Y, Shimizu K. A weighted average difference method for detecting differentially expressed genes from microarray data. Algorithms Mol Biol. 2008;3:8.
Kadota K, Nakai Y, Shimizu K. Ranking differentially expressed genes from Affymetrix gene expression data: methods with reproducibility, sensitivity, and specificity. Algorithms Mol Biol. 2009;4:7.
Kadota K, Shimizu K. Evaluating methods for ranking differentially expressed genes applied to MicroArray Quality Control data. BMC Bioinform. 2011;12:227.
Schurch NJ, Schofield P, Gierliński M, Cole C, Sherstnev A, Singh V, et al. How many biological replicates are needed in an RNAseq experiment and which differential expression tool should you use? RNA. 2016;22:839–51.
Tang M, Sun J, Shimizu K, Kadota K. Evaluation of methods for differential expression analysis on multigroup RNAseq count data. BMC Bioinform. 2015;16:361.
Anders S, Huber W. Differential expression analysis for sequence count data. Genome Biol. 2010;11:R106.
Smyth GK. Linear models and empirical bayes methods for assessing differential expression in microarray experiments. Stat Appl Genet Mol Biol., 2004;3:Article3.
samr package. https://CRAN.Rproject.org/package=samr. Accessed 31 July 2020.
Li J, Witten DM, Johnstone IM, Tibshirani R. Normalization, testing and false discovery rate estimation for RNAsequencing data. Biostatistics. 2012;13:523–38.
ColladoTorres L, Nellore A, Kammers K, Ellis S, Taub MA, Hansen KD, et al. Reproducible RNAseq analysis using recount2. Nat Biotechnol. 2017;35:319–21.
Pickrell JK, Marioni JC, Pai AA, Degner JF, Engelhardt BE, Nkadori E, et al. Understanding mechanisms underlying human gene expression variation with RNA sequencing. Nature. 2010;464:768–72.
Hänzelmann S, Castelo R, Guinney J. GSVA: gene set variation analysis for microarray and RNAseq data. BMC Bioinform. 2013;14:7.
Kadota K, Shimizu K. Commentary: A systematic evaluation of single cell RNAseq analysis pipelines. Front Genet. 2020;11:941.
Frazee AC, Jaffe AE, Langmead B, Leek JT. Polyester: simulating RNAseq datasets with differential transcript expression. Bioinformatics. 2015;31:2778–84.
Soneson C, Robinson MD. Towards unified quality verification of synthetic count data with countsimQC. Bioinformatics. 2018;34:691–2.
R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2016.
Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, et al. Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 2004;5:R80.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc B. 1995;57:289–300.
Acknowledgements
We would like to thank Editage (www.editage.jp) for English language editing.
Funding
This work was supported by JSPS KAKENHI Grant Number JP21K12120. The funding bodies had no role in the design of the study and collection, analysis, and interpretation of data, or in writing the manuscript.
Author information
Authors and Affiliations
Contributions
TO made the R codes, performed the analysis and drafted the manuscript. KS designed the study, supervised the critical discussion and revised the paper. KK confirmed the analysis, revised the paper and led this project to completion. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that there is no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
Results corresponding to Fig. 1 with a larger number of replicates. Boxplots of AUC values (100 trials) for individual methods with n1 = n2 = (a) 6, (b) 9, and (c) 12 are shown. In the simulation, the degree of DE was fixed at 4fold (i.e., FC = 4).
Additional file 2.
Results corresponding to Fig. 2 with a larger number of replicates. Boxplots of AUC values (100 trials) for MBCdeg (K = 2–4) with n1 = n2 = (a) 6, (b) 9, and (c) 12 are shown.
Additional file 4.
Effect on different degrees of DE for MBCdeg with K = 2–4. Boxplots of AUC values (100 trials) for MBCdeg (K = 2–4) with n1 = n2 = (a) 3, (b) 6, (c) 9, and (d) 12 are shown. In contrast to Fig. 2 and Additional file 2, simulations were performed using different degrees of DE. The AUC values for MBCdeg with K = 3 were almost the same as those in Additional file 3 (different trials were used).
Additional file 5.
Results corresponding to Fig. 3 with a larger number of replicates. Boxplots of AUC values (50 trials) for individual methods with n1 = n2 = (a) 6, (b) 9, and (c) 12 are shown.
Additional file 6.
Results corresponding to Fig. 4 with a larger number of replicates. Boxplots of AUC values (50 trials) for individual methods with n1 = n2 = n3 = (a) 6, (b) 9, and (c) 12 are shown.
Additional file 7.
Results corresponding to Additional file 4 on the threegroup simulated data. Boxplots of AUC values (50 trials) for individual methods with n1 = n2 = n3 = (a) 3, (b) 6, (c) 9, and (d) 12 are shown.
Additional file 8.
Concordance rate between methods for Pickrell data. This file provides additional information given in Table 4. The “Sheet1” shows the percentage of genes assigned to the same pattern that are common between the two methods. For example, DESeq2 and TCC have a total of 51,812 similar patterns, and the concordance rate is therefore calculated as 51,812/51,910 = 0.9981. The “Sheet2” shows the results for each cluster obtained using MBCdegbased methods: (a–c) MBCdeg1 with K = 3–5 and (d–f) MBCdeg2 with K = 3–5. The number of genes (column B), centers m (columns C–E), L2 Norm (column F), and the patterns assigned (column G) for each cluster are shown.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Osabe, T., Shimizu, K. & Kadota, K. Differential expression analysis using a modelbased gene clustering algorithm for RNAseq data. BMC Bioinformatics 22, 511 (2021). https://doi.org/10.1186/s12859021044384
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12859021044384