 Methodology article
 Open Access
 Published:
Using iterative cluster merging with improved gap statistics to perform online phenotype discovery in the context of highthroughput RNAi screens
BMC Bioinformatics volume 9, Article number: 264 (2008)
Abstract
Background
The recent emergence of highthroughput automated image acquisition technologies has forever changed how cell biologists collect and analyze data. Historically, the interpretation of cellular phenotypes in different experimental conditions has been dependent upon the expert opinions of welltrained biologists. Such qualitative analysis is particularly effective in detecting subtle, but important, deviations in phenotypes. However, while the rapid and continuing development of automated microscopebased technologies now facilitates the acquisition of trillions of cells in thousands of diverse experimental conditions, such as in the context of RNA interference (RNAi) or smallmolecule screens, the massive size of these datasets precludes human analysis. Thus, the development of automated methods which aim to identify novel and biological relevant phenotypes online is one of the major challenges in highthroughput imagebased screening. Ideally, phenotype discovery methods should be designed to utilize prior/existing information and tackle three challenging tasks, i.e. restoring predefined biological meaningful phenotypes, differentiating novel phenotypes from known ones and clarifying novel phenotypes from each other. Arbitrarily extracted information causes biased analysis, while combining the complete existing datasets with each new image is intractable in highthroughput screens.
Results
Here we present the design and implementation of a novel and robust online phenotype discovery method with broad applicability that can be used in diverse experimental contexts, especially highthroughput RNAi screens. This method features phenotype modelling and iterative cluster merging using improved gap statistics. A Gaussian Mixture Model (GMM) is employed to estimate the distribution of each existing phenotype, and then used as reference distribution in gap statistics. This method is broadly applicable to a number of different types of imagebased datasets derived from a wide spectrum of experimental conditions and is suitable to adaptively process new images which are continuously added to existing datasets. Validations were carried out on different dataset, including published RNAi screening using Drosophila embryos [Additional files 1, 2], dataset for cell cycle phase identification using HeLa cells [Additional files 1, 3, 4] and synthetic dataset using polygons, our methods tackled three aforementioned tasks effectively with an accuracy range of 85%–90%. When our method is implemented in the context of a Drosophila genomescale RNAi imagebased screening of cultured cells aimed to identifying the contribution of individual genes towards the regulation of cellshape, it efficiently discovers meaningful new phenotypes and provides novel biological insight. We also propose a twostep procedure to modify the novelty detection method based on oneclass SVM, so that it can be used to online phenotype discovery. In different conditions, we compared the SVM based method with our method using various datasets and our methods consistently outperformed SVM based method in at least two of three tasks by 2% to 5%. These results demonstrate that our methods can be used to better identify novel phenotypes in imagebased datasets from a wide range of conditions and organisms.
Conclusion
We demonstrate that our method can detect various novel phenotypes effectively in complex datasets. Experiment results also validate that our method performs consistently under different order of image input, variation of starting conditions including the number and composition of existing phenotypes, and dataset from different screens. In our findings, the proposed method is suitable for online phenotype discovery in diverse highthroughput imagebased genetic and chemical screens.
Background
Metazoan cells have the ability to adopt an extraordinarily diverse spectrum of cell shapes. For example, the cuboidal, polarized morphology of epithelial cells differs markedly from that of neuronal cells, which extend long, thin, and highlybranched projections. The shape of an individual cell is the result of a complex interplay between the activity of thousands of genes and the cell's environment. Understanding this interplay is a fundamental challenge in developmental and cell biology. Currently, there are two key aspects to deciphering cellular morphogenesis on genomescale. The first is determining the individual functional contributions of every gene towards the regulation of cell shape, and the second is to describe how complex relationships between cell shape genes affect morphology. With the advent of highthroughput RNA interference (RNAi) screening technologies, particularly in model systems such as Drosophila melanogaster [1], it is now possible to systematically query the involvement of genes in the regulation of different cellular processes and functions. Typically, RNAibased genetic screens involve the acquisition of relatively lowcontent, singledimensional data which is easily analyzed using conventional and unbiased means and thus feasible to perform on genome, or multigenome scales [1, 2]. In order to facilitate similar analysis of imagebased screens, we and other researchers have recently developed novel image segmentation algorithms to rapidly quantitate hundreds of different parameters at a singlecell level in an automated fashion [3–6], and we have demonstrated that such image segmentation algorithms can be used in the context of genetic screens [7]. Notably however, this and other similar screens [8] have been 50–100 fold smaller in scale than typical lowdimensional screens and are not yet genomescale. The reduced scale of these screens is due, largely in part, to the fact that the expert opinion of cell biologists is still an essential and ratelimiting aspect in the analysis of many imagebased datasets. Although human intervention is not required in screens where the potential phenotypic outcomes are few or binary in number (e.g. an imagebased screen where a particular marker is determined to be nuclear or nonnuclear), such intervention is currently necessary in order to identify novel/subtle phenotypes in imagebased datasets of genetic or chemical perturbations where the dynamic range of cellular phenotypes cannot be predicted before the data is collected. For example, in genomescale screens for regulators of cell shape, it is impossible to predict a priori the diversity of morphologies that will ultimately be present in the dataset. The failure to accurately measure this phenotypic variation will lead to concomitant classification errors, especially false negatives, and misleading results. Current methodologies usually employ a twostep procedure to maximize the amount of variation that is captured in a particular imagebased analysis. First, 100–600 phenotypic features are measured on a singlecell level (automatically but somehow exhaustively), and second, supervised techniques assisted by biologists are used to both reduce dimensionality of feature space and carrying out classification on the images. The biologist has to at least perform preliminary qualitative visual scoring of a small part of the dataset in order to gain a crude assessment of the phenotypic variance that is present in this subset. Unfortunately, it is impossible to perform such analysis in the course of screens where millions of images are acquired, thus the ability of these screens to identify new phenotypes is greatly limited. The issues of defining meaningful phenotypes and describing them using informative feature subsets are closely related. Automated feature space reduction schemes have been implemented in the context of high content screen, including feature extraction methods examined in [9], factor analysis in [10] and SVMRFE method in [11]. These methods allow more effective modelling of existing phenotypes, and also prompt the necessity of updating informative feature sets so that they can not only model the existing, but also discover the novel.
Cluster analysis is widely used to reveal the structure of unlabeled datasets. Specifically, there are a number of methods that have been developed in order to estimate cluster numbers from a dataset such as using a series of internal indices [12], jump methods [13], and weighted gap statistics [14]. Moreover, supervised approaches to cluster validation such as using resampling strategy [15], prediction strength [16], methods based on mixture models and inference of Bayesian factors[17, 18], or strategies which are applicationspecific [19] have also been previously implemented. Nevertheless, most existing methods are subject to certain hypothesis on a fixed dataset, and cannot be directly used for online phenotype discovery where new images continuously extend the dataset and millions of cells are involved. Improper assumptions on data structure may cause incorrect division or merging of biologically meaningful phenotypes. To avoid this problem, such methods combine each new image with the whole existing dataset (regardless of the large difference in cell numbers) and frequently rerun from the very beginning.
Methods for online phenotype discovery should be sensitive and flexible to various phenotypes and avoid frequent remodelling involving complete existing datasets. As a kernel machine based novelty detection method, oneclass SVM is used for "offline" phenotype discovery [20]. However, two major points limit its application to highthroughput imagebased screens, especially for screens of cell shape regulators. First, in oneclass SVM all the test samples are classified into two classes, "novel" and "known", however many highthroughput RNAi datasets may potentially contain multiple diverse and unique novel phenotypes which should not necessarily be grouped together. Subsequent cluster analysis would be needed to identify and model different novel phenotypes following the use of oneclass SVM. Second, each time a novel phenotype is discovered using oneclass SVM, the support vectors need to be modified so that the newly discovered phenotype are included as "known" in the following loops, otherwise it will continuously be identified as novel in future. As mentioned earlier, in a typical RNAi screen on 1,000–10,000s genes with dozens of images for each RNAi and 100s of cells in each image, such updating would involve millions of cells and is intractable.
Here we describe the development of an online phenotype discovery pipeline that we implemented in the context of a highthroughput imagebased RNAi screen for regulators of cell shape. A simplified scheme of online phenotype discovery is shown in Figure 1. Online phenotype discovery demands adaptively identifying various novel phenotypes based on multiple existing phenotypes (e.g. those identified a priori by biologists), being sensitive and flexible to various new phenotypes and avoiding frequent remodelling using large existing dataset. Our method includes two key components: phenotype modelling and iterative cluster merging. First, a Gaussian Mixture Model (GMM) is estimated for each existing phenotype following [21]. Second, iterative cluster merging are performed based on gap statistics. When a new image is incorporated, we sample the GMM of each existing phenotypes and start a series of merging loops. In each loop, the image is combined with sample set for one existing phenotype and we estimate cluster number in such combined dataset using gap statistics and use GMM of existing phenotype as part of the reference distributions. If some cells in the new image are clustered together with samples from the existing phenotype, they are merged into the existing phenotype, i.e. they are included into the dataset of existing phenotype and deleted from the new image. The iterations continue until sample set from each existing phenotype has been combined with the new image and has merged with its counterpart (if any exist). Upon completion of all loops, the remaining cell groups in the new image are identified as the candidate of new phenotypes. By sampling reference dataset from new image and existing phenotype separately, utilizing the GMM for existing phenotypes as (part of) reference distribution and involving existing clusters one by one, our method improves the ideas in [12] and becomes more effective. Experimental results show that the proposed method is robust and efficient for online phenotype modelling and discovery in the context of diverse imagebased screens, especially RNAi screens on Drosophila.
Results
Synthetic dataset
Overcoming large sample size difference between two clusters
Difference between sample numbers of distinct clusters could bias cluster number estimation. We propose to tackle this problem by using GMMs as reference distributions for existing phenotypes in gap statistics and validate our method using simulation.
Each simulated dataset consists of observations from two populations ℙ_{1} and ℙ_{2}, each population are sampled from a two dimensional Gaussian distribution with means (0,0) for ℙ_{1} and (0,3) for ℙ_{2}, and an identity covariance for both groups. Gap statistics [12] are used to estimate number of clusters from the experiment dataset ℙ_{1} ⋃ ℙ_{2}. This method uniformly samples different reference datasets from the support of ℙ_{1} ⋃ ℙ_{2}, and here the number of reference datasets is set to 20. Then the experiment dataset ℙ_{1} ⋃ ℙ_{2} and the 20 reference datasets are clustered into candidate cluster numbers k = 1... K, and we set K = 10. For each clustering result, we measure the compactness of obtained clusters using "within cluster dispersion". For each cluster number k, such dispersion are measured separately on experiment dataset and each reference dataset, and gap statistic for k, denoted as gap(k), is defined as the average value of difference between the dispersion on experiment dataset and that on each reference dataset, meanwhile we obtained standard deviation of such difference across 20 reference dataset, and denoted as s_{ k }.
Some typical gap statistic curves are summarized in Figure 2 to illustrate the problem and validate our method. X axis in Figure 2 indicates candidate cluster number i, and each data point denote gap(k) while the error bar indicating s_{ k }. Larger value of gap(k) means better compactness when the dataset is clustered into k clusters (compared with the reference datasets which simulate monogenous data), then a increase from gap (k1) to gap (k) means the clustering performance is improved from k1 to k. We take s_{ k }into consideration when estimating cluster numbers following [12], and take the estimated cluster number as the first k with gap(k)>gap(k+1)s_{k+1}(the candidate number whose data point is higher than the bottom of error bar for its instant right neighbor). Details of gap statistics method are discussed in Methods section.
When samples from ℙ_{1} and ℙ_{2} have identical number of 100, gap statistics can correctly judge sample number as 2, then we set sample number from ℙ_{1} as 200, 300, 500, 700, 900 and 1000, and sample number from ℙ_{2} are fixed as 100. Figure 2, left and Figure 2, middle show that when number difference is over sixfold, gap statistics does not work correctly.
A tenfold difference of cell numbers between existing phenotypes and new images is not the worst situation we would face in online phenotype discovery. Based on the results given in Figure 2, middle, samples from two obviously different populations would be merged together. We propose to solve this bias through fitting a GMM model for existing phenotypes, as well as using GMM as reference distribution for each existing cluster in gap statistics.
Next, we consider ℙ_{1} as existing cluster with known distribution model. If we use Gaussian model for ℙ_{1} as reference dataset for gap statistics, it gives the correct result in 87.4% occasions across 500 experiments even with tenfold difference in sample number. Figure 2, right shows one gap curve with tenfold difference, where Gap(1)(Gap(2)s_{2}) = 0.0006, meanwhile Gap(2)>Gap(3)s_{3}, thus, the estimated cluster number is 2 rather than 3 (although Gap(3)>Gap(2)), because data point for k = 2 is higher than the bottom of error bar for k = 3.
The results are summarized in Table 1. Generally speaking, when two distinct clusters have tenfold difference in sample numbers, original gap statistics method using uniform reference fails to estimate cluster number correctly, while our method of using accurate model as reference distribution can overcome this issue and give a correct estimation of cluster number.
Simulating typical cells using seven types of polygons
Seven types of polygons are defined based on the fluorescent cell image from a real genome wide RNAi screen (protocol discussed later), and a simulation dataset is constructed based on these different types of polygons. Information about these seven polygons is shown in Figure 3 and some details on generating these polygons are introduced in [Additional file 1].
2000 polygons from each of seven types were generated and used as training dataset, i.e. the set of existing phenotypes, and another 2000 polygons were generated for each type to as testing dataset. In each experiment, we started from a certain set of existing phenotypes and built GMM from training samples, meanwhile, we iteratively chose two of seven polygon types and selected 100 polygons apiece from the testing dataset to form a synthetic test image, altogether 70 images can be formed for one experiment. Using the model estimated from the training set, we can identify existing and novel type of polygons from these synthetic images, and observe the performance of our method under different number of novel phenotypes and order of image input.
Performance under different sets of existing phenotypes
Figure 4 shows the general performance of our method under different sets of existing phenotypes. We changed the number and composition of existing phenotypes for different experiments, (different composition means different phenotypes are considered as "existing". GMM for existing phenotypes were estimated from training dataset to start each experiment), and for each set of existing phenotypes, we divided the testing set into 70 synthetic images and shuffled the order of image input 50 times. Whatever set of existing phenotypes we use, the synthetic images always contain all seven phenotypes. We can define accuracy for each polygon type as "the proportion of test samples restored into their original cluster". If one phenotype is used as existing phenotype in an experiment, the accuracy for this phenotype is defined as the proportion of testing cells (in this phenotype) merged into the original existing cluster; while if the phenotype is novel, the accuracy for this phenotype equals the proportion of testing cells in this phenotype which are left alone in a separate cluster after all the merging loops. The accuracies are then averaged to report general performance of our method.
Figure 4 shows our method as having consistent accuracy around 85% for different polygons under different conditions, and the best performance is seen when the number of existing phenotypes are 3 and 4. When the number of existing phenotype is 6, more false negatives appears as novel samples are merged into existing phenotypes, and thus prompts the importance of cluster validation and more refined multiple hypothesis tests.
Box and whisker plots for performance under different conditions
As indicated earlier, the test datasets always consist of seven phenotypes, we can then change the conditions of experiments (number and composition of existing phenotypes and order of image input) and observe the performance for certain phenotype to test the robustness of our method. Across experiments with different input order of images and composition of existing phenotypes, the performance on certain phenotypes are ranked, and such distribution of performance are illustrated using box and whisker plot. We show the box plots for ellipses and 16point stars in Figure 5 and explain the meaning of such plots in its caption. We observed that larger variation of accuracy values correlates with lower number of existing phenotypes, which is because the models of novel phenotypes are estimated from test samples input in the earlier stage of experiment and updated as new images are included. Thus, the accuracy has a larger variance across different image input order when the number of existing phenotypes is low. This issue indicates the importance of more robust strategy of model updating. However, the overall performance of our method is robust regarding to different condition of experiments.
Performance comparison with SVM based methods
Oneclass SVM [20] tackles the novelty detection problem of differentiating novel phenotypes from known ones by estimating a distribution from the core structure of existing dataset and model such distribution using a series of support vectors. It then labels each testing samples as "known" or "novel" using the model built upon support vectors. Compared with SVM used in classification, a parameter ν ∈ (0, 1) (denoted as 'Nu' in figures) is involved in oneclass SVM. This parameter is used to define the core structure of the existing dataset, and it has two roles, i.e. the asymptotic upper bound of training data which are labelled as outliers and the lower bound of the fraction support vectors in training samples. However, oneclass SVM itself cannot be used to handle problems such as the restoration of multiple existing phenotypes. We modify oneclass SVM to fit it into the scenario of online phenotype discovery. Each new image is combined with the support vectors trained from the existing samples and novelty detection is carried out using one class SVM with Gaussian kernels of width 0.5 and various parameters ν to define the scale of support vectors and outliers. After novelty detection, each test sample labelled as "known" is subject to multiple linear SVM classifiers (trained from one pair of existing phenotypes) and assigned into one of multiple existing phenotypes according to majority vote among classifiers. We detailed oneclass SVM and our modification in [Additional file 1].
We compared our method and SVM based method and Figure 6 shows the comparison results in two occasions. Four sets of parameters are used for oneclass SVM. Figure 6left shows the performance when ellipses are considered as novel phenotype while the other six phenotypes serve as the set of existing dataset; and Figure 6right shows the performance when 16point stars are the only novel phenotype. Accuracies for all seven phenotypes were measured and averaged across 100 experiments with different orders of image input. In both cases, when ν = 0.1, SVM based method merged most of the new samples into existing phenotypes and gave best performance on existing phenotypes (especially for 16point stars), while SVM with ν = 0.5 left out most of the new samples as outliers and gave the best accuracy for the novel phenotype, meanwhile, the difference between best and worst accuracy in one experiment could be as large as 25%; our method outperformed most SVM based method on the accuracies for at least 3 of 7 phenotypes and the difference between best and worst accuracy across seven types are never greater than 10%.
Cell culture, image segmentation, morphological feature extraction and selection
Cell culture and image acquisition
As a next step, we implemented our methods in the context of a highthroughput imagebased screen. In particular, we focused on a novel dataset of images acquired in the course of a genomescale RNAi screen for regulators of Drosophila Kc167 cell shape that have hemocytelike properties (Bakal et al, unpublished). By using dsRNA to target and inhibit the activity of specific genes/proteins, the role of individual genes in regulating morphology can be systematically determined. Briefly, Kc167 cells are bathed in the presence of individual dsRNAs targeting all known Drosophila protein kinases and phosphatases in 384well plates (detailed protocols are available at [22]). Following a 5day incubation period, the cells are fixed and stained with reagents in order to visualize the nuclear DNA (blue channel in all images), polymerized Factin (green), and αtubulin (red). For each well, sixteen images from each of the three channels (blue, green and red) were acquired in an automated fashion using an Evotec spinningdisk confocal with a 60× water objective. Autofocusing is performed in a twostep fashion by first focusing on the bottom well at each individual site, and then moving the objective by the same Zdistance (in this case 3 μ m above the bottom of the well) at each site. The images were captured at a binning of 2 and have a resolution of 661*481 pixels.
Image segmentation
To analyze the morphology of single cells, it is necessary to first delineate the boundaries of individual cells. Direct segmentation of the cell bodies in the Factin and αtubulin channels is difficult due to the complex morphology of cellular boundaries. Segmentation of nuclei in the DNA channel is relatively easier, and its segmentation results provide the rough position information of the cell bodies. Herein, we utilize a twostep segmentation procedure [5, 23] including nuclei segmentation on DNA channel, and cell body segmentation of images derived by combining images from the DNA, Factin and αtubulin channels.
In nuclei segmentation, the nuclei are first separated from the background by using a background correction based adaptive thresholding method [24]. However, the clustered nuclei cannot be separated by the adaptive thresholding method. To separate the clustered nuclei, the centres of the nuclei are first detected using a gradient vector field (GVF) based detection method [24]. Specifically, we filter the nuclei image using a Gaussian filter, which suppresses the noise and generate local maxima inside cells, and these local maxima correspond to the nuclei centres. However, there are still some local maxima due to noise. To further eliminate the noisy local maxima, we detect the true cell centres using GVF method. It is a wellknown fact that in an electric field, the electric field lines point to the positive electrodes, and the free negative electrons move along the electric field lines and stop at these electrodes. In GVF, the gradientvector lines also point to the local maxima. Analogous to the electron moving inside the electron field, we put one particle on each detected cell pixel and pushed it along the gradient vector lines. Consequently, these particles stop at these local maxima. Since no or very few particles stop at nonmaxima and noisy local maxima, the true cell centres can be identified by choosing the points that have many particles [24]. After the centres of nuclei are detected, the nuclei are segmented using the markercontrolled watershed algorithm.
To use both Factin and αtubulin channels information, we combine the two channels' signal as I = (I_{Factin} + I_{αtubulin})/2, where I, I_{Factin} and I_{αtubulin}denote the combined image, Factin channel image and I_{αtubulin}channel image respectively. We then segment the cell bodies using the combined image. First the cell bodies are separated from the background using the aforementioned adaptive thresholding algorithm. The nuclei segmentation results facilitate the segmentation of cell bodies by providing the rough position information of cell bodies. Herein, we employ the markercontrolled watershed and the nuclei segmentation results to segment the individual cell bodies. To reduce the oversegmentation of cell bodies a feedback system proposed in [5] is employed. Three scoring models, which measure the morphological appearance, gradient and edge intensity of cell pairs respectively, are built to identify the oversegmented cell bodies, and guide the merging procedure [5]. Detailed shape and boundary information of nuclei and cell bodies is obtained after the twostep segmentation procedure.
Morphological feature extraction and feature selection
Cellular phenotype identification depends on choosing a rich set of descriptive features, which is one of the most critical steps for pattern recognition problems. To capture the geometric and appearance properties, 211 morphology features belonging to five categories are extracted following [23]. The selected features include a total of 85 wavelet features (70 of them from Garbor wavelet transformation [25] and 15 features from 3level CDF97 wavelet transformation [26]), 10 geometric region features describing the shape and texture characteristics of cells [23], 48 Zernike moments features with selected order of 12 [27], 14 Haralick texture features [28] and a total of 54 phenotype shape descriptor features (36 features of ratio length of the central axis projection and 18 features of area distribution over equal sectors) [23]. A feature selection procedure is necessary to denoise the dataset and describe it in the most informative way. As the datasets and phenotype models are being updated adaptively, an unsupervised feature selection without relying on phenotype labels is used to supply a stable feature subset. It is based on iterative feature elimination using k nearest neighbour features following [29]. In this study, an informative subset of fifteen features is selected to quantify the segmented cells.
Online phenotypes discovery in the context of RNAi highthroughput screenings
Fitting GMM model for existing phenotypes
We first performed a visual examination on a subset of dataset in order to define images and cellular morphologies of typical normal cells, as well as cells in three distinct cellular phenotypes. We termed these quantitative categories "Long Punctuate Actin (LPA)", "Cell Cycle Arrest (CCA)" and "Rho1 (Rho)", collected images in these categories and combined them with images of 1583 normal cells, to form our cell database of existing phenotypes. We estimated a GMM for each existing phenotype using EM algorithms. A unimodality model is obtained for normal and LPA phenotypes, and CCA and Rho phenotypes end up with 2 and 3 Gaussian terms respectively and the covariance matrices are set to be diagonal. A brief introduction of each existing phenotype is shown in Figure 7.
Case 1: merging cells in existing phenotypes
To validate our method's ability of restoring three existing phenotypes: Normal, LPA and CCA, we carried out 100 times of fivefold cross validation. In each experiment, 20% of cells from each existing phenotypes were taken out and combined to form a flow of new images, these cells were divided into seven groups, simulating seven new images. We defined merging accuracy for each phenotype as the proportion of test samples merged into its original phenotype. The mean and standard deviation of accuracies across 100 experiments was shown in Table 2.
Our method can identify and merge cells into original phenotypes well. In the third column of Table 2, we list the typical mistakes made during the merging loops. Some cells with normal and LPA phenotypes are not merged correctly, and such mistakes suggest the existence of previously undefined phenotypes in such images.
Case 2: discovering new phenotypes: cross validation based on known phenotypes
To validate our method's ability of discovering new phenotypes, we performed the following experiments after the a priori identification of four existing phenotypes (Normal, LPA, CCA and Rho1) by biologists. In each experiment, three of four phenotypes were considered as existing phenotypes, and cells in the other phenotype were divided into groups with 100 cells. These cell groups represent an incoming dataset of new images containing "novel phenotypes". Given only one phenotype in the testing images, ideally in each experiment, our method would identify the first of such cell groups as a new phenotype, model this phenotype, assign all the other testing images to this "novel phenotype", and no testing cells would be merged by any of the other three phenotypes. Fifty experiments were performed to identify each phenotype, 1000 cells served as "novel group" for normal and LPA phenotypes while 600 cells were used for CCA and Rho1 phenotypes. The experiment results are summarized in Table 3. "Accuracy" is defined as the ratio between the number of testing cells assigned to a single cluster and the total number of testing cells, and such accuracy is calculated after all three merging loops for each experiment.
Case 2 shows our method's ability of identifying novel phenotypes. We hypothesize that the relatively low accuracy for CCA and Rho phenotypes can be attributed to the small number of samples and incomplete understanding of which phenotypes is the biological representative for the entire treatment class. High classification accuracies for normal cells in both case 1 and case 2 provide strong validation of the ability of our methods to identify wildtype cells. While the overlap of normal and LPA serves as a starting point for novel phenotypes discovery.
Case 3: identifying multiple novel phenotypes from online image input and performance comparison with SVM based methods
In this case, we still used the test dataset in case 2, which included a total of 3,200 cells from four phenotypes. In each group of experiments we started from the models (available from previous step) of two existing phenotypes, and all 3,200 test cells were divided into 32 images with cells from two phenotypes in one image, and all images were input with 50 different orders. Altogether, three groups of experiments were carried out, and in each experiment, normal phenotype were paired with one of the other three phenotypes, to serve as sets of ''existing phenotypes''. Both our method and SVM based methods were used in each experiment, and we can thus validate our method's ability to deal with multiple novel phenotypes well as the performance under different order of image input.
Figure 8 summarizes the average performance of our method and SVM based methods for each phenotype across 50 experiments. The results from different sets of existing phenotypes are shown separately, and "accuracy" is defined as the proportion of test samples restored into its original cluster. The performance of our method degraded with reduced number of existing phenotypes compared with case 1 and case 2, especially for the Rho1 phenotype, however, it still performed consistently on existing and novel phenotypes, never failed to reach 80% mark and outperformed SVM based method in at least two of four phenotypes on all occasions.
Figure 9 shows the box and whisker plots for our methods under three different sets of existing phenotypes. The variation of accuracy across different order of image input can be as large as 8% (Figure 9bottom, accuracy for CCA phenotype), but the accuracy is never less than 80% For two experiment with the lowest accuracies and shown as outlier in the box and whisker plot (Figure 9top, CCA and Figure 9bottom, LPA), the order of image input was validated, and on both occasions we observed a small group of novel cells emerging at the beginning of image flow with all their counterparts appearing very late. Thus, the model for novel phenotypes was only built based on a small group of cells, and most test cells appeared later were merged by similar phenotypes with more stable models. This indicates the necessity of better cluster validation and model updating solution, which are proposed in our method.
Having multiple phenotypes in a single image is a challenge in the analysis of image based highthroughput screens. Our method successfully tackle such cases and identify multiple phenotypes from online image input, and can therefore provide a better perspective for further quantification of the whole image, en route to the identification for the role of each gene.
Identifying "rl/teardrop" phenotype in the context of Drosophila genomescale RNAi screen
Typically, a new image which is incorporated into the dataset may have less than fifty cells, which can severely impact the ability to quantitatively determine and distinguish novel phenotypes. But such images can still be incorporated into our analysis by discarding images with cell numbers <10, and putting together cells from multiple new images to make a combined dataset having at least 100 cells. We collected cells from four existing phenotypes, assembled them as training dataset, modelled existing phenotypes and used such phenotype models to analyze images acquired as part of a Drosophila genomescale RNAi screen. Implementation of our method revealed a phenotype that was undetected by visual inspection which we termed as "rl/teardrop". These cells are small in size and having smooth boundaries and nonround shape. Figure 10 supplies some information and typical images for this phenotype. Such phenotype was initially discovered in wells where cells had been incubated in the presence of rl RNAi. Drosophila rl, or rolled is the homolog of mammalian ERK kinase and is a central regulator of a host of cellular processes [30]. Importantly, the rl/teardrop phenotype was not scored during human inspection of the images. The detection of cells with the rl/teardrop phenotypes in an image or well often correlates with detection of cells with an LPA phenotype, and we hypothesize that rl/teardrop represents a phenotypes that occur as cells transition from normal to LPA. We collected more than 500 cells with the rl/teardrop phenotype through analysis of replicate experiments, modelled this phenotype with GMM, and used it to analyze cells from the new images. Our method detects rl/teardrop cells in experiments where CG10673, CG7236, NippedA and Pten have been targeted by RNAi. Although the nature of the relationship among these genes needs further investigation, we have previously identified NippedA and Pten as regulators of ERK activity following insulin stimulation [2], suggesting a relevant relationship between these genes. Altogether, these results demonstrate that our online phenotype discovery methods can be used to provide unexpected and novel biological insight.
We also tested our method using two published dataset from Drosophila RNAi screen [7] and HeLa cell cycle phase detection [ref. s3 in Additional file 1], compared its performance with SVM based methods and validated our method's ability of handling dataset from various organisms. These experiments are described in [Additional file 1], the results on Drosophila dataset from [7] are reported in [Additional file 2] and results on HeLa dataset are reported in [Additional file 3, 4].
All other functions are developed in Matlab 7.0 and ran in PC with Intel^{®} Core™ 2 T7200 2.00 GHz CPU and 2.00 GB of RAM. Starting from four existing phenotypes, the average running time for our method based on improved gap statistics is 1.8 seconds on a group of 100 segmented cells, 10.2 seconds on a group of 600 cells and 19.4 seconds on a group of 1000 cells. Considering the fact that cell number in each image is seldom over 300 in the reported high content screen, our method is suitable for online application.
Discussion
Online identification and validation of novel morphological phenotypes are major challenges in specific highthroughput imagebased screens. Manual phenotype labelling of highthroughput imagebased data is a laborious and inordinately timeconsuming process, while available automatic identification methods usually classify cells into a limited set of predefined phenotypes which may be determined through biased means and will not be updated according to the online image input. As millions of images are now generated during the course of a comprehensive genomescale screen, new methods are needed to effectively identify novel phenotypes in such massive databases. Here we report the development of an online phenotype discovery method which models existing phenotypes, compares cells in new images with existing phenotype models through cluster analysis, assigns some new cells to existing phenotypes, and finally identifies and validates novel phenotypes online.
GMM is used for modelling existing phenotypes and gap statistics, with GMM as reference distribution for existing phenotype, plays a key role in cluster analysis and merging. We built GMM for existing phenotypes, sampled datasets from the model and used them as reference distribution in gap statistics method, following this pipeline we can cover the complete properties of phenotypes more efficiently. Furthermore, gap statistics are dealing with only one existing phenotype plus a part of the new image in each merging loop, and the content of new image is iteratively updated with the merging procedure. We present Additional file 5 to validate the idea of modeling existing phenotype using GMM, the detailed information of GMM estimated from four existing phenotype in our real dataset are reported along with histograms for some typical feature.
For analysis of high content screen data, many researchers choose to summarize the information of single cells or objects to supply a normalized signature for higher level concepts (e.g. treatment conditions, genes, complexes, etc). Thus it is critical to identify different phenotypes related to a same treatment condition. Our method can be used in identifying multiple phenotypes in single well and supply detailed insight into related questions. The performance of our methods relies on the quality of image processing, feature selection, phenotype modelling, and cluster analysis methods. Using iterative cluster merging, our future goals are to build more reliable phenotype models and to construct complete pipelines of cluster analysis with detailed validation procedures to obtain more reliable definition of clusters.
Conclusion
We propose an online phenotype discovery method for highthroughput RNAi screen, which can be used in the course of many imagebased screens. This method is based on adaptive phenotype modelling and iterative cluster merging using improved gap statistics. Given datasets for existing phenotypes, the method can build a model of each existing phenotype, identify novel phenotypes in images obtained from ongoing screening and assign newly obtained cell images into different phenotypes. Compared with traditional novelty detection techniques, our approach avoids frequent remodelling involving the huge existing dataset and can handle multiple existing phenotypes in a flexible manner. Implementation of our methods in the analysis of images acquired during a genetic screen for regulators of Drosophila cell morphology demonstrates the power of these computational tools in efficiently discovering meaningful new phenotypes.
Methods
Online cluster discovery: problem formulation
Suppose we have identified K_{0} nonoverlapping cellular phenotypes, the ith cell in the mth existing phenotype is denoted by vector ${s}_{i}^{(m)}\triangleq [{s}_{i,1}^{(m)},{s}_{i,2}^{(m)}\mathrm{...}{s}_{i,p}^{(m)}]$, with each cell described by p morphological features. Then, let ${\mathbb{S}}_{m}\triangleq {\left\{{s}_{i}^{(m)}\right\}}_{i=1}^{{u}_{m}}$ denotes dataset for the mth phenotype, with u_{ m }indicating the number of cells for mth phenotype. Thus, we denote the dataset of all available cells, $\mathbb{S}$, as:
and the total number of existing cells is $u={\displaystyle \sum _{m=1}^{{K}_{0}}{u}_{m}}$. Similarly, when a new image $\mathbb{E}$ is obtained, the ith cell in this image is also described using p features, and denoted by e_{ i }≜ [e_{i 1}, e_{i 2}... e_{ ip }], and $\mathbb{E}={\left\{{e}_{i}\right\}}_{i=1}^{v}$, where ν is the number of cells in $\mathbb{E}$. New images are continuously obtained, and each new image $\mathbb{E}$ contains tens of cells while there are thousands cells for each $\mathbb{S}$_{ m }, thus v <<u_{ m }<u.
Given a new image $\mathbb{E}$, we need to adaptively determine number of new phenotypes K_{ new }, based on K_{0}, $\mathbb{S}$ and $\mathbb{E}$. Cells in $\mathbb{E}$ while belonging to some existing phenotype $\mathbb{S}$_{ m }should be identified, and used to update model for $\mathbb{S}$_{ m }. It is unfeasible to involve every single cell in $\mathbb{S}$ into cluster discovery, because the large scale of $\mathbb{S}$ could bias cluster analysis towards existing phenotypes and add computation burden. On the other hand, "new cluster" identified only according to $\mathbb{E}$ is vulnerable to outliers. Thus an efficient method to utilize $\mathbb{S}$ is necessary.
Outline of the proposed approach
We propose to discover new clusters through iterative cluster merging. The dataset of each existing phenotype $\mathbb{S}$_{ m }is first fit to a GMM and sample dataset ${\mathbb{S}}_{m}^{\text{'}}$ is obtained from such model. Each ${\mathbb{S}}_{m}^{\text{'}}$ is combined with a new image $\mathbb{E}$ one by one to detect possible new phenotypes. Our online phenotype discovery method is outlined as below:

(1)
Phenotype modelling. A GMM is fit to each existing phenotypes using ExpectationMaximization (EM) algorithm following [21].

(2)
Sampling existing phenotype and combining existing information with the new image. We sample from the GMM of one existing clusters, say $\mathbb{S}$_{ m }, m ∈ {1, 2... K_{0}}, get the sample set ${\mathbb{S}}_{m}^{\text{'}}$, and put ${\mathbb{S}}_{m}^{\text{'}}$ together with new image $\mathbb{E}$, we denote this combined set as $\mathbb{F}$, thus
$$\mathbb{F}={\mathbb{S}}_{m}^{\text{'}}\cup \mathbb{E}$$(2)
${\mathbb{S}}_{m}^{\text{'}}$ should have comparable cell numbers as ν, the cell number in $\mathbb{E}$, so that phenotype information would not be overwhelmed due to limited cell number of $\mathbb{E}$. We empirically set sample number of ${\mathbb{S}}_{m}^{\text{'}}$ as ν to 5ν.

(3)
Estimating the cluster number in $\mathbb{F}$. An improved gap statistics method is used in which we take reference dataset from the range of feature values of ${\mathbb{S}}_{m}^{\text{'}}$ and $\mathbb{E}$ separately, and use GMM as the reference distribution for reference samples obtained from the support of ${\mathbb{S}}_{m}^{\text{'}}$.

(4)
Defining clusters on $\mathbb{F}$. Based on the estimated cluster number from step 3, a partition of $\mathbb{F}$ is obtained using Partitioning Around Medoids (PAM) [31] method.

(5)
Merging samples from $\mathbb{E}$ to existing phenotypes.

(a)
If some samples from $\mathbb{E}$ are assigned to a same cluster as at least 95% samples from ${\mathbb{S}}_{m}^{\text{'}}$, they are considered as a candidate for merging.

(b)
Validate merging operation using a statistical test with Bonferroni correction. For each merging candidate, calculate its p value under the GMM for $\mathbb{S}$_{ m }, reject the merging operation and keep this sample in $\mathbb{E}$ if p value is smaller than 1/K_{0}, or else merge this candidate into $\mathbb{S}$_{ m }and delete it from $\mathbb{E}$.

(6)
Returning to step 2 to sample another existing phenotype and start new merging loop.

(7)
Updating phenotype models. After each existing phenotype $\mathbb{S}$_{ m }, m ∈ {1, 2... K_{0}}merges their counterparts in $\mathbb{E}$, define clusters left in $\mathbb{E}$ as new phenotypes and estimate GMM for them.
Through modelling and resampling, $\mathbb{S}$ becomes more flexible and reuseable, allowing us to cover complete properties of phenotypes. Following data modelling and sampling, the information from existing phenotypes is combined with new image one by one in the loops from step 3 to 5. Thus in each single loop, the task of estimating cluster number is simplified to identifying difference between new image $\mathbb{E}$ and only one existing phenotype. After each $\mathbb{S}$_{ m }merges its counterpart in $\mathbb{E}$, clusters left in $\mathbb{E}$ are identified as new phenotypes.
Cluster modelling and sampling
Given the dataset $\mathbb{S}$, we model each phenotype $\mathbb{S}$_{ m }using a GMM:
where N denotes Gaussian distribution. We denote the number of Gaussian terms for phenotype $\mathbb{S}$_{ m }as Q_{ m }and define parameters for $\mathbb{S}$_{ m }as ${\pi}_{m}={\left\{{\pi}_{m,t}\right\}}_{t=1}^{{Q}_{m}},{\mu}_{m}={\left\{{\mu}_{m,t}\right\}}_{t=1}^{{Q}_{m}},{\Sigma}_{m}={\left\{{\Sigma}_{m,t}\right\}}_{t=1}^{{Q}_{m}}$. Initially, the covariance matrix Σ_{m, t}is set to be diagonal. We use Expectationmaximization (EM) algorithm to estimate {π_{ m }, μ_{ m }, Σ_{ m }} from $\mathbb{S}$_{ m }. In the initialization of EM algorithm, Q_{ m }is set to four, and $\mathbb{S}$_{ m }is first partitioned into Q_{ m }clusters using fuzzy Cmeans clustering method, and then initial parameters are estimated using the standard vector quantization method. For each class, Q_{ m }is reduced to the minimum possible using minimum description length (MDL) technique, following [21]. We obtain random samples from the GMM to form set ${\mathbb{S}}_{m}^{\text{'}}$ having i.i.d $\mathbb{S}$_{ m }, ${\mathbb{S}}_{m}^{\text{'}}$, and ${\mathbb{S}}_{m}^{\text{'}}$ is combined with new image $\mathbb{E}$ to form $\mathbb{F}$. When estimating cluster number in $\mathbb{F}$ using gap statistics, GMM is used as reference distribution for ${\mathbb{S}}_{m}^{\text{'}}$.
Estimating cluster numbers using improved gap statistics
To estimate the number of clusters from an unlabeled dataset, many existing methods focus on the within cluster dispersion W_{ k }, resulting from clustering datasets (e.g. $\mathbb{F}$) into k clusters, C_{1}, C_{2},... C_{ k }with C_{ r }denoting the indices of samples in clusters r and f_{i, j}denotes the value of jth feature measured from ith data point. Based on ${D}_{r}={\displaystyle \sum _{i,{i}^{\text{'}}\in {C}_{r}}{\displaystyle \sum _{j=1}^{p}{({f}_{i,j}{f}_{{i}^{\text{'}},j})}^{2}}}$, we have ${W}_{k}={\displaystyle \sum _{r=1}^{k}\frac{1}{2{n}_{r}}{D}_{r}}$. W_{ k }tends to decrease monotonically as the number of clusters k increases, but from some k on, such decrease flattens markedly. Statistical folklore has it that error measure based on W_{ k }should have an "elbow" at the desirable cluster number, thus different criterions based on W_{ k }are defined.
Gap statistics [12] method utilizes the output of any clustering algorithm under different k, compares the change of W_{ k }to the dispersion expected under a reference null distribution, the gap between the logarithms of these two dispersions are employed to detect cluster number. Gap statistics can detect homogenous nonclustered data against the alternative of clustered data [14]. This ability is critical when all cells in new image $\mathbb{E}$ belong to the same phenotype.
To estimate cluster number in $\mathbb{F}$ (defined in equation (2)), we first select a number K which is larger than the expected cluster number, e.g. in our case K = 5. For each k = 1, 2... K, $\mathbb{F}$ is divided into k clusters and gives a series of W_{ k }. Then we generate B reference datasets from $\mathbb{F}$, cluster them into k clusters and obtain ${W}_{kb}^{\ast},b=1,2,\mathrm{...}B,k=1,2,\mathrm{...}K$. We use PAM [31] for clustering. Considering the mean dispersion $\stackrel{\_}{l}={\displaystyle \sum _{b}\mathrm{log}\phantom{\rule{0.1em}{0ex}}({W}_{kb}^{\ast})/B}$ across B = 20 reference datasets, and their standard deviation $s{d}_{k}=\sqrt{{\displaystyle \sum _{b}{(\mathrm{log}\phantom{\rule{0.1em}{0ex}}({W}_{kb}^{\ast})\stackrel{\_}{l})}^{2}/B}}$, the item ${s}_{k}=s{d}_{k}\sqrt{1+{B}^{1}}$ is taken into consideration for a better control about the rejection of null model [12], and estimated cluster number k' is:
The reference distribution is a null model of data structure. In [12], reference datasets are sampled uniformly either from the range of observed values for each feature, or the range of a box aligned with the principle components of data. However, it is encouraged to estimate reference distribution from existing samples rather than simply using uniform distribution because the bounding box of the whole dataset always includes some "blank" area. The existing cluster definition can help us focus on where the data really lies, and avoid generating a reference dataset violating the properties of original one. Here, we sampled ${\mathbb{S}}_{m}^{\text{'}}$ from GMM of each existing phenotype and it makes sense to use this GMM as the reference distribution for ${\mathbb{S}}_{m}^{\text{'}}$.
The problem now is to generate reference dataset from GMM, because ${\mathbb{S}}_{m}^{\text{'}}$ is combined with new image $\mathbb{E}$ to form the dataset $\mathbb{F}$, and the model of $\mathbb{E}$ is unavailable. We have to deal with ${\mathbb{S}}_{m}^{\text{'}}$ and $\mathbb{E}$ separately because the distribution of $\mathbb{E}$ is unavailable. We propose to solve this problem by generating reference dataset from ${\mathbb{S}}_{m}^{\text{'}}$ (GMM reference distribution) and $\mathbb{E}$ (uniform reference distribution) separately and combine two sets together, i.e. substituting $Supp(\mathbb{F})=Supp(\mathbb{E}\cup {\mathbb{S}}_{m}^{\text{'}})$ with
We discuss more detail of this strategy in the [Additional file 1], and supply a figure as [Additional file 6] to illustrate the motivation and innovation of our strategy.
Gap statistics method repeatedly carries out clustering using a set of candidate cluster numbers, and pick up the number supplying best within cluster dispersion as estimated cluster number. GMM is an accurate model for ${\mathbb{S}}_{m}^{\text{'}}$, and using GMM as reference distribution can avoid the risk of split biological meaningful clusters and retain biological properties of existing phenotypes. The selection of K and B controls the number of clustering operation to be carried out and greatly influences the complexity of the whole methods. An effective way of utilizing existing phenotypes can greatly reduce K and make gap statistics method more suitable for online phenotype discovery in highthroughput imagebased screens.
Cluster definition and merging
We use Partitioning Around Medoids (PAM; also known as Kmedoids) [31] to do clustering on combined set $\mathbb{F}$. PAM provides better flexibility and robustness of choosing suitable dissimilarity measurements for different applications [32] and more efficient compared to Fuzzy clustering methods, especially in our cases where clustering are carried out frequently.
After clustering, we get a nonoverlapping partition of $\mathbb{F}={\displaystyle \underset{m=1}{\overset{{K}^{\text{'}}}{\cup}}{\mathbb{F}}_{m}},\forall m,n\in \left\{1,\mathrm{2...}{K}^{\text{'}}\right\},{\mathbb{F}}_{m}\cap {\mathbb{F}}_{n}=\varnothing $, where the cluster number K' is determined through gap statistics, and we adjust the cluster labels to make sure that $\mathbb{F}$_{1} includes the largest ratio of samples from existing phenotype ${\mathbb{S}}_{m}^{\text{'}}$. Merging operation is done according to this partition. Datasets ${\mathbb{S}}_{m}^{\text{'}}$, m ∈ {1, 2,... K_{0}} are combined with $\mathbb{E}$ one by one, and in each loop, the overlapped part of ${\mathbb{S}}_{m}^{\text{'}}$ and $\mathbb{E}$ (if any) is located in $\mathbb{F}$_{1}, deleted from $\mathbb{E}$ and included as part of existing cluster:
after all merging loops, clusters left in $\mathbb{E}$ are defined as new phenotypes.
The above merging strategy is based on theoretical case of ${\mathbb{F}}_{1}\supseteq {\mathbb{S}}_{m}^{\text{'}}$, but in reality, when we consider random sample set ${\mathbb{S}}_{m}^{\text{'}}$ from GMM of an existing phenotype, it is possible that some samples are randomly far from the centre of existing phenotype and thus assigned into different clusters with their majority counterparts in ${\mathbb{S}}_{m}^{\text{'}}$. We take two strategies to protect the merging operation from influence of outliers.

(1)
Merging operations only happens when some cells in $\mathbb{E}$ are assigned into $\mathbb{F}$_{1}, together with more than 95% of samples ${\mathbb{S}}_{m}^{\text{'}}$. And such cells are considered candidates for merging operation.

(2)
For each merging candidate in $\mathbb{E}$, we carry out statistical test with Bonferroni correction. We calculate the p value for each candidate with respect to the GMM for ${\mathbb{S}}_{m}^{\text{'}}$, i.e. possibility of obtaining a value at least as extreme as (if not more) this candidate under the GMM. The corrected p value for each candidate is defined as its p value with respect to the GMM of ${\mathbb{S}}_{m}^{\text{'}}$ divided by number of existing phenotypes K_{0}. If the corrected p value is lower than 0.05/K_{0}, the merging operation is rejected and we keep that candidate in $\mathbb{E}$.
In the merging loops, we focused on identifying samples of existing phenotypes from $\mathbb{E}$. While some cells of $\mathbb{E}$ are merged into existing phenotypes, novel clusters gradually stand out.
References
 1.
Perrimon N, MatheyPrevot B: Applications of highthroughput RNAi screens to problems in cell and developmental biology. Genetics 2007, 175: 7–16.
 2.
Friedman A, Perrimon N: functional genomic RNAi screen for novel regulators of RTK/ERK signaling. Nature 2006, 444: 230–234.
 3.
Zhou X, Liu KY, Bradley P, Perrimon N, Wong STC: Towards automated cellular image segmentation for RNAi genomewide screening. Lecture Notes in Computer Science (MICCAI 2005) 3749: 885–892.
 4.
Xiong G, Zhou X, Ji L, Bradley P, Perrimon N, Wong STC: Automated segmentation of Drosophila RNAi fluorescence cellular images using deformable models. IEEE Transactions on Circuit and Systems 2006, 53: 2415–2424.
 5.
Li FH, Zhou X, Wong STC: An automated feedback system with the hybrid model of scoring and classification for solving oversegmentation problems in RNAi high content screening. Journal of Microscopy 2007, 226(2):121–132.
 6.
Yan P, Zhou X, Shah M, Wong STC: Automatic segmentation of RNAi fluorescent cellular images with interaction model. IEEE Transactions on Information Technology in Biomedicine 2008, 12(1):109–117.
 7.
Bakal C, Aach J, Church G, Perrimon N: Quantitative morphological signatures define local signaling networks regulating cell morphology. Science 2007, 316: 1753–1756.
 8.
Perlman Z, Slack M, Feng Y, Mitchison T, Wu L, Altschuler S: Multidimensional drug profiling by automated microscopy. Science 2004, 306: 1194–1198.
 9.
Huang K, Velliste M, Murphy RF: Feature reduction for improved recognition of subcellular location patterns in fluorescence microscope images. Proceedings of SPIE 2003, 4692: 307–318.
 10.
Yong D, Bender A, Hoyt J, McWhinnie E, Chirn G, Tao CY, Tallarico J, Labow M, Jenkins J, Mitchison T, Feng Y: Integrating highcontent screening and ligandtarget prediction to identify mechanism of action. Nature Chemical Biology 2008, 4(1):59–68.
 11.
Loo L, Wu L, Altshuler S: Image based multivariate profiling of drug responses from single cells. Nature Methods 2007, 4(5):445–453.
 12.
Tibshirani R, Walther G, Hastie T: Estimating the number of clusters in a dataset via the gap statistic. Journal of Royal Statistics Society 2001, 32(2):411–423.
 13.
Sugar C, James G: Finding the number of clusters in a dataset: An informationtheoretic approach. Journal of the American Statistical Association 2003, 98(463):750–763.
 14.
Yan M, Ye K: Determining the number of clusters using the weighted gap statistics. Biometrics 2007, 63: 1031–1037.
 15.
Dudoit S, Fridlyand J: A Predictionbased resampling method to estimate the number of clusters in a dataset. Genome Biology 2002, 3(7):research 0036.1–0036.21.
 16.
Tibshirani R, Walther G: Cluster validation by prediction strength. Journal of Computational & Graphical Statistics 2005, 14(3):511–528.
 17.
Guo P, Chen P, Lyu M: Cluster number selection for a small set of samples using the Bayesian YingYang model. IEEE Transactions on Neural Networks 2002, 13(3):757–763.
 18.
Gangnon R, Clayton M: Cluster detection using Bayes factors from overparameterized cluster models. Environmental and Ecological Statistics 2007, 14: 69–82.
 19.
Bickel D: Robust cluster analysis of microarray gene expression data with the number of clusters determined biologically. Bioinformatics 2003, 19(7):818–824.
 20.
Schölkopf B, Platt J, ShaweTaylor J, Smola A, Williamson R: Estimating the support of a high dimensional distribution. Neural Computation 2001, 13: 1443–1471.
 21.
Zhou X, Wang X: Optimisation of Gaussian mixture model for satellite image classification. IEE ProceedingsVision, Image and Signal Process 2006, 153(3):349–356.
 22.
Drosophila RNAi Screening Center (DRSC) at Harvard Medical School[http://www.flyrnai.org]
 23.
Wang J, Zhou X, Bradley PL, Perrimon N, Wong STC: Cellular phenotype recognition for highcontent RNAi genomewide screening. Journal of Molecular Screening 2008, 13(1):29–39.
 24.
Li FH, Zhou X, Zhu J, Ma J, Huang X, Wong STC: High content image analysis for human H4 neuroglioma cells exposed to CuO nanoparticles. BMC Biotechnology 2007, 7: 66. (9 October 2007)
 25.
Manjunath BS, Ma WY: Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern Analysis and Machine Intelligence 1996, 18: 837–842.
 26.
Cohen A, Daubechies I, Feauveau JC: Biorthogonal bases of compactly supported wavelets. Communications on Pure and Applied Mathematics 1992, 45: 485–560.
 27.
Zernike F: Beugungstheorie des schneidencerfarhens undseiner verbesserten form, der phasenkontrastmethode. Physica 1934, 1: 689–704.
 28.
Haralick RM, Shanmugam K, Dinstein I: Textural features for image classification. IEEE Transactions on Systems, Man and Cybernetics 1973, 6: 610–620.
 29.
Mitra P, Murthy CA, Pal S: Unsupervised feature selection using feature similarity. IEEE Transactions on Pattern Analysis and Machine Intelligence 2002, 24(3):301–312.
 30.
Koch W: Coordinaring ERK/MAPK signalling through scaffolds and inhibitors. Nature Reviews Molecular Cell Biology 2005, 6(11):827–838.
 31.
Kaufman L, Rousseeuw P: Finding groups in data: an introduction to cluster analysis. Wiley, New York; 1990.
 32.
Thalamuth A, Mukhopadhyay I, Zheng X, Tseng G: Evaluation and comparison of gene clustering methods in microarray analysis. Bioinformatics 2006, 22(19):2405–2412.
Acknowledgements
The authors would like to thank research members of The Methodist Hospital Research Institute, Radiology Department, and we thank colleagues in the Department of Genetics at Harvard Medical School, for technical support and comments. CB is a Fellow of the Leukemia and Lymphoma Society. NP is an Investigator of the Howard Hughes Medical Institute. The research is funded by The Methodist Hospital Research Institute (Stephen T.C. Wong).
Author information
Affiliations
Corresponding author
Additional information
Authors' contributions
NP and CB conceived the biological hypothesis while STCW and XZ conceived the bioinformatics part of the study. ZY and XZ designed the framework of online phenotype discovery and performed tests, CB and colleagues carried out genomescale RNAi screens, helped to set up initial phenotype database and validated final results, FL developed the image processing methods. All authors contribute in writing this paper, have read and approved the final version of this manuscript.
Zheng Yin, Xiaobo Zhou, Chris Bakal contributed equally to this work.
Electronic supplementary material
Supplementary materials on performance validation and algorithm details
Additional file 1: . Methods of simulating real cells using polygons are noted. Documents and results for two more validation experiments are provided, and two published dataset using different organisms were involved in these experiments. More details of four existing phenotypes used in the main text are presented, including the histogram of specific feature and key parameters for estimated GMM. Our improvement on gap statistics method and oneclass SVM novelty detection are also discussed in detail. (DOC 100 KB)
Performance comparison on restoring biological meaningful cluster from published high throughput screen dataset
Additional file 2: . These two histograms report the comparisons on the ability of restoring biological meaningful phenoclusters between our method and SVM based method. The comparison carried out on a published high throughput screen dataset based on Drosophila BG2 cell line, and results using two different groups of existing phenotypes are presented separately. (TIFF 962 KB)
Typical images and information for datasets of four cell cycle phases in HeLa cells
Additional file 3: . In this figure, typical images and some information from a published dataset of HeLa cells are summarized. This dataset consists of single channel fluorescent images of HeLa nuclei in four cell cycle phases and it was used to illustrate the prospect of combining our method to dataset from various organisms. (TIFF 183 KB)
Performance comparison on cell cycle phase identification using HeLa dataset
Additional file 4: . These three histograms report performance comparisons between our method and SVM based method. The comparisons were carried out on the HeLa dataset described in Additional file 3, and the results using three different groups of existing phenotypes are presented separately. (TIFF 263 KB)
Information on four existing phenotypes for case 1–4: histogram for major axis length and complete model parameters
Additional file 5: . This figure extends the information in Figure 7 of main text. The histogram for major axis length helps to show the necessity of modelling each morphological feature using GMM, and the parameters of estimated models are also available. (TIFF 604 KB)
Improving the strategy of taking reference dataset for gap statistics: motivation and innovation
Additional file 6: . This figure illustrates why we have to modify the strategy of taking reference dataset in the context of online phenotype discovery and how we work it out. The limitations of existing method, as well as the idea of our improvement are illustrated. (TIFF 464 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
About this article
Cite this article
Yin, Z., Zhou, X., Bakal, C. et al. Using iterative cluster merging with improved gap statistics to perform online phenotype discovery in the context of highthroughput RNAi screens. BMC Bioinformatics 9, 264 (2008). https://doi.org/10.1186/147121059264
Received:
Accepted:
Published:
Keywords
 Gaussian Mixture Model
 Reference Dataset
 Reference Distribution
 Gradient Vector Field
 Iterative Cluster