Skip to main content
  • Methodology article
  • Open access
  • Published:

Simulation of microarray data with realistic characteristics

Abstract

Background

Microarray technologies have become common tools in biological research. As a result, a need for effective computational methods for data analysis has emerged. Numerous different algorithms have been proposed for analyzing the data. However, an objective evaluation of the proposed algorithms is not possible due to the lack of biological ground truth information. To overcome this fundamental problem, the use of simulated microarray data for algorithm validation has been proposed.

Results

We present a microarray simulation model which can be used to validate different kinds of data analysis algorithms. The proposed model is unique in the sense that it includes all the steps that affect the quality of real microarray data. These steps include the simulation of biological ground truth data, applying biological and measurement technology specific error models, and finally simulating the microarray slide manufacturing and hybridization. After all these steps are taken into account, the simulated data has realistic biological and statistical characteristics. The applicability of the proposed model is demonstrated by several examples.

Conclusion

The proposed microarray simulation model is modular and can be used in different kinds of applications. It includes several error models that have been proposed earlier and it can be used with different types of input data. The model can be used to simulate both spotted two-channel and oligonucleotide based single-channel microarrays. All this makes the model a valuable tool for example in validation of data analysis algorithms.

Background

The emergence of several high throughput measurement technologies provides new possibilities to study biological organisms at the system level. New technologies produce such large amounts of data that can no longer be analyzed by hand. This has made computational techniques an inseparable part of data analysis. Although new computational methods are continuously proposed for data analysis, their performance can not be objectively evaluated. This remains as a fundamental problem in method development. Typically validation of data analysis methods is based on clinically determined labels of biological samples. If the computational method produces results which are consistent with the predetermined labels, then the method is considered to work reliably. This approach, however, relies entirely on a priori information about the data. Furthermore, the clinical classification of samples is not always unambiguous [1, 2].

A more objective approach to validate the data analysis methods is to use data whose characteristics and ground truth are known [3, 4]. Unfortunately, in real life problems this kind of data usually does not exist. Thus, to obtain data with known ground truth, one needs to produce the data by simulation. If simulated data is used to evaluate the performance of the analysis methods, can it be guaranteed that the same performance is obtained with real data also? To get meaningful results, the simulated data and the real biological data have to have similar biological and statistical characteristics.

A problem in the validation of data analysis algorithms using simulated data is that there is always an underlying mathematical model that is used to simulate the data. Thus, when different computational methods are compared, this approach favors the ones that implement the same assumptions as the data generation process does. While this is a fundamental problem, it can be circumvented by evaluating the methods using simulated data produced by different kinds of models. When the results are combined, the bias due to the model assumptions can be avoided.

Numerous studies have focused on mathematical modeling of biological and measurement errors, including both stochastic noise and systemic bias [5–11]. These studies have improved the analysis methods by utilizing the knowledge about the data properties [7]. This knowledge can be utilized in the generation of simulated data as well.

The error model itself is not enough for the simulation of biologically and statistically accurate data. Before an error model can be applied, the ground truth biological signal needs to be obtained. Depending on the application, a biological signal can be obtained for example by sampling a proper distribution or by modeling and simulating the biological system using differential equation models [12].

Once the biological ground truth signal has been generated and the error model has been applied, simulated data is still not comparable to real measurement data. Real data is always extracted from a measurement system. In the case of gene expression microarrays, image processing algorithms are used to read the spot values from the scanned slide image. The applied grid alignment, segmentation and data extraction algorithms have a significant effect to the obtained data [13].

There are numerous possible applications for a simulation model that can simulate realistic biological measurement data. The most obvious application is the validation and improvement of data analysis algorithms [3, 4, 14]. In addition, different data extraction algorithms can effectively be tested under different noise conditions. If the biological ground truth model is accurate enough one might even be able to simulate entire microarray experiments. If this could be done before performing expensive laboratory experiments, the proposed hypotheses could be tested with simulated data. This could help in finding problems in the design of the experiment and, thus, potentially save significant amount of time and money.

While all the steps of the simulation process have been extensively studied separately [6, 7, 15–18], not much work has been done to combine all the steps. We propose a model that combines these steps and can be used to produce microarray data with realistic biological and statistical characteristics. The proposed model is modular and it can be easily extended to include new error models and even new measurement technologies. The current implementation supports the simulation of spotted two-channel microarrays and oligonucleotide based single-channel microarrays. We have implemented the model in Matlab environment [see additional file 1]. The simulation model is also available for download at our companion web page [19].

Biologically meaningful input data can be obtained from various sources. We introduce some possibilities how this data can be obtained. We then review several previously published error models which model biological and measurement technology specific errors, and which can be used to add realistic statistical properties to the simulated data. The result data is used as a basis for simulating the production of the microarray slides. After that, we discuss about the final step in obtaining realistic measurement data: the extraction of the gene expressions from the slide. Finally we demonstrate the applications of the proposed model by examples.

Generation of the ground truth data

Depending on the application, the requirements for the ground truth data may vary. A typical microarray experiment includes comparison of different classes of samples, measuring a response to a perturbation, or measuring time series behavior. Validation of the data analysis methods developed for each of these applications sets different requirements for the ground truth data.

The simplest approach to generate the ground truth data is to sample data randomly from a specific distribution. First the distribution and its parameters can be estimated from real measurements. Next the ground truth data can be obtained by sampling a simulated ideal distribution with estimated parameters [7, 15]. This approach can be adequate for several applications. The detection of differentially expressed genes is often based on the comparison of statistical properties of microarray data from two different samples, for example from two different cancer types. Therefore, the ground truth data suitable for validating data analysis methods can be obtained simply by sampling two distributions with different parameters.

If purpose of the data analysis is to study the behavior of the system in more detail, for example to study responses to perturbations, then biologically more detailed data can be generated. Because microarray technology measures gene expressions, the natural source for biological data would be a model of a genetic regulatory network (GRN). Unfortunately, GRNs are not generally known well enough so that they could be utilized in data simulation [20].

However, in some cases parts of the networks are known and even simulation models that include parts of the genetic regulatory mechanisms have been proposed [12, 17]. These kinds of models would be ideal for the generation of ground truth data. If a model is accurate enough, even hypotheses about the behavior of the real system could be tested before a real microarray experiment is done.

Generation of data with biologically meaningful characteristics does not require the modeling of real GRNs [18]. Instead one can use networks with random topology. If the interactions between network components are modeled properly, for example by utilizing interaction information from real GRNs, one could produce data with realistic characteristics [20].

Once the network model has been obtained and mathematical models for interactions have been formulated, the expression values of the genes in the network need to be simulated. There are several publicly available software packages that can be used to accomplish this task [21, 22].

Yet another application for microarray data is network inference, that is, learning the network structure and the interaction rules between the network components from time series or perturbation measurements.

In network inference, the modeling of control mechanisms of a network plays an essential role. Therefore, it is not necessary that all the interactions correspond to the ones of a real network and thus, even coarse scale models can be used. For example, it is shown that very simple models, even random Boolean networks, can capture some of the essential characteristics of real GRNs [23, 24]. Thus it may be sufficient to use for example a Boolean network as a ground truth in network inference studies [25].

Real measurement data can also be used as ground truth data. This is the case, for example, if we want to study how our data analysis algorithm performs under different types and amounts of noise. By adding noise to real measurement data we can effectively test if the performance of our data analysis algorithms degrades as the amount of noise increases. This can give us valuable insight into the robustness of the algorithms.

Microarray simulation model

In this section, a model for microarray measurements is presented. The model can use input data from numerous different sources. In practice, there is no limitation on what kind of simulator or software is used to generate the ground truth data.

The proposed simulation model is modular and the configuration is very flexible. The structure of the model is presented in Figure 1. Each module is independent of the others, and can easily be replaced. This, for example, makes it possible to easily change the error model for the biological noise.

Figure 1
figure 1

Microarray simulation model. Block diagram of the microarray simulation model.

In the following we will discuss the most important characteristics of each module. Model parameters are listed in Tables 1, 2, 3, 4, 5. A more detailed documentation about the effect and usage of each parameter can be found on our companion web page [19].

Table 1 List of noise parameters. Noise parameters available in the microarray simulation model.
Table 2 List of slide parameters. Overview of the slide simulation parameters. More detailed documentation of the parameters is available on the companion web page [19].
Table 3 List of hybridization parameters. Overview of the hybridization effect parameters.
Table 4 List of scanner parameters. Overview of the scanner effect parameters.
Table 5 List of error models. Error models (EM) and the parameters for each of the implemented error model. Noise free input data is denoted by x and the noisy output data by y. Index i refers to gene, j to array (chip), and k to biological sample specific noise. Index p refers to a specific probe within a probe set.

File input

Input data to the model is read using a file input module. This module converts the data to the internal format of the simulation model. Input data can be gene expression values or expression ratios. For example data from Affymetrix .cel files or simulated expression values can be used. In addition to data itself, the user should specify spot locations on the slide and their identifiers, such as probe names. Requirements for the input data are listed in Table 6. More detailed information about the format of the input data are given on the companion web page [19].

Table 6 Input data requirements. Requirements for the simulator input data used in microarray simulation.

Biological and measurement noise

The most important part in the simulation of realistic microarray data is the modeling of biological and measurement technology specific errors because they define the statistical characteristics of the simulated data. Biological errors are typically considered to include the internal stochastic noise of the cells and error sources related to sample preparation [16, 26]. This type of intrinsic noise is present in all measurements, regardless of the measurement technology. Measurement errors, on the other hand, include error sources that are directly related to the measurement technology and its limitations, for example bias due to the used dyes. The properties of this kind of extrinsic noise depend on the measurement technology [5]. In addition to the fact that the simulated ground truth data is measurement error free, there is another major difference compared to real microarray data. Microarray data are usually measurements from cell populations. Thus the measured values are average expression values of all the cells in the population while the simulated data essentially presents the behavior of a single cell. Furthermore, it is difficult to prepare a sample containing only one type of cells. Therefore, the measured data is typically from a heterogeneous cell population, for example from a mixture of different types of cells [27]. The simulated data can be made more realistic by introducing a population effect. This can be done by using a kernel function to spread the ideal expression patterns as proposed in [28]. The population effect blurs the simulated ground truth data so that all the details can not be observed. Small variations occurring only in some cells can not be observed because they are covered by the large trends of the majority of the cells.

After the population effect has been taken into account, we can add biological and measurement errors to the simulated data. There have been numerous studies characterizing the properties of the error sources [5–11]. While the formulations of different error models are slightly different, the main components in all the models are the same. All of these models contain components that are dependent and components that are independent of the expression level. Thus, the errors are considered to be nonlinear in nature. Biological and measurement errors can be presented in the compact form

y = f (x) + e,       (1)

where f is a nonlinear function, depending on the gene expression level x, e is an error term independent of gene expression level, and y is the observed expression value. Function f includes all error sources that are dependent on the true underlying biological gene expression level x. Thus, error term e and function f include both stochastic noise and systemic bias that originate from biological and measurement technology specific error sources.

To make it possible to estimate the parameters of the error models from real data, error terms are usually factorized into a more detailed form. Typically an error model includes separate terms for gene specific noise, measurement specific noise, array specific noise, biological sample specific noise, noise independent of all these, and so on [6, 7]. Some of the components model the intrinsic noise, that is, errors from biological origin while other components represent the extrinsic noise, that is, errors from the microarray measurement technology. However, usually both of these error types are modeled together regardless of their origin.

As there are error sources that are gene, array and biological sample specific, there needs to be a way to implement all these in the model. In addition to these error sources, there may be technology specific details which have to be considered. Affymetrix type oligonucleotide arrays contain several probes that are a part of the same probe set and thus measure the same gene. Furthermore, perfect match (PM) and mismatch (MM) probes need to be handled independently in the error model [11]. These issues are taken into account in the simulation model design, and all these type of errors can easily be included. For details on how different types of error sources can be implemented, see the documentation available on the companion web page.

Our microarray simulation model includes several error models proposed in the literature [6–11]. Along with the models, methods for estimating model parameters from real measurement data have been proposed [7, 9, 11]. These methods can be used to estimate realistic parameters for the simulation. Some of the implemented error models are for oligonucleotide and some for cDNA data. Thus, to get statistically accurate results the right type of error model needs to be used together with the proper array type. The error models and their parameters are summarized in Table 5. After the error model and the population effect have been applied, the simulated data has realistic biological and statistical characteristics.

Slide manufacturing

To model a real microarray experiment it is not enough to simulate the gene expressions and to apply the error model, but the extraction of the data from slides has to be considered too [13]. Thus we need to model the microarray manufacturing process.

A slide image is simulated using a user specified layout, that is, how many subarrays there are on the slide and how many spots or probes are in each row and column. Slide simulation introduces several error sources that are often visible in real microarray slide images. These include variation in the spot position and size. In addition the marks done by a print tip and deformations in the spot shape can be produced. For example, one type of deformations are chords that are cut away from the spots. These error sources are demonstrated in Figure 2. It is also possible to make the subarray layout imperfect by applying a non-linear error which makes the subarrays to drift from their ideal rectangular layout. This is shown in Figure 3. All the error sources can be controlled probabilistically by user adjustable parameters (see Table 2).

Figure 2
figure 2

Slide generation errors. Errors in slide image generation are demonstrated. There is large variation in the spot size. In addition many spots have unideal shapes.

Figure 3
figure 3

Drift in spot alignment. Systematic drift due to the unideal printing of the microarray slide can be introduced with used adjustable parameters.

Slide hybridization

The slide hybridization step simulates the shape of the hybridized spot on the microarray. Several models for spot shape have been proposed. As different array technologies produce different types of spots, there is no single spot model that is suitable for all types of arrays. For example, it is shown that Gaussian distribution can be successfully fitted over cDNA microarray spots [29]. Recent studies have also introduced more detailed spot models [30]. We have implemented several models for the spot shape, including Gaussian and polynomial-hyperbolic spot shapes [30]. Parameters for the spot shapes can be set by the user. The ideal shape of the spot is corrupted by multiplicative Gaussian noise, again with user specified parameter values for the noise. The hybridized spot is then obtained by multiplying the noisy spot shape by the corresponding expression value. Spot generation with the Gaussian spot shape is presented in Figure 4(a–b). In the case of a single channel oligonucleotide microarray, rectangular spot corrupted by additive Gaussian noise is used. An example of a simulated oligonucleotide microarray spot is shown in Figure 4(c).

Figure 4
figure 4

Simulated spots. Shape of (a) simulated noise free cDNA spot, (b) noisy cDNA spot, and (c) noisy single-channel oligonucleotide array spot. Intensity of the spot is determined by the corresponding expression value.

Like previously in the slide generation phase, the user can introduce several hybridization errors that are typical for microarrays. Errors include background noise, spot bleeding, scratches, and air bubbles. These are demonstrated in Figure 5.

Figure 5
figure 5

Hybridization errors. Hybridization errors are demonstrated. Spot bleeding, scratches, air bubbles and background noise are clearly visible.

While the most relevant of these errors may depend on the array type, the simulation model makes it possible to use the same error sources on both spotted two-channel and oligonucleotide based single-channel arrays. Introduction of these types of error sources might be of interest in validation of grid alignment and segmentation algorithms.

Slide scanning

In real experiments the hybridized slide is digitized by scanning. As a result a digital RGB image is obtained in which each color channel corresponds to the intensity information from different dyes. While the modern scanners are usually of high quality, they still have an effect on the obtained data, for example, in the form of the dynamic range. All scanners have a finite dynamic range, and thus some measurement values might saturate.

The scanner can also be a source for other type of errors. Because the slide is read by scanning each dye color separately, it might be possible that channels do not align perfectly. Furthermore, it is not guaranteed that the slide is always scanned exactly straight. All these types of errors are included into the model.

Image reading

The final step in obtaining the realistic simulation data is to extract the expression values from the image. Because our simulation model produces images similar to real microarray slides, one can conveniently use any microarray feature extraction software.

We have however included an automatic grid alignment and image segmentation algorithm into the simulation model so that the data can be automatically extracted from images. These default algorithms can be easily replaced by other extraction algorithms.

Results and discussion

We first demonstrate the use of the proposed microarray model using simulated gene expression data. The ground truth biological signals are generated using random network topology with kinetic rate laws that present rates for transcription processes, and kinetic rate laws for degradation rates of the gene products [18]. The details about the data generation can be found on our companion web site. We use a gene knock out experiment as a case study [31]. The reference data is obtained by simulating the generated network. Then the test sample is obtained by knocking out a randomly chosen gene from the network and then running the same simulation using the network with the knocked out gene. Simulated gene expression profiles of a few selected genes that were affected by the knock out are shown in Figure 6. Next an error model is applied to the obtained ground truth data. We use the hierarchical error model to model the biological and the measurement specific noise [6]. Figure 7 illustrates the simulated gene expressions profiles after adding the noise.

Figure 6
figure 6

Simulated ground truth signals. Gene expression profiles of the selected genes. The effect of the gene knockout to the expression profiles is clearly observable. Reference signal is shown with solid and test signal with dashed line.

Figure 7
figure 7

Simulated ground truth signals with noise added. Gene expression profiles of the same genes as in Figure 6 with measurement noise added. Small trends (for example lowest sub figure) in the signals are covered by noise. Reference signal is shown with solid and test signal with dashed line.

After the error model is applied, we generate the slide images. As an example we show two slide images in Figure 8, generated at time instants 10 and 200 minutes corresponding to the time scale in Figures 6 and 7. It can be observed that in the beginning only one spot shows a difference in the expression. This corresponds to the gene that was knocked out. At the later time instant the effect of the knockout has spread through the network, and many genes show change in their expression. That is, spot colors have changed from yellow to red or green. In this example the amount of biological and measurement errors is in the minimum in order to point out the spreading effects of the knock out. Adding more measurement and biological errors would introduce more changes in the expressions already at the 10 minutes time instant. To illustrate that the simulated data has properties similar to real microarray data, we show scatter plots of the simulated data. For this example the ground truth data is drawn from predetermined distribution. Common assumption is that the ground truth expression values are from an exponential distribution I = λe-λx [7, 15]. We draw 10000 expression values from this distribution, with λ = 1/3000. As we are interested in evaluating the quality of the data, we do not introduce any differentially expressed genes, but simulate a self versus self experiment as explained in [15]. Red and green intensities I R and I G are drawn from a normal distribution N (I, αI), where α = 0.1 and I is a realization from an exponential distribution. Next, the final red and green intensities I R and I G are transformed with x ^ = x a 0 + a 1 MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacH8akY=wiFfYdH8Gipec8Eeeu0xXdbba9frFj0=OqFfea0dXdd9vqai=hGuQ8kuc9pgc9s8qqaq=dirpe0xb9q8qiLsFr0=vr0=vr0dc8meaabaqaciaacaGaaeqabaqabeGadaaakeaacuWG4baEgaqcaiabg2da9iabdIha4naaCaaaleqabaGaemyyae2aaSbaaWqaaiabicdaWaqabaaaaOGaey4kaSIaemyyae2aaSbaaSqaaiabigdaXaqabaaaaa@369A@ , where x = {I R , I G } with parameters a0 = 1.04, a1 = 0.5 for I R and a0 = 0.95, a1 = -0.2 for I G . This is a simplified version of the ground truth data generation proposed in [15]. Scatter plot of the data is shown in Figure 9(a). To illustrate what is the effect of reading the spot values from a simulated slide image, we simulate a microarray without adding any biological or measurement errors to the ground truth data. Only slide manufacturing and hybridization errors are introduced. Scatter plot of the noise free data extracted from a simulated slide image is shown in Figure 9(b). It can be observed that the extraction of the data alone introduces some errors.

Figure 8
figure 8

Simulated spotted microarray slide images. Simulated slide images at time instants (a) 10 and (b) 200 minutes. Several error sources, like spot size and shape variation and bleeding are included in simulation. On the slide image on the right (b) also unideal subarray alignment and scratches are introduced.

Figure 9
figure 9

Scatter plots of the simulated data. MA-plot is shown for (a) noise free simulated data, (b) noise free data extracted from slide, and (c) realistic simulated data. Lowess fit is shown over each scatter plot to illustrate the trends in the data. All data points extracted from slide are scaled to [0,1] interval, thus the scale of the x-axis is different to the simulated noise free data.

Finally, we run the simulated ground truth data through a hierarchical error model [6]. The resulting scatter plot is shown in Figure 9(c). It is difficult to quantify objectively if the data is really realistic, but the scatter plot shows characteristics that are observed from real microarray data [2, 32]. For example, the arrow head shape at the left is observed with real microarray data [32]. Furthermore, the scatter pattern shows more variation at the small intensity values, which is the case with real microarray data also [32]. As another example we will demonstrate the simulation of a single-channel oligonucleotide microarray slide. As the ground truth data we use yeast data that can be downloaded from Affymetrix web site [33]. We simulate a slide image based on the intensity values in the .cel file. Figure 10 represents a crop of the simulated image and the corresponding real image from the original .dat file.

Figure 10
figure 10

Example of an Affymetrix microarray simulation. Example of the simulated single-channel oligonucleotide microarray slide image (crop from top left corner) (a). We have used an Affymetrix .cel file as the ground truth data. Thus the text about the slide type is observable. Real Affymetrix slide image is shown for comparison (b).

As the final application example, we present how the proposed simulation model can be used for comparing spot segmentation algorithms. Spot segmentation, along with procedures such as spot addressing and estimation of background and foreground levels, is one of the successive steps affecting the estimation of the true signal intensity. Simultaneous comparison of all the methods affecting the estimated true signal is a complex problem which would require more attention in order to be thoroughly studied. In our current example we estimate the spot and the background intensities by calculating the mean of segmented foreground and background pixels. Thereafter, the expression value is obtained by subtracting the background intensities from the foreground intensities. Our comparison example includes three different segmentation algorithms: The fixed circle (FC) method [34], the histogram segmentation (HST) method [35], and the seeded region growing (SRG) method [36].

We simulate three test images consisting of eight subarrays with altogether 1000 spots per image. Each image has different quality characteristics. The first image is of high quality, with low variance noise (0.01) and relatively round and regularly sized spots. The second image has more noise (variance 0.02) and more irregular spot shapes and sizes, while the third has even more disturbing noise which has higher variance (0.03). Furthermore the spot shapes and sizes include more variation compared to the other images. Air bubbles, scratches, spot bleeding, and print tip effects are added into the second and third image, the third including more such artefacts than the second image. Figure 11 shows one subarray from each of the images used in this experiment. Detailed information about the simulation parameters for these three images is available on the companion web page.

Figure 11
figure 11

Slide image segmentation examples. One subarray from each of the images used to test the segmentation algorithms are shown. From left to right: (a) high quality slide, (b) noisy slide with artifacts, and (c) disturbing noise and artifacts over the slide. Increase in noise and degradation of the spot quality is clearly observable.

The results of applying the selected segmentation algorithms on the synthetic test images and calculating the spot intensities from the segmentation results are shown in Figure 12 where the estimated spot intensities are plotted against the reference signal. Figure 12(a) shows the scatter plots for the first image, 12(b) shows the plots for the second image of slightly degraded quality, and 12(c) presents the plots for the third, low quality image. After removing the estimated background, some of the spot intensities become negative. These negative intensities are replaced with zeros. To quantify the performance of different algorithms, we compute the correlation coefficient for each comparison. The results are given in Table 7. Even though we mainly focus on simulating images with realistic parameters, some observations on the segmentation results are presented. The results presented in Table 7 support intuition; all methods give worse results as the image quality is degraded. The fixed circle segmentation is likely to be confused by the irregular shapes and sizes of the spots in the second image (shown in Figure 11(b)) and especially in the third image (shown in Figure 11(c)). The other methods are corrupted mainly by the noise in the second and the third image. Despite the high correlation with the reference expressions, the intensity given by HST segmentation method suffers from a relatively high bias. However, the low scattering of intensities given by HST, compared to that of FC and SRG, explains the high correlation. HST has also less outliers on the lower side of the scatter plot. Both the bias in HST and scattering in FC and SRG are clearly visible in Figure 12. The results of the segmentation experiment are well in accordance with the basic assumptions. Thus, the images produced by the proposed simulation model can be used for testing microarray image processing algorithms, and the model provides useful information about the available methods.

Figure 12
figure 12

Results of segmentation example. The spot intensities estimated from the simulated images with the fixed circle (first row), the histogram segmentation (second row), and the seeded region growing (third row) segmentation algorithms are plotted against the input data (reference). The plots are from the first channel of the test images: (a) intensities for the high quality image given by the three segmentation algorithms, (b) intensity plots for image with noise and errors, (c) plots for image with disturbing noise and artefacts.

Table 7 Segmentation results. Correlation coefficients between the estimated spot intensities and the input data. Histogram segmentation gives the highest correlation with the reference data. All methods give poorer correlations as the image quality is degraded.

Conclusion

The previously proposed microarray simulation models have been suitable for specific simulation tasks only. The model we have proposed is modular and can be used in different kinds of analyzes. One of the most important properties of the proposed model is the ability to use almost any kind of input data. Most models are limited to specific types of data, typically random data drawn from a predetermined distribution. Thus, they can not exploit other data, such as data produced by network simulation. In addition, the proposed model utilizes several previously published error models in modeling the biological and measurement technology dependent variation. Thus, the model is not dependent of any specific formulation of noise characteristics, and the performance of the analysis algorithms can effectively be tested under different noise assumptions. Our model also supports both spotted two-channel and oligonucleotide based single-channel microarrays.

We have shown that the proposed model can be used to simulate microarray data which is valuable for validating various kind of data analysis algorithms. As an example, the performance of the microarray segmentation algorithms were compared under different noise conditions.

References

  1. Trotter MJ, Bruecks AK: Interpretation of skin biopsies by general pathologists: Diagnostic discrepancy rate measured by blinded review. Arch Pathol Lab Med 2003, 127(11):1489–1492.

    PubMed  Google Scholar 

  2. Nykter M, Hunt KK, Pollock RE, El-Naggar AK, Taylor E, Shmulevich I, Yli-Harja O, Zhang W: Unsupervised analysis uncovers changes in histopathologic diagnosis in supervised genomic studies. Technol Cancer Res Treat 2006, 5(2):177–182.

    Article  CAS  PubMed  Google Scholar 

  3. Quackenbush J: Computational analysis of microarray data. Nat Rev Genet 2001, 2: 418–427. 10.1038/35076576

    Article  CAS  PubMed  Google Scholar 

  4. Wierling CK, Steinfath M, Elge T, Schulze-Kremer S, Aanstad P, Clark M, Lehrach H, Herwig R: Simulation of DNA array hybridization experiments and evaluation of critical parameters during subsequent image and data analysis. BMC Bioinformatics 2002, 3: 29. 10.1186/1471-2105-3-29

    Article  PubMed Central  PubMed  Google Scholar 

  5. Tu Y, Stolovitzky G, Klein U: Quantitative noise analysis for gene expression microarray experiments. Proc Natl Acad Sci USA 2002, 99(22):14031–14036. 10.1073/pnas.222164199

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  6. Cho H, Lee JK: Bayesian hierarchical error model for analysis of gene expression data. Bioinformatics 2004, 20(13):2016–2025. 10.1093/bioinformatics/bth192

    Article  CAS  PubMed  Google Scholar 

  7. Dror RO, Murnick JG, Rinaldi NJ, Marinescu VD, Rifkin RM, Young RA: Bayesian estimation of transcript levels using a general model of array measurement noise. J Comput Biol 2003, 10(3–4):433–1452. 10.1089/10665270360688110

    Article  CAS  PubMed  Google Scholar 

  8. Rocke DM, Durbin B: A model for measurement error for gene expression array. J Comput Biol 2001, 8(6):557–569. 10.1089/106652701753307485

    Article  CAS  PubMed  Google Scholar 

  9. Hartemink AJ, Gifford DK, Jaakkola TS, Young RA: Maximum-likelihood estimation of optimal scaling factors for expression array normalization. In Proc. SPIE Microarrays: Optical Technologies and Informatics Edited by: Bittner ML, Chen Y, Dorsel AN, Dougherty ER. 2001, 4266: 132–140.

    Chapter  Google Scholar 

  10. Nykter M, Aho T, Kesseli J, Yli-Harja O: On estimation of statistical characteristics of microarray data. Proc. Finnish Signal Processing symposium FINSIG 2003, Tampere, Finland 2003.

    Google Scholar 

  11. Hein AMK, Richardson S, Causton HC, Ambler GK, Green PJ: BGX: A fully Bayesian integrated approach to the analysis of Affymetrix GeneChip data. Biostatistics 2005, 6(3):349–373. 10.1093/biostatistics/kxi016

    Article  PubMed  Google Scholar 

  12. Chen KC, Csikasz-Nagy A, Gyorffy B, Val J, Novak B, Tyson JJ: Kinetic analysis of a molecular model of the budding yeast cell cycle. Mol Biol Cell 2000, 11: 369–391.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  13. Balagurunathan Y, Wang N, Dougherty ER, Nguyen D, Chen Y, Bittner ML, Trent J, Carroll R: Noise factor analysis for cDNA microarrays. J Biomed Opt 2004, 9(4):663–678. 10.1117/1.1755232

    Article  CAS  PubMed  Google Scholar 

  14. Singhal S, Kyvernitis CG, Johnson SW, Kaisera LR, Liebman MN, Albelda SM: Microarray data simulator for improved selection of differentially expressed genes. Cancer Biol Ther 2003, 2(4):383–391.

    Article  CAS  PubMed  Google Scholar 

  15. Balagurunathan Y, Dougherty ER, Chen Y, Bittner ML, Trent JM: Simulation of cDNA microarrays via a parameterized random signal model. J Biomed Opt 2002, 7(3):507–523. 10.1117/1.1486246

    Article  CAS  PubMed  Google Scholar 

  16. Blake WJ, Kærn M, Cantor CR, Collins JJ: Noise in eukaryotic gene expression. Nature 2003, 422(6932):633–637. 10.1038/nature01546

    Article  CAS  PubMed  Google Scholar 

  17. Chen KC, Calzone L, Csikasz-Nagy A, Cross FR, Novak B, Tyson JJ: Integrative analysis of cell cycle control in budding yeast. Mol Biol Cell 2004, 15: 3841–3862. 10.1091/mbc.E03-11-0794

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  18. Mendes P, Sha W, Ye K: Artificial gene networks for objective comparison of analysis algorithms. Bioinformatics 2003, 19(Suppl 2):ii122-iil29.

    Article  PubMed  Google Scholar 

  19. Simulation of microarray data with realistic characteristics companion web page[http://www.cs.tut.fi/sgn/csb/mamodel/]

  20. Lee TI, Rinaldi NJ, Robert F, Odom DT, Bar-Joseph Z, Gerber GK, Hannett NM, Harbison CT, Thompson CM, Simon I, Zeitlinger J, Jennings EG, Murray HL, Gordon DB, Ren B, Wyrick JJ, Tagne JB, Volkert TL, Fraenkel E, GifFord DK, Young RA: Transcriptional regulatory networks in saccharomyces cerevisiae . Science 2002, 298: 799–804. 10.1126/science.1075090

    Article  CAS  PubMed  Google Scholar 

  21. Mendes P: GEPASI: a software package for modelling the dynamics, steady states and control of biochemical and other systems. Comput Appl Biosci 1993, 9(5):563–571.

    CAS  PubMed  Google Scholar 

  22. Pettinen A, Aho T, Smolander OP, Manninen T, Saarinen A, Taattola KL, Yli-Harja O, Linne ML: Simulation tools for biochemical networks: Evaluation of performance and usability. Bioinformatics 2005, 21(3):357–363. 10.1093/bioinformatics/bti018

    Article  CAS  PubMed  Google Scholar 

  23. Kauffman SA: Metabolic stability and epigenesis in randomly constructed genetic nets. J Theor Biol 1969, 22: 437–467. 10.1016/0022-5193(69)90015-0

    Article  CAS  PubMed  Google Scholar 

  24. Huang S, Ingber DE: Shape-dependent control of cell growth, differentiation, and apoptosis: Switching between attractors in cell regulatory networks. Exp Cell Res 2000, 261: 91–103. 10.1006/excr.2000.5044

    Article  CAS  PubMed  Google Scholar 

  25. Shmulevich I, Yli-Harja O, Astola J: Inference of genetic regulatory networks under the best-fit extension paradigm. Proc. IEEE – EURASIP Workshop on Nonlinear Signal and Image Processing, Baltimore, Maryland 2001.

    Google Scholar 

  26. Fraser HB, Hirsh AE, Giaever G, Kumm J, Eisen MB: Noise minimization in eukaryotic gene expression. PloS Biol 2004, 2(6):el37. 10.1371/journal.pbio.0020137

    Article  Google Scholar 

  27. Lähdesmäki H, Shmulevich I, Dunmire V, Yli-Harja O, Zhang W: In silico microdissection of microarray data from heterogeneous cell populations. BMC Bioinformatics 2005, 6: 54. 10.1186/1471-2105-6-54

    Article  PubMed Central  PubMed  Google Scholar 

  28. Lähdesmäki H, Aho T, Huttunen H, Linne ML, Niemi J, Kesseli J, Pearson R, Yli-Harja O: Estimation and inversion of the effects of cell population asynchrony in gene expression time-series. Signal Process 2003, 83(4):835–858. 10.1016/S0165-1684(02)00471-1

    Article  Google Scholar 

  29. Brändle N, Bishof H, Lapp H: A generic and robust DNA microarray image analysis. Mach Vision Appl 2003, 15: 11–28. 10.1007/s00138-002-0114-x

    Article  Google Scholar 

  30. Ekstrøm CT, Bak S, Kristensen C, Rudemo M: Spot shape modelling and data transformations for microarrays. Bioinformatics 2004, 20(14):2270–2278. 10.1093/bioinformatics/bth237

    Article  PubMed  Google Scholar 

  31. Hughes TR, Roberts CJ, Dai H, Jones AR, Meyer MR, Slade D, Burchard J, Dow S, Ward TR, Kidd MJ, Friend SH, Marton MJ: Widespread aneuploidy revealed by DNA microarray expression profiling. Nat Genet 2000, 25: 333–337. 10.1038/77116

    Article  CAS  PubMed  Google Scholar 

  32. Bolstad BM, Irizarry RA, Åstrand M, Speed TP: A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics 2003, 19(2):185–193. 10.1093/bioinformatics/19.2.185

    Article  CAS  PubMed  Google Scholar 

  33. Affymetrix[http://www.affymetrix.com/]

  34. Scanalyze[http://rana.lbl.gov/EisenSoftware.htm]

  35. Yang YH, Buckley MJ, Speed TP: Analysis of cDNA microarray images. Brief Bioinform 2001, 2(4):341–349. 10.1093/bib/2.4.341

    Article  CAS  PubMed  Google Scholar 

  36. Yang YH, Buckley M, Dudoit S, Speed T: Comparison of methods for image analysis on cDNA microarray data. J Comput Graph Stat 2002, 11: 108–136. 10.1198/106186002317375640

    Article  Google Scholar 

Download references

Acknowledgements

This work was funded by the National Technology Agency of Finland and the Academy of Finland, project No. 213462 (Finnish Centre of Excellence program (2006–2011)). We want to thank Raija Lehto and Juho Lahti for implementing the grid alignment and image segmentation tools.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matti Nykter.

Additional information

Authors' contributions

MN and MA designed and implemented the microarray simulation model. TA was responsible for simulating the biological ground truth data. PR and AL performed image processing experiments. OY-H conceived of the study and participated in the design and coordination. MN drafted the manuscript. All authors read and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Nykter, M., Aho, T., Ahdesmäki, M. et al. Simulation of microarray data with realistic characteristics. BMC Bioinformatics 7, 349 (2006). https://doi.org/10.1186/1471-2105-7-349

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2105-7-349

Keywords