# designGG: an R-package and web tool for the optimal design of genetical genomics experiments

- Yang Li
^{1}Email author, - Morris A Swertz
^{1, 2}, - Gonzalo Vera
^{1}, - Jingyuan Fu
^{2}, - Rainer Breitling
^{1}and - Ritsert C Jansen
^{1, 2}

**10**:188

https://doi.org/10.1186/1471-2105-10-188

© Li et al; licensee BioMed Central Ltd. 2009

**Received: **23 April 2009

**Accepted: **18 June 2009

**Published: **18 June 2009

## Abstract

### Background

High-dimensional biomolecular profiling of genetically different individuals in one or more environmental conditions is an increasingly popular strategy for exploring the functioning of complex biological systems. The optimal design of such genetical genomics experiments in a cost-efficient and effective way is not trivial.

### Results

This paper presents designGG, an R package for designing optimal genetical genomics experiments. A web implementation for designGG is available at http://gbic.biol.rug.nl/designGG. All software, including source code and documentation, is freely available.

### Conclusion

DesignGG allows users to intelligently select and allocate individuals to experimental units and conditions such as drug treatment. The user can maximize the power and resolution of detecting genetic, environmental and interaction effects in a genome-wide or local mode by giving more weight to genome regions of special interest, such as previously detected phenotypic quantitative trait loci. This will help to achieve high power and more accurate estimates of the effects of interesting factors, and thus yield a more reliable biological interpretation of data. DesignGG is applicable to linkage analysis of experimental crosses, e.g. recombinant inbred lines, as well as to association analysis of natural populations.

## Keywords

## Background

Genetical genomics [1] has become a popular strategy for studying complex biological systems using a combination of classical genetics, biomolecular profiling and bioinformatics [2–5]. By measuring molecular variation, using transcriptomics, proteomics, metabolomics and related emerging technologies, in genetically different individuals, genetical genomics has the potential to identify the functional consequences of natural and induced genetic variation. Recently, genetical genomics has been generalized to achieve a comprehensive understanding of the dynamics of molecular networks by combining environmental and genetic perturbation [6, 7]. This type of large scale "omics" study leads to a better understanding of why individuals of the same species respond differently to drugs, pathogens, and other environmental factors.

However, most molecular profiling experiments are very costly, and as a consequence most genetical genomics studies are performed at the verge of statistical feasibility. Therefore, experimental design needs careful consideration to achieve maximum power from limited resources, such as microarrays and experimental animals [8, 9]. But, even in standard scenarios this requires sophisticated application of statistical concepts to intelligently select genetically different individuals from a population and allocate them to different conditions and experimental units. This topic has motivated classical statistical research since a long time [10]. More recently, the concepts developed there have been adapted to the high dimensional data sets of post-genomics research [8, 11–13], and useful simplified design strategies have been suggested [11, 14]. However, to transfer these statistical ideas to the even more complex context of genetical genomics [9, 15, 16] still requires considerable expertise in statistics.

Here we present an online web tool to make these selections and allocations easy for biologists with little/no statistical training. The program will find the best experimental design to produce the most accurate estimates of the most relevant biological parameters, given the number of experimental factors to be varied, the genotype information on the population, the profiling technology used, and the constraints on the number of individuals that can be profiled. Advanced users can download the underlying methods as an R package to adapt the program for a more tailored design. Without loss of generality, we will illustrate the method using microarrays, while they apply equally well to other profiling technologies, such as mass spectrometry. Also, we will only discuss molecular technologies that profile samples individually (e.g., single color microarrays) or in pairs (e.g., dual color microarrays), but an extension of the R scripts to more advanced multiplex technologies would be straightforward [17].

## Implementation

The objective of designGG is to find an optimal allocation of genetically different samples to different conditions and experimental units (arrays) favoring a precise estimate of interesting parameters, such as main genetic effects and interaction effects between genotype and drug treatment. A simple case with one environmental factor can be expressed as y = μ + G× E + ε, where y is the measurement vector, ε is the error term, and G×E denotes main effect and interaction effects of genotype and environment. In matrix notation, a model with one or more genotype factors (quantitative trait loci; QTL) and one or more environmental factors can be written as: **Y** = **Xβ** + **E**, where **X** is the design matrix of samples by parameters and **β** is the effect of genotype and environmental factors. The least squares estimate of **β** is b = (**X**^{T}**X**)^{-1}**X**^{T}**Y** with var(b) = σ^{2}(**X**^{T}**X**)^{-1}. The optimal experiment design is defined as the one that minimizes the double sum of the variances of b firstly summed over all parameters and then summed over all genotypic markers. We use an optimization algorithm (simulated annealing [18]) to search the experimental design space of all possible allocations to produce an optimal design matrix **X**. During the optimization, the algorithm utilizes the available marker information from the individuals to optimize the allocation of individuals to microarrays and conditions.

In the optimization, the experimenter can, of course, give more weight to parameters of higher interest, which will then be estimated with higher accuracy. Particularly, prior knowledge about expected effect sizes of interesting factors can be incorporated as weight parameters for the algorithm and the weight is inversely proportional to the expected effect size of the corresponding factors. In addition, it is also possible to specify the genome regions that are of major interest in a particular experiment, by specifying a region parameter. For example, if the relevant phenotype is known to map to certain genome regions, parameters for the markers in these regions can be given full weight in the optimization algorithm, whereas parameters for other markers can be given lesser or even zero weight. Thus, mapping resolution can improve and the power for finding QTLs in focal regions can be increased.

DesignGG is a package entirely written in the R language [19]. Every function of the designGG library is available as a stand-alone R tool and detailed help is available according to the standard format of R documentation.

## Results

### Web tool

- 1.
Choose the platform. Select the single- or dual-channel option for one-color or two-color gene expression microarrays (the dual-channel option is also used for any other technology profiling pairs of samples).

- 2.
Upload a tab separated value (TXT) file containing the genotype data matrix (individuals × markers). Each cell contains a genotype label (e.g. A or B for the parental alleles, H for heterozygous loci; NA for missing data).

- 3.
Set parameters. Specify the number of environmental factors, their number of levels, and the possible values of these levels. Specify either the total number of slides (assays) or the number of samples allocated within each condition.

- 4.
Use advanced options if only one or a few genome regions or particular factors are of major interest. It is possible to optimize the experimental design by focusing on certain regions (e.g. the first 20 markers on chromosome I). Prior knowledge about expected effect sizes of interesting factors can also be incorporated as weight parameters for the algorithm.

- 5.
Start the optimization algorithm by clicking on the button

**Optimize Experimental Design**(Figure 1). - 6.
Get results. After the optimization is finished, the optimal experimental design will be displayed online (in table format), and will be available as text files for download.

### R package

_{1}), drug treatment (F

_{2}) and their interaction on gene expression using two-colour microarrays. There are 100 microarray slides available for this experiment, and we plan to study two different levels for each environment, which are 16°C and 24°C for F

_{1}(temperature), and 5 μM and 10 μM for F

_{2}(drug treatment). Then the R package can also be used in command line form as follows:

- 1.
Prepare the input file specifying the genotype of each individual at each marker position. The file should be formatted as tab separated values (TXT), as illustrated in Table 1.

Example table of genotype data. Heterozygous loci are indicated by an H.

Strain 1 | Strain 2 | Strain 3 | Strain 4 | Strain 5 | ... | |
---|---|---|---|---|---|---|

C1M1 | A | B | B | B | A | ... |

C1M2 | A | H | A | B | A | ... |

C1M3 | A | A | B | H | A | ... |

... | ... | ... | ... | ... | ... | ... |

- 2.
Load the designGG package by starting the R application and typing the command:

> library(designGG)

- 3.
Choose the platform of the experiment. In this example, we use two-color microarray, thus:

- 4.
Load the marker data and specify the following required arguments (number of environmental factors, number of levels per factor, the values of each level, and the number of available slides):

> data(genotype) #an example data attached with the designGG package

# The command below can be used to read TXT data

# genotype <- read.table("genotype.txt")

> nEnvFactors <- 2

> nLevels <- c(2, 2)

> Level <- list(c(16, 24), c(5, 10))

> nSlides <- 100; nTuple <- NULL

An alternative to specifying nSlides is to specify nTuple, the number of strains to be allocated onto each condition. For example,

- 5.
In addition to the required arguments specified in step 4, there are some optional ones for a tailored experimental design: e.g., we might be especially interested in the genome region between 1

^{st}marker and 20^{th}marker, where a known phenotypic QTL from previous study locates. They can then specify that the optimization algorithm should only take genotypes at markers 1 to 20 into account:

> region <- seq(1, 20, by = 1)

Additionally, if we want that the estimates of all interaction effects are twice as accurate as the estimates of the main effects (genotype, temperature and drug treatment), then we specify weights for the estimates:

> weight <- c(0.5,0.5,0.5,1,1,1,1)

- 6.
The following commands specify the directory where the resulting optimal design tables are to be stored and the name of the output files (design tables):

> directory <- "C:\myproject\design"

> fileName <- "myDesign"

The description and possible values of designGG arguments

Arguments | Description | Possible value(s) |
---|---|---|

bTwoColorArray
| The type of platform | T(RUE) or F(ALSE) for the dual- or single-channel option, respectively. For example, F for one-color and T for two-color gene expression microarrays (the dual-channel option is also used for any other technology profiling pairs of samples) |

genotype
| Genotype information | A matrix of marker genotypes for each marker and each strain. The values can be numeric: "1" and "0" for two homozygous genotypes, respectively (optionally, "0.5" for heterozygous allele). They can also be characters: "A" "B" or "H" and "H" is for heterozygous allele; NA for missing data. The column names are strain names, such as "Strain 1", "Strain 2", etc. The row names are marker names, such as "C1M1", "C2M2", etc. |

nEnvFactors
| Number of environmental factors in the study | A numeric integer value between 1 and 3 which indicates the number of environmental factors to be studied. Experiments with more than three environmental factor are not recommended here since the power to estimate the high-order interactions is very limited for a realistic number of samples (several hundreds). |

nLevels
| Number of levels for each environmental factor | A numeric integer vector. For example, there are two different levels for two environmental factors under study, then we use nLevels <- c(2, 2) |

Level
| Level values for each environmental factor | A list which specifies the levels for each factor in the experiment. The element is a vector describing all levels of the environmental factor. In the given example, temperature levels are 16 and 24 and drug treatment levels are 5 and 10. The we use: Level <- list(c(16, 24), c(5, 10)) |

nSlides
| Total number of slides available for the experiment. | A numeric integer value |

nTuple
| Average number of strains to be assigned onto each condition | A numeric value which is larger than 1 |

region
| Genome region of biological interest | A numeric integer vector which indicates the markers of biological interest, for example those previously detected for phenotypic quantitative trait loci. The value is the marker index (i.e., the row number in the genotype data table), |

weight
| The weights for estimating genetic and environmental factors, and their interaction terms | A numeric vector which indicates the parameters of biological interest. Higher weights correspond to higher interest, and the optimization is adjusted in such a way as to result in a higher accuracy of the estimate for the parameters with higher weight. Prior knowledge about expected effect sizes of interesting factors can also be incorporated as weight parameters for the algorithm. The weight is inversely proportional to the expected effect size of the corresponding parameter, if the same relative accuracy is intended. When there is no environmental perturbation, weights is 1, as there is only one parameter of interest (genotype); When nEnvFactor = 1, weight = c(w |

nIterations
| Number of iterations of the simulated annealing method | A numeric integer value larger than 1. Default = 3000 |

directory
| Output file directory | The path where output files will be saved. |

fileName
| Output file names | The name for output tables in CSV format to be produced. |

- 7.
Run designGG to obtain your optimal design:

> myOutput <- designGG(genotype, nSlides, nTuple, nEnvFactors, nLevels, Level, region = region, weight = weight, nIterations = 10)

- 8.
Output can be found in the directory or retrieved with:

> optimalArrayDesign <- myOutput$arrayDesign

> optimalCondDesign <- myOutput$conditionDesign

Example table of the allocation of strains to arrays.

Channel 1 | Channel 2 | |
---|---|---|

array 1 | Strain 28 | Strain 92 |

array 2 | Strain 70 | Strain 47 |

array 3 | Strain 22 | Strain 89 |

... | ... | ... |

Example table of the allocation of strains to experimental conditions.

Temperature | Drug | Selected Strains | |||||
---|---|---|---|---|---|---|---|

condition 1 | 16 | 5 | Strain 28 | Strain 81 | Strain 18 | Strain 61 | ... |

condition 2 | 24 | 5 | Strain 70 | Strain 40 | Strain 83 | Strain 92 | ... |

condition 3 | 24 | 10 | Strain 14 | Strain 3 | Strain 89 | Strain 22 | ... |

... | ... | ... | ... | ... | ... | ... | ... |

- 9.
In addition, users can check the curve of optimization score recorded as the algorithm iterates using:

> plotAllScores (myOutput$plot.obj)

Details of default settings such as method (SA: simulated annealing) or nSearch (equals 2) can be found in the designGG manual or the online help. Example genotype data and output tables are also provided along with the package. The R package can be found in Additional file 1 and most up-to-date version of the software can be downloaded at http://gbic.biol.rug.nl/designGG.

### Expected Results

Two tables summarize the optimal design: The table pair design is only used for two-channel experiments and describes how samples are paired together in one assay e.g., a two-color microarray chip (Table 3). The table environment design lists how samples are assigned to environments/experimental factors (Table 4).

## Conclusion

DesignGG, a freely-available R package and web tool presented in this work, represents a novel tool for the researcher interested in system genetics. Based on the careful experimental design provided by designGG, limited resources, such as arrays and samples, are maximally exploited, and more accurate estimates of parameters of interest can be achieved.

## Availability and requiredments

Project name: designGG R package and web tool

Project home page: http://gbic.biol.rug.nl/designGG

Programming language: R

Requirement: R statistical software available at http://www.r-project.org/ for the stand-alone version.

## Declarations

### Acknowledgements

This work was supported by the Netherlands Organization for Scientific Research, NWO-86504001. We thank Danny Arends for help in implementing the web tool.

## Authors’ Affiliations

## References

- Jansen RC, Nap JP: Genetical genomics: the added value from segregation.
*Trends Genet*2001, 17(7):388–391. 10.1016/S0168-9525(01)02310-1View ArticlePubMedGoogle Scholar - Bystrykh L, Weersing E, Dontje B, Sutton S, Pletcher MT, Wiltshire T, Su AI, Vellenga E, Wang J, Manly KF,
*et al*.: Uncovering regulatory pathways that affect hematopoietic stem cell function using 'genetical genomics'.*Nat Genet*2005, 37(3):225–232. 10.1038/ng1497View ArticlePubMedGoogle Scholar - Schadt EE, Lamb J, Yang X, Zhu J, Edwards S, Guhathakurta D, Sieberts SK, Monks S, Reitman M, Zhang C,
*et al*.: An integrative genomics approach to infer causal associations between gene expression and disease.*Nat Genet*2005, 37(7):710–717. 10.1038/ng1589PubMed CentralView ArticlePubMedGoogle Scholar - Chen Y, Zhu J, Lum PY, Yang X, Pinto S, MacNeil DJ, Zhang C, Lamb J, Edwards S, Sieberts SK,
*et al*.: Variations in DNA elucidate molecular networks that cause disease.*Nature*2008, 452(7186):429–435. 10.1038/nature06757PubMed CentralView ArticlePubMedGoogle Scholar - Brem RB, Kruglyak L: The landscape of genetic complexity across 5,700 gene expression traits in yeast.
*Proc Natl Acad Sci USA*2005, 102(5):1572–1577. 10.1073/pnas.0408709102PubMed CentralView ArticlePubMedGoogle Scholar - Li Y, Breitling R, Jansen RC: Generalizing genetical genomics: getting added value from environmental perturbation.
*Trends Genet*2008, 24(10):518–524. 10.1016/j.tig.2008.08.001View ArticlePubMedGoogle Scholar - Li Y, Alvarez OA, Gutteling EW, Tijsterman M, Fu J, Riksen JA, Hazendonk E, Prins P, Plasterk RH, Jansen RC,
*et al*.: Mapping determinants of gene expression plasticity by genetical genomics in C. elegans.*PLoS Genet*2006, 2(12):e222. 10.1371/journal.pgen.0020222PubMed CentralView ArticlePubMedGoogle Scholar - Churchill GA: Fundamentals of experimental design for cDNA microarrays.
*Nat Genet*2002, 32(Suppl):490–495. 10.1038/ng1031View ArticlePubMedGoogle Scholar - Fu J, Jansen RC: Optimal design and analysis of genetic studies on gene expression.
*Genetics*2006, 172(3):1993–1999. 10.1534/genetics.105.047001PubMed CentralView ArticlePubMedGoogle Scholar - Fisher RA:
*The design of experiments.*4th edition. Edinburgh: Oliver and Boyd; 1947.Google Scholar - Kerr MK, Churchill GA: Experimental design for gene expression microarrays.
*Biostatistics*2001, 2(2):183–201. 10.1093/biostatistics/2.2.183View ArticlePubMedGoogle Scholar - Yang YH, Speed T: Design issues for cDNA microarray experiments.
*Nat Rev Genet*2002, 3(8):579–588.PubMedGoogle Scholar - Fournier MV, Carvalho PC, Magee DD, Carvalho MGC, Appasani K: Experimental Design for Gene Expression Analysis. In
*Bioarrays From Basics to Diagnostics*. Humana Press; 2007:29.Google Scholar - Wit E, Nobile A, khanin R: Near-optimal designs for dual-channel microarray studies.
*Applied Statistics*2005, 54(5):817–830.Google Scholar - Lam AC, Fu J, Jansen RC, Haley CS, de Koning DJ: Optimal design of genetic studies of gene expression with two-color microarrays in outbred crosses.
*Genetics*2008, 180(3):1691–1698. 10.1534/genetics.108.090308PubMed CentralView ArticlePubMedGoogle Scholar - Rosa GJ, de Leon N, Rosa AJ: Review of microarray experimental design strategies for genetical genomics studies.
*Physiol Genomics*2006, 28(1):15–23. 10.1152/physiolgenomics.00106.2006View ArticlePubMedGoogle Scholar - Woo Y, Krueger W, Kaur A, Churchill G: Experimental design for three-color and four-color gene expression microarrays.
*Bioinformatics*2005, 21(Suppl 1):i459–467. 10.1093/bioinformatics/bti1031View ArticlePubMedGoogle Scholar - Wit E, Nobile A, Khanin R: Simulated annealing for near-optimal dual-channel microarray designs.
*Appl Statistics*2005, (54):817–830.Google Scholar - The R Project for Statistical Computing[http://www.r-project.org/]
- Swertz MA, De Brock EO, Van Hijum SA, De Jong A, Buist G, Baerends RJ, Kok J, Kuipers OP, Jansen RC: Molecular Genetics Information System (MOLGENIS): alternatives in developing local experimental genomics databases.
*Bioinformatics*2004, 20(13):2075–2083. 10.1093/bioinformatics/bth206View ArticlePubMedGoogle Scholar - Swertz MA, Jansen RC: Beyond standardization: dynamic software infrastructures for systems biology.
*Nat Rev Genet*2007, 8(3):235–243. 10.1038/nrg2048View ArticlePubMedGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.