- Open Access
AWclust: point-and-click software for non-parametric population structure analysis
© Gao and Starmer; licensee BioMed Central Ltd. 2008
Received: 14 August 2007
Accepted: 31 January 2008
Published: 31 January 2008
Population structure analysis is important to genetic association studies and evolutionary investigations. Parametric approaches, e.g. STRUCTURE and L-POP, usually assume Hardy-Weinberg equilibrium (HWE) and linkage equilibrium among loci in sample population individuals. However, the assumptions may not hold and allele frequency estimation may not be accurate in some data sets. The improved version of STRUCTURE (version 2.1) can incorporate linkage information among loci but is still sensitive to high background linkage disequilibrium. Nowadays, large-scale single nucleotide polymorphisms (SNPs) are becoming popular in genetic studies. Therefore, it is imperative to have software that makes full use of these genetic data to generate inference even when model assumptions do not hold or allele frequency estimation suffers from high variation.
We have developed point-and-click software for non-parametric population structure analysis distributed as an R package. The software takes advantage of the large number of SNPs available to categorize individuals into ethnically similar clusters and it does not require assumptions about population models. Nor does it estimate allele frequencies. Moreover, this software can also infer the optimal number of populations.
Our software tool employs non-parametric approaches to assign individuals to clusters using SNPs. It provides efficient computation and an intuitive way for researchers to explore ethnic relationships among individuals. It can be complementary to parametric approaches in population structure analysis.
Population structure analysis is important to genetic association studies [1–4] and evolutionary investigations [5–9]. Many statistical methods have been proposed to infer population structure and to assign individuals to ethnically similar clusters using multilocus genotype data, among which there are two major categories: parametric and non-parametric approaches.
Parametric approaches usually need to estimate population parameters such as allele frequencies and genotype frequencies and calculate likelihood, assuming Hardy-Weinberg equilibrium (HWE) and linkage equilibrium (LE) among loci for each population [10, 11]. Two representative programs for parametric approaches are: STRUCTURE, a Bayesian method which uses a Markov chain Monte Carlo (MCMC) algorithm based on the Gibbs sampler algorithm , and L-POP, a frequentist method which uses the Expectation-Maximization (EM) algorithm . In the extended version of STRUCTURE (version 2.1), the program can account for loose linkage between loci, but not high background linkage disequilibrium (LD) [12, 13]. High background LD increases the chance of spurious clusters . There are many other parametric Bayesian methods [14–20] and frequentist methods [21, 22], which require similar or more complicated model assumptions. Two major challenges for the parametric approaches are the accuracy of allele frequencies estimates with small sample sizes, and the model assumptions that may not hold for some data sets. Moreover, assumptions of LE or loosely linked loci put a restriction on the number of genome-wide SNP loci that can be used.
In contrast to parametric approaches, non-parametric approaches do not rely on model assumptions about the properties of the sub-populations, nor do they require allele frequency estimates. In situations where parametric model assumptions can not be verified, or there is only a limited number of individuals from a single sub-population, non-parametric methods are more powerful for inference. However, when the model assumptions do hold and allele frequencies can be accurately estimated, then parametric methods provide more information. Thus, the two approaches are complementary in that one method is stronger where the other is weaker.
As stated by Liu and Zhao , non-parametric methods use a two-stage design. They start by calculating pair-wise distances [6, 7, 9], or some other form of dimension reduction, e.g. singular value decomposition (SVD) , and then rely on statistical clustering methods, e.g. neighbor joining (NJ) [6, 7], K-means method , principal coordinates analysis (PCoA) [9, 24] or multidimensional scaling (MDS) [25, 26], to separate individuals. Recently, Gao and Starmer proposed a non-parametric method for population structure analysis and showed its advantages when genome-wide SNPs are available . Liu and Zhao also proposed a non-parametric approach , but it requires missing genotypes be imputed explicitly and the software is not widely available. In recent publications, researchers tend to use both parametric and non-parametric approaches in their reports [24, 25, 28].
Since its publication in 2000, the freely available program STRUCTURE has become quite popular and dominated population structure analysis, while the non-parametric methods have not received much attention. However, with the vast amount of genotype data available, non-parametric approaches may be preferred because of their robustness to model assumptions and fast calculation. Recently, it was shown in an empirical study that non-parametric methods can give accurate results in fine-scale population structure detection and even separated Chinese and Japanese individuals using genome-wide random SNPs . The separation of Chinese and Japanese individuals was also observed by Purcell et al. using MDS .
R is a convenient fast growing statistical computing environment with considerable popularity in the research community. It is freely available on a wide range of platforms, comes with implementations of many standard statistical methods, and can be easily extended through packages. We borrowed the strength of R and developed an add-on package that specifically focused on non-parametric population structure analysis. The motivation behind the package is to make recent developments in non-parametric population structure analysis available to researchers with an easy to use and intuitive graphical interface.
We have developed point-and-click software for non-parametric population structure exploration. The program was written in R and Tk and can be installed as an R package. The package is named AWclust (A llele sharing distance and W ard's minimum variance hierarchical clustering). The major modules enclosed are: allele sharing distance (ASD) calculation, MDS 2D plot, MDS 3D plot, hierarchical plot by Ward's minimum variance algorithm, gap statistic calculation for inferring the optimal number of clusters and saving the clustered results.
We automated the non-parametric population structure analysis procedures and packed all the routine steps in an intuitive graphical interface. The software can save researchers' time in data exploration. The outputs from AWclust are ready for publication and further analysis. It is distributed as R installation packages available for all popular operating systems: MS Windows, Mac OS X and Linux/Unix. The software comes with two example data sets, is fully documented, and includes a tutorial to help users become familiar with how to use it.
After loading a SNP data set, the next step is to calculate the allele sharing distance (ASD) matrix. Once this is done the user can perform non-parametric exploration with the SNP data set. The user can generate multidimensional scaling (MDS) 2D/3D plots to get a general idea of how the data clusters and to detect any outliers in the dataset. MDS is a statistical technique for allowing differences and similarities to be visualized. The differences are represented by distances between points on a graph. Elements in the ASD matrix that are close together will tend to cluster together.
If the MDS plot does not reveal any outliers in the dataset, then it makes sense to create a hierarchical plot of the data. For large datasets, the screen size and resolution may cause the IDs for the individuals to become difficult to read, however, this problem can be solved by saving and viewing the PDF output separately. The hierarchical plot can help users identify clusters and general relationships among individuals. The cluster tree can be cut at any level of similarity according to researchers' need and be saved to a text file.
One of the important features of AWclust is that it will calculate the gap statistic, a method for estimating the number of clusters in a data set . It compares the pooled within-cluster sum of squares with its expectation from a null reference distribution. The precision of this method requires multiple simulations from the null reference distribution and thus, can be computationally intensive. For example, a dataset with 209 individuals, each with 1000 SNPs and running 60 simulations (K = 1 to 6) takes slightly longer than two minutes to run on an Intel Core2, 2.4 GHz CPU with 2 GB of RAM. The data points are then plotted for a range of cluster sizes and the optimal size maximizes the distance between the observed and expected pooled within-cluster sum of squares. Information from MDS and hierarchical plots may also help interpret of the gap statistic plots.
When using AWclust on datasets other than the provided samples, it is important to note that the more closely related the subpopulations are, the larger the number of genome-wide random SNP loci needed for good separation. Fortunately, AWclust can quickly process large datasets. For the number of SNP loci required for major human populations, users can refer the empirical studies by Gao and Starmer .
Genome-wide SNPs can be easily obtained using Affymetrix or Illumina chips and thus, making full use of the vast amount of genetic markers available is an open issue for parametric approaches since the LE assumption does not hold when SNPs are densely genotyped. Without complicated LD modeling, there is a bottleneck for the amount of data that can be used by parametric approaches. Moreover, the allele frequency estimation in parametric approaches suffers from high variation if the number of individuals for a sub-population is extremely small, e.g. less than ten, and this leads to questionable results.
Besides STRUCTURE, there are several other parametric software packages that are compared by Wu et al. , such as PARTITION , BAPS 2 , GENELAND  and PSMIX . However, all parametric approaches suffer similar limitations because they all require verification of their model assumptions. When they are not justified, and for densely genotyped SNPs or when there is only a limited number of individuals from a single sub-population this is likely to be the case, non-parametric approaches provide better results.
Recently researchers have began to use both parametric and non-parametric approaches to aid population structure analysis [24, 25, 28]. However, non-parametric approaches have been limited to the utilization of NJ, K-means method, PCoA or MDS, all of which can not give the optimal number of clusters objectively. Furthermore, to our knowledge, we are not aware of an easy to use software package for non-parametric population structure analysis. Therefore, it is imperative to promote a non-parametric software package that automates routine steps and can take advantage of the vast amount of SNP markers available while inferring the optimal K objectively.
A limitation for the AWclust software is that it does not estimate the proportion of genome that belongs to each sub-population, which would necessarily require allele frequency estimation and many other assumptions about HWE and LD, while AWclust assigns each individual to one and only one cluster. Furthermore, AWclust only handles SNPs, currently the most popular genetic marker. Also, we did not aim to cover as many features in population genetics analysis as possible, like Arlequin does  since we did not want to replicate functions available in other software. There is also algorithm/software targeting on admixture mapping, i.e. ADMIXMAP [14, 16, 17] and ANCESTRYMAP , which requires more complicated model assumptions and is out of the scope of non-parametric methods. AWclust performs classification rather than test statistic adjustment as genomic control [32–34] and EigenStrat  do. However, investigators can conduct further analysis conditional on the cluster information provided by AWclust.
A general challenge in population structure analysis is to infer the optimal number of populations, K, and this is no different for the AWclust software. Before using the gap statistic to infer the optimal K, we suggest to plot the data using MDS first in addition to the hierarchical plot. In our experience, hierarchical plots give general information about the clusters embedded in the data, while MDS is suitable for outlier detection in exploration of individual relationships. To give an extreme situation, if there is just one individual for a particular sub-population, it is unlikely this individual can form a stand-alone cluster among all of the hierarchical clusters. Therefore, it is better to take outlier individuals out before applying the hierarchical plot and the gap statistic. The optimal K can also be explained in combination with other prior information about populations in the data sets and experience of the field.
In summary, we have developed new software, AWclust, for non-parametric population structure exploration. The software does not require HWE and LE for sample individuals. Nor does it need to estimate allele frequency. Most importantly, it can identify the optimal number of populations objectively. AWclust provides a user friendly GUI interface and does not require any prior programming skill from users. This non-parametric software is complementary to the parametric population structure programs because it is useful when HWE and LE can not be assumed to hold and when the accuracy of allele frequency estimation is questionable.
Availability and requirements
Project name: AWclust
Project home page: http://awclust.sourceforge.net/
Online users' manual: http://awclust.sourceforge.net/docs/index.html
Operating system(s): Platform independent
Programming language: R, Tk
Other requirements: R 2.5 or higher (with Tk Widgets)
Any restrictions to use by non-academics: none
This work was supported in part by NIH grants NS39764 and NIEHS T32 ES007126. We are grateful for Drs. Eden Martin, Robert Tibshirani, Amy Kapp and Alan Dabney's help, which made the software possible.
- Lander ES, Schork NJ: Genetic dissection of complex traits. Science 1994, 265: 2037–2048. 10.1126/science.8091226View ArticlePubMedGoogle Scholar
- Risch NJ: Searching for genetic determinants in the new millennium. Nature 2000, 405: 847–856. 10.1038/35015718View ArticlePubMedGoogle Scholar
- Marchini J, Cardon L, Phillips M, Donnelly P: The effects of human population structure on large genetic association studies. Nat Genet 2004, 36(5):512–517. 10.1038/ng1337View ArticlePubMedGoogle Scholar
- Freedman M, Reich D, Penney K, McDonald G, Mignault A, Patterson N, Gabriel S, Topol E, Smoller J, Pato C, Pato M, Petryshen T, Kolonel L, Lander E, Sklar P, Henderson B, Hirschhorn J, Altshuler D: Assessing the impact of population stratification on genetic association studies. Nat Genet 2004, 36: 388–393. 10.1038/ng1333View ArticlePubMedGoogle Scholar
- Cavalli-Sforza LL, Menozzi P, Piazza A: The history and geography of human genes. Princeton University Press. Princeton, NJ; 1994.Google Scholar
- Bowcock A, Ruiz-Linares A, Tomfohrde J, Minch E, Kidd J, Cavalli-Sforza L: High resolution of human evolutionary trees with polymorphic microsatellites. Nature 1994, 368: 455–457. 10.1038/368455a0View ArticlePubMedGoogle Scholar
- Mountain J, Cavalli-Sforza L: Multilocus genotypes, a tree of individuals, and human evolutionary history. Am J Hum Genet 1997, 61: 705–718. 10.1086/515510PubMed CentralView ArticlePubMedGoogle Scholar
- Rosenberg N, Pritchard J, Weber J, Cann H, Kidd K, Zhivotovsky L, Feldman M: Genetic structure of human populations. Science 2002, 298: 2381–2385. 10.1126/science.1078311View ArticlePubMedGoogle Scholar
- Shriver M, Kennedy G, Parra E, Lawson H, Sonpar V, Huang J, Akey J, Jones K: The genomic distribution of population substructure in four populations using 8,525 autosomal SNPs. Hum Genomics 2004, 1: 274–286.PubMed CentralView ArticlePubMedGoogle Scholar
- Pritchard JK, Stephens M, Donelly P: Inference of population structure using multilocus genotype data. Am J Hum Genet 2000, 67: 945–959. 10.1086/302959View ArticleGoogle Scholar
- Purcell S, Sham P: Properties of structured association approaches to detecting population stratification. Hum Hered 2004, 58: 93–107. 10.1159/000083030View ArticlePubMedGoogle Scholar
- Falush D, Stephens M, Pritchard J: Inference of population structure using multilocus genotype data: Linked loci and correlated allele frequencies. Genetics 2003, 164: 1567–1587.PubMed CentralPubMedGoogle Scholar
- Kaeuffer R, Réale D, Coltman DW, Pontier D: Detecting population structure using STRUCTURE software: effect of background linkage disequilibrium. Heredity 2007, 99: 374–380. 10.1038/sj.hdy.6801010View ArticlePubMedGoogle Scholar
- McKeigue PM, Carperter JR, Parra EJ, Shriver MD: Estimation of admixture and detection of linkage in admixed populations by a Bayesian approach: application to African-American populations. Ann Hum Genet 2000, 64: 171–186. 10.1046/j.1469-1809.2000.6420171.xView ArticlePubMedGoogle Scholar
- Dawson KJ, Belkhir K: A Bayesian approach to the identication of panmictic populations and the assignment of individuals. Genet Res 2001, 78: 59–77. 10.1017/S001667230100502XView ArticlePubMedGoogle Scholar
- Hoggart CJ, Parra EJ, Shriver MD, Bonilla C, Kittles RA, Clayton DG, McKeigue PM: Control of confounding of genetic associations in stratified populatinos. Am J Hum Genet 2003, 72: 1492–1504. 10.1086/375613PubMed CentralView ArticlePubMedGoogle Scholar
- Hoggart CJ, Shriver MD, Kittles RA, Clayton DG, McKeigue PM: Design and analysis of admixture mapping studies. Am J Hum Genet 2004, 74: 965–78. 10.1086/420855PubMed CentralView ArticlePubMedGoogle Scholar
- Corander J, Waldmann P, Sillanpaa MJ: Bayesian analysis of genetic differentiation between populations. Genetics 2003, 163: 367–374.PubMed CentralPubMedGoogle Scholar
- Corander J, Waldmann P, Marttinen P, Sillanpaa MJ: BAPS 2: enhanced possibilities for the analysis of genetic population structure. Bioinformatics 2004, 20: 2363–2369. 10.1093/bioinformatics/bth250View ArticlePubMedGoogle Scholar
- Guillot G, Mortier F, Estoup A: Geneland: A program for landscape genetics. Molecular Ecology Notes 2005, 5: 712–715. 10.1111/j.1471-8286.2005.01031.xView ArticleGoogle Scholar
- Tang H, Peng J, Wang P, Rish N: Estimation of individual admixture: analytical and study design considerations. Genet Epi 2005, 28: 289–301. 10.1002/gepi.20064View ArticleGoogle Scholar
- Wu B, Liu N, Zhao H: PSMIX: an R package for population structure inference via maximum likelihood method. BMC Bioinformatics 2006, 7: 317. 10.1186/1471-2105-7-317PubMed CentralView ArticlePubMedGoogle Scholar
- Liu N, Zhao H: A non-parametric approach to population structure inference using multilocus genotypes. Human Genomics 2006, 2: 353–364.PubMed CentralView ArticlePubMedGoogle Scholar
- Bauchet M, McEvoy B, Pearson LN, Quillen EE, Sarkisian T, Hovhannesyan K, Deka R, Bradley DG, Shriver MD: Measuring European Population Stratification with Microarray Genotype Data. Am J Hum Genet 2007, 80: 948–956. 10.1086/513477PubMed CentralView ArticlePubMedGoogle Scholar
- Lao O, van Duijn K, Kersbergen P, de Knijff P, Kayser M: Proportioning whole-genome single-nucleotide-polymorphism diversity for the identification of geographic population structure and genetic ancestry. Am J Hum Genet 2006, 78: 680–690. 10.1086/501531PubMed CentralView ArticlePubMedGoogle Scholar
- Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MA, Bender D, Maller J, Sklar P, de Bakker PI, Daly MJ, Sham PC: PLINK: A Tool Set for Whole-Genome Association and Population-Based Linkage Analyses. Am J Hum Genet 2007, 81: 559–575. 10.1086/519795PubMed CentralView ArticlePubMedGoogle Scholar
- Gao X, Starmer J: Human population structure detection via multilocus genotype clustering. BMC Genet 2007, 8(1):34. 10.1186/1471-2156-8-34PubMed CentralView ArticlePubMedGoogle Scholar
- Guthery SL, Salisbury BA, Pungliya MS, Stephens JC, Bamshad M: The Structure of Common Genetic Variation in United States Populations. Am J Hum Genet 2007, 81: 1221–1231. 10.1086/522239PubMed CentralView ArticlePubMedGoogle Scholar
- Tibshirani R, Walther G, Hastie T: Estimating the number of clusters in a data set via the gap statistic. J R Statist Soc B 2001, 63: 411–423. 10.1111/1467-9868.00293View ArticleGoogle Scholar
- Excoffer L, Laval G, Schneider S: Arlequin ver. 3.0: An integrated software package for population genetics data analysis. Evolutionary Bioinformatics Online 2005, 1: 47–50.Google Scholar
- Patterson N, Hattangadi N, Lane B, Lohmueller KE, Hafler DA, Oksenberg JR, Hauser SL, Smith MW, O'Brien SJ, Altshuler D, Daly MJ, Reich D: Methods for high-density admixture mapping of disease genes. Am J Hum Genet 2004, 74: 979–1000. 10.1086/420871PubMed CentralView ArticlePubMedGoogle Scholar
- Devlin B, Roeder K: Genomic control for association studies. Biometrics 1999, 55: 997–1004. 10.1111/j.0006-341X.1999.00997.xView ArticlePubMedGoogle Scholar
- Devlin B, Roeder K, Wasserman L: Genomic control, a new approach to genetic-based association studies. Theoretical Population Biology 2001, 60: 155–166. 10.1006/tpbi.2001.1542View ArticlePubMedGoogle Scholar
- Devlin B, Roeder K, Bacanu S: Unbiased methods for population-based association studies. Genet Epi 2001, 21: 273–284. 10.1002/gepi.1034View ArticleGoogle Scholar
- Price AL, Patterson NJ, Plenge RM, Weinblatt ME, Shadick NA, Reich D: Principal components analysis corrects for stratification in genome-wide association studies. Nat Genet 2006, 38: 904–9. 10.1038/ng1847View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.