- Methodology article
- Open Access
A genetic algorithm-Bayesian network approach for the analysis of metabolomics and spectroscopic data: application to the rapid identification of Bacillus spores and classification of Bacillus species
- Elon Correa^{1} and
- Royston Goodacre^{1, 2}Email author
https://doi.org/10.1186/1471-2105-12-33
© Correa and Goodacre; licensee BioMed Central Ltd. 2011
- Received: 10 June 2010
- Accepted: 26 January 2011
- Published: 26 January 2011
Abstract
Background
The rapid identification of Bacillus spores and bacterial identification are paramount because of their implications in food poisoning, pathogenesis and their use as potential biowarfare agents. Many automated analytical techniques such as Curie-point pyrolysis mass spectrometry (Py-MS) have been used to identify bacterial spores giving use to large amounts of analytical data. This high number of features makes interpretation of the data extremely difficult We analysed Py-MS data from 36 different strains of aerobic endospore-forming bacteria encompassing seven different species. These bacteria were grown axenically on nutrient agar and vegetative biomass and spores were analyzed by Curie-point Py-MS.
Results
We develop a novel genetic algorithm-Bayesian network algorithm that accurately identifies sand selects a small subset of key relevant mass spectra (biomarkers) to be further analysed. Once identified, this subset of relevant biomarkers was then used to identify Bacillus spores successfully and to identify Bacillus species via a Bayesian network model specifically built for this reduced set of features.
Conclusions
This final compact Bayesian network classification model is parsimonious, computationally fast to run and its graphical visualization allows easy interpretation of the probabilistic relationships among selected biomarkers. In addition, we compare the features selected by the genetic algorithm-Bayesian network approach with the features selected by partial least squares-discriminant analysis (PLS-DA). The classification accuracy results show that the set of features selected by the GA-BN is far superior to PLS-DA.
Keywords
- Genetic Algorithm
- Feature Selection
- Bayesian Network
- Predictive Accuracy
- Bacillus Species
Background
Bacillus and Clostridium species can adapt to rapidly changing environments and starvation by developing spores. An endospore is a dormant non-reproductive structure produced by these Gram-positive bacteria and is a survival mechanism adapted to spending a long period of time in hostile conditions. The sporulation process in Bacillus species causes singular molecular and cellular changes in the cell which are not seen in the vegetative state [1]. One of these changes is the biosynthesis of calcium dipicolinate, which is found in sporulated cells but not in the vegetative ones.
Members of the genus Bacillus are widely distributed in the environment and because their spores are so resistant their control is of considerable importance in the food manufacture [2]. Some of these bacteria are pathogenic including B. cereus and B. subtilis which cause food poisoning. The most notorious member of this genus is B. anthracis, which is the causal agent of anthrax, and the rapid identification of spores and bacterial identification are paramount because of its importance as a potential biological warfare agent [3] and in bioterrorism [4]. Thus there is a need to have a generic characterisation method that allows rapid identification of spores and typing of bacteria.
Many automated analytical techniques such as Raman spectroscopy [5], liquid and gas chromatography [6, 7] and Curie-point pyrolysis mass spectrometry (Py-MS) [8–10] have been used to identify bacterial spores. All of these methods rely on chemometric analyses of the data and the question arises as to how robust these mathematical models are. However, the vast majority of modelling approaches are considered "black boxes" as they do not readily allow the specific association between input analytical data and output classification to be revealed.
These types of data analysis involve a large number of features to be analysed, such as several mass spectra. This high number of features makes interpretation of the data extremely difficult Therefore, we start our data analysis by reducing data dimensionality. This data reduction step selects a small subset of key relevant masses to be further analysed and discards the less important ones. This feature selection procedure uses Bayesian network learning methods coupled with genetic algorithms to identify bacterial spores and classify Bacillus species.
A Bayesian network (BN) is basically a graphical model of a probability distribution over a set of variables of a given problem domain [11, 12]. This graphical model provides a compact and intuitive representation of the relationships among variables of a given problem domain. Nodes on the graph represent variables from the problem (e.g., m/z intensities) and an arrow linking two nodes indicates a statistical correlation between them. This statistical correlation falls broadly into one of the two categories: (a) "positive correlation" indicates that the values of both variables increase or decrease together, and (b) "negative correlation" indicates that as one variable increases, the other decreases, or vice versa. The network structure of a BN encodes probabilistic dependencies among domain variables and a joint probability distribution quantities the strength of these dependencies [13]. The resulting graphical model or network has two main uses. (1) Visualization of probabilistic relationships: the graphical model provides direct and accurate information about the underlying interactions among variables of interest, m/z intensities in our case, and (2) Inference: the Bayesian network is intrinsically an inference model and can be used to predict outputs or to classify new samples.
We use statistical and data mining algorithms to identify Bacillus spores automatically from their Curie-point pyrolysis mass spectrometry data. This process extends the data mining analysis to a two step hierarchical-based classification that further identifies the bacilli into one of their respective species. First, the data dimensionality is reduced by a feature selection process using genetic algorithms (GA) and BNs in parallel. Subsequently, once that the relevant variables are identified, a classification model using only BN is built based on the reduced data set, and this process undergoes full validation. Next a statistical analysis of the interactions among variables and classes and variables and variables is performed using the built Bayesian network model. As this combined process identifies probabilistic biomarkers in the data set it is possible to develop predictive, testable models that allow inference of biological properties of the bacilli. The computer code for the GA-BN algorithm developed on this work was written in R programming language [14] ver. 2.9.2 and is freely available, together with the Bacillus data set, on request to the corresponding author.
Methods
The Bacillus data set
The work uses the Bacillus Py-MS data set reported in [8] and described as an additional file (see Additional file 1). Unlike most data sets which concentrate on a single or only a handful of Bacillus species, this data set investigates 36 different strains of aerobic endospore-forming bacteria encompassing seven different species: Bacillus amyloliquefaciens, Bacillus cereus, Bacillus licheniformis, Bacillus megaterium, Bacillus subtilis (including Bacillus niger and Bacillus globigii), Bacillus sphaericus, and Brevibacillus laterosporus. These bacteria were grown axenically on nutrient agar as detailed in [8, 15] and vegetative biomass and spores were analyzed in triplicates by Curie-point Py-MS. The data set contains 216 Bacillus samples; 108 are vegetative and 108 are sporulated. For a more detailed explanation of this data set see [8]. A phylogenetic tree of the type strains of the Bacillus species studied in this paper can be found in [16].
Data analysis
Stage 1 employed a genetic algorithm for feature selection with classification of (a) either spores versus vegetative biomass or (b) speciation to one of the seven different species. The classifier used is the Bayesian network that best fits the best solution (with a reduced set of features) found by a genetic algorithm. In this supervised learning procedure, the measurement of the fitness of a GA solution in this study follows a wrapper approach. The wrapper approach searches for an optimal feature subset tailored to a particular algorithm, such as a Bayesian network. For more information on wrapper and other feature selection approaches see [17].
Stage 2 involved the fitting of a new Bayesian network model to the best GA solution found on the previous stage. The built BN model is then used to determine probabilistic relationships between the m/z intensities selected by the GA and the classification (sporulation status or speciation). This two step process and model validation are detailed below.
Genetic algorithms (GAs)
A GA is an optimization procedure that evolves a population of candidate solutions to solve an objective function [18]. A GA repeatedly applies operators based on natural selection and genetic recombination to the candidate solutions. In a standard GA the initial solutions are randomly generated using a uniform distribution. The candidate solutions are called chromosomes. The chromosomes are usually represented by fixed-length strings over a finite alphabet. The term fitness is used to describe the quality of a candidate solution. The fitness is a measurement of how well the chromosome solves the objective function. The fitness associated with a chromosome is used to select probabilistically which chromosomes from the population will recombine and possibly generate new solutions. A genetic operator called crossover is applied to create two new chromosomes (progeny) from a pair of selected chromosomes called parents. The crossover consists of swapping random subsets of the genetic material from both parents. Because of the selective pressure applied on the population through a number of generations, the overall trend is towards higher-fitness chromosomes. Mutations are used to help preserve diversity in the population by introducing random changes into the chromosomes. Both crossover and mutation are usually applied with user-defined probabilities, and in general, the probability of crossover is much larger than the probability of mutation. For more details on genetic algorithms see [19–21]. The design of our genetic algorithm is as follows. We employed a binary chromosome with 150 bits, one for each m/z variable. A gene value of 1 indicates that the corresponding m/z variable is selected and a value of 0 indicates that it is not selected. A population size of 200 candidate solutions was used, with a crossover and mutation probabilities of 0.75 and 0.033, respectively. During the test phase of the GA these parameters generated the best results; but we make no claim that they are optimal parameter values. Setting the parameters of a GA is not a trivial task and GA parameter optimization is a topic for future investigation. The objective function that we employed was to maximize classification accuracy. The fitness of a candidate solution was assessed as the classification accuracy, on a validation set, achieved by the BN model built for the candidate solution being assessed. As each candidate solution represents a different subset of features (m/z intensities), the BN model built for a particular solution is a classification model based solely on the features present on that solution, e.i., the features that correspond to the genes whose value is equal to 1 inside the chromosome, Figure 1. The stopping criteria used were: (1) maximum of 200 generations are performed on a single GA run, (2) a solution whose classification model (BN) produces 100% of predictive accuracy is found, or (3) when all the 200 solutions in the population converge to a single solution.
Bayesian networks (BNs)
A BN is a graphical map of the probabilistic relationships among variables of a given problem domain [22]. The graphical representation of a BN is a directed acyclic graph. A directed acyclic graph G is an ordered pair G = (V; E) where V is a set whose elements are called vertices or nodes and E is a set whose elements are called directed edges, arcs, or arrows. The graph G contains no directed cycles; for any vertex υ ∈ V , there is no directed path that starts and ends on υ. An example of a Bayesian network is as follows. This is a modified version of the so-called "Asia" problem found in [23]. Suppose that a doctor is treating a patient who has been suffering from shortness of breath, called dyspnoea. The doctor knows that diseases such as tuberculosis, bronchitis and lung cancer are possible causes of this. The doctor also knows that other relevant information includes whether the patient is a smoker, which increases the chances of lung cancer and bronchitis, and what sort of air pollution the patient has been exposed to. A positive X-ray would indicate either tuberculosis or lung cancer. The set of variables for this problem and their possible values are shown in an additional file (see Additional file 2) together with a Bayesian network representing this problem. The network structure, also known as network topology, shows how variables correlate to each other. More formally, let X = {X_{1}, X_{2},..., X_{ n } } be a multivariate random variable whose components X_{ i } are also random variables. A corresponding lower-case letter x_{ i } denotes an assignment of state or value to the random variable. X_{ i }Parents (X_{ i }) represents the set of nodes that have a directed edge pointing to X_{ i } .
Learning the structure of a BN is an NP-hard problem [24, 25]. Many algorithms developed to this end use a scoring metric and a search procedure. The scoring metric evaluates the "goodness-of-fit" of a structure to the data. The search procedure generates alternative structures and selects the best one based on the scoring metric. A greedy search algorithm is used to generate alternative structures for the BN. Greedy search algorithms make a locally optimal choice at each stage. Starting with an empty network, the greedy search algorithm adds to the current network the edge that most increases the score of the new resulting network. The search stops when no other edge addition improves the score of the network. Additional file 3 shows the pseudocode of a generic greedy search algorithm for learning Bayesian network structures. In this paper, we use an unconventional scoring metric to evaluate the goodness-of-fit" (score) of a network structure to the data. The scoring metric adopted is specific to our classification task and is computed as follows. The entire data set is divided into mutually exclusive training and test sets, see "Model validation" for more details. The training set is further divided into two mutually exclusive parts - training and validation sets. The first part (training set) is used to compute the probabilities for the Bayesian network. The second part is used as the validation set. During the search for the best possible network structure only the validation set is used to compute predictive accuracy and the measurement (quality) of the predictive accuracy achieved is used as the scoring metric for the Bayesian network model proposed. The higher the predictive accuracy value, the better the BN model fits the data. Once the best GA solution is found, at the end of the GA run, the validation set and the training set are merged and this merged data (i.e., the entire original training set) is used to compute the probabilities for a new BN fitting to this data. Using this newly built BN model the predicted accuracy, for that combination of folds, is then computed on the previously untouched test set. The results reported in this paper are the average predictive accuracy over 10 entirely distinct test folds.
To summarize, the Bayesian network is used both in parallel to the GA and sequentially after each complete GA run is performed as shown in Figure 1. First, the parallel GA-BN usage. For each new GA solution the following procedure is repeated. Solution S_{ k } is generated. A Bayesian network model B_{ k } is built based only on the features (m/z variables) that are selected in S_{ k } and using the training set to compute probabilities. The model B_{ k } is then used to predict the samples on the validation set and the predictive accuracy produced by B_{ k } becomes the fitness value of solution S_{ k } , i.e., fitness value of S_{ k } = predictive accuracy resulting from model B_{k}. At the end of the GA run, the solution with the highest fitness value S_{best} is retained. Second, the sequential BN usage after the complete GA-BN run. A new Bayesian network B_{best} is built based on S_{best} but this time using the combined data, training set + validation set, for computation of probabilities. The predictive accuracy of B_{best} is then evaluated on a third, previously untouched fold, the test set. This result is then added to the computation of the average accuracy over the 10-fold cross-validation. The process is repeated for each of the 10 folds.
Feature selection
Many data mining applications involve the task of building a model. The goal of such a model is to classify data records according to a set of common features. Feature selection, also known as variable or attribute selection, is the technique of selecting a subset of relevant variables for building robust and accurate learning models. In the present work, feature selection using GA is used to reduce data dimensionality before a classification model is built. The reduction of the number of variables speeds up model building and improves model stability and interpretability. In addition, we independently applied a partial least squares-discriminant analysis [26, 27] (PLS-DA) algorithm for feature selection. PLS-DA is a particular case of partial least squares regression where the dependent variable, or response, is a binary or a dummy variable. We use the PLS-DA implementation form the R package "Classification and Regression Training" (Caret) ver. 4.31 written by Max Kuhn [28]. The importance of every variable for the prediction model is measured by their variable importance for projection (VIP) coefficient. Variables with large VIP, larger than 1, are the most relevant ones for the model and contribute more for class discrimination.
Model validation
For an accurate measurement of model generalization, ideally, model validation would involve the prediction of classes on a completely new and independently generated data set addressing the same questions under investigation. In practice, however, those two complete and independently generated sets of data are rarely available and the researcher has to balance the trade-off between model overfitting and generalization using the unique set of data available. To deal with this problem our model validation uses a standard data mining procedure called cross-validation [17, 29]. First, the complete data set is divided into 10 equally sized folds. The folds are randomly generated but under the following criteria: (1) the proportion of classes in every single fold has to be similar to the proportion of classes found in the original data set containing all records (this is known as stratified cross-validation, and importantly (2) replicates are kept together and not split into different folds. Each of the 10 folds is used once as a test set. Out of the 9 remaining folds, 8 folds are used as training set and 1 fold is reserved to be a validation set. The Bayesian network uses the training set (8 folds) to compute the probabilities required to classify new examples. Once those probabilities are computed, the BN classifies the examples in the validation set. When the run of the GA algorithm is completed, the training set (8 folds) and the validation set (1 fold) are merged into a full, bigger training set. This full merged training set is used to re-compute the probabilities for a new BN fitted to the best solution (subset of features) returned by the GA. The new Bayesian network is then used to classify examples in the test set (the 10th fold), which was never accessed before during the run of the genetic algorithm. The reasons for having separate validation and test sets are that in a classification model the goal is to measure predictive accuracy (generalization ability) on a test set unseen during training. Hence, the test set cannot be used by the GA, and is reserved just to compute the predictive accuracy associated with the Bayesian network built with the best set of variables selected at the end of the GA run.
Results and Discussion
Discriminating between different physiological states
Vegetative and sporulated classes: confusion matrices and summary statistics, w. avg. = weighted average.
Confusion Matrices | |||||
---|---|---|---|---|---|
predicted class | |||||
all 150 m / z intensities | 17 GA selected m / z intensities | ||||
veg | spo | veg | spo | ||
actual class | veg spo | 108 1 | 0 107 | 108 1 | 0 107 |
Statistics | |||||
class | TP | FP | precision | Sensitivity | |
veg spo | 1 0.995 | 0.009 0 | 0.991 1 | 1 0.991 | |
w. avg. | 0.995 | 0.005 | 0.995 | 0.995 |
The PC scores plot in Figure 2(a) shows a clear separation between the vegetative $(\overline{\text{v}})$ and sporulated $(\overline{s})$ bacilli in the first PC which accounts for 46% of the total explained variance. The m/z intensities that appear to the right of the vertical dotted line that divides the graph have a strong correlation with the sporulated physiological state and the intensities to the left of that line are strongly correlated to the vegetative state. The proximity of $\overline{\text{v}1}$ and $\overline{\text{v6}}$ on the graph indicates that in their vegetative state B. amyloliquefaciens and B. subtilis are very closely related and this reflects the known taxonomy of these two species [16]; these are also closely related to the taxonomically similar B. licheniformis$(\overline{\text{v}3})$. This is also seen in the spores of these bacteria. This suggests that despite choosing m/z that can discriminate between spores and vegetative cells some information on the different species is still present. This is also true for B. cereus$(\overline{\text{v2}})$ and B. megaterium$(\overline{\text{v4}})$ that also co-cluster and are taxonomically similar [16]. To examine the interactions among the m/z intensities further we have developed a powerful probabilistic model based on Bayesian networks. Contrary to intuition, the direction of the arrows in a Bayesian network does not necessarily imply a cause-effect relationship between the variables; that is to say a Bayesian network is not a "causal network". Thus to eliminate possible confusion we have intentionally omitted the arrow heads from our BN graphs. Figure 2(b) shows the BN describing the association of the 17 selected m/z intensities, and as detailed above this was fully validated using 10-fold cross-validation. Solid lines indicate a positive correlation between nodes, dashed lines indicate negative correlation and the thickness of the line indicates the strength of the correlation. Therefore the thicker the line is the stronger the correlation. The number beside the line shows the partial correlation coefficient for that correlation. A partial correlation estimates the correlation between two nodes when the effect of all other nodes in the model is held constant, and this process avoids finding variables (m/z ) that are not directly correlated to each other [31].
The network Figure 2(b) shows the correlation among the m/z intensities. The strongest correlation on the network is a positive correlation between m/z 105 and m/z 77. m/z 105 is a pyridine ketonium ion known to arise from DPA [8] and Beverly et al., Havey et al. and Opitz have suggested that m/z 77 results from the electron ionization fragmentation pathway via loss of CO from m/z 105 [32–34]. As these m/z are highly correlated in the BN and appear closer to the sporulated classes on Figure 2(a), the results indicate that for sporulated bacilli the m/z 105 and m/z 77 intensities are noticeably higher than for the vegetative case.
where h = 3.523 m/z 63 + 4.193 m/z 77 - 1.007 m/z 84 - 0.347 m/z 105 - 0.961, and MZ = (m/z 63, m/z 77, m/z 84 ; m/z 105). This equation successfully classifies 100% of the cases from the Bacillus data set correctly. Thus we have understood some of the relationships between the variables, confirmed that DPA and its product ions in Electron Impact Mass Spectrometry (EI-MS) are excellent biomarkers for spores and have a very parsimonious model where only 4 of the original 150 ions are used to describe the solution adequately.
Discriminating between species
For this analysis the species are considered as classes (n = 7). In order to ascertain whether there was any difference in classifications based on physiology, we performed these experiments using three different partitions of the mass spectral data. The first partition uses all the 216 bacilli collectively, vegetative + sporulated. The second partition uses only vegetative cells and the third one uses only sporulated cells. Experiments on the second and third partitions expect that one has already differentiated between the two physiology states (as illustrated above) and would work like a hierarchical classification were the physiological state of the cases is known and only the species have to be predicted.
The diagram, Figure 3, shows that for the data set containing the 216 bacilli, labelled BOTH, 22 m/z intensities have been selected as relevant to discriminate between the different Bacillus species, whereas for the data set containing only vegetative cells and the data set containing only sporulated cells, 25 and 39 variables were selected respectively It is also clear that some ions (m/z 57, 67, 74, 89, 104 and 136) were used by all classifiers irrespective of data partitioning.
Species as classes: all bacilli
Species: classification results for all bacilli (including vegetative and sporulated cases).
Confusion Matrices Species - all bacilli | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
predicted class | |||||||||||||||
all 150 m / z intensities | 22 GA selected m / z intensities | ||||||||||||||
sph | sub | lic | lat | cer | amy | meg | sph | sub | lic | lat | cer | amy | meg | ||
actual class | sph sub lic lat cer amy meg | 29 3 1 0 0 1 1 | 1 24 1 0 0 3 0 | 0 0 21 0 0 0 3 | 0 1 0 23 1 0 0 | 0 0 0 1 14 0 0 | 0 14 7 0 0 26 0 | 0 0 0 0 15 0 26 | 30 3 1 1 3 0 6 | 0 32 0 0 0 3 0 | 0 0 22 0 0 1 0 | 0 0 1 23 0 0 0 | 0 0 0 0 25 0 0 | 0 7 6 0 0 26 0 | 0 0 0 0 2 0 24 |
Statistics | |||||||||||||||
class | TP | FP | precision | sensitivity | TP | FP | precision | sensitivity | |||||||
all 150 m/z intensities | 22 GA selected m/z intensities | ||||||||||||||
sph | 0.967 | 0.032 | 0.829 | 0.967 | 1 | 0.075 | 0.682 | 1 | |||||||
sub | 0.571 | 0.029 | 0.828 | 0.571 | 0.762 | 0.017 | 0.914 | 0.762 | |||||||
lic | 0.7 | 0.016 | 0.875 | 0.7 | 0.733 | 0.005 | 0.957 | 0.733 | |||||||
lat | 0.958 | 0.01 | 0.92 | 0.958 | 0.958 | 0.005 | 0.958 | 0.958 | |||||||
cer | 0.467 | 0.005 | 0.933 | 0.467 | 0.833 | 0 | 1 | 0.833 | |||||||
amy | 0.867 | 0.113 | 0.553 | 0.867 | 0.867 | 0.07 | 0.667 | 0.867 | |||||||
meg | 0.867 | 0.081 | 0.634 | 0.867 | 0.8 | 0.011 | 0.923 | 0.8 | |||||||
w. avg. | 0.755 | 0.041 | 0.794 | 0.755 | 0.843 | 0.026 | 0.871 | 0.843 |
The Bayesian network model built on the 22 GA selected variables is shown in Figure 4(b). Interpretation of these relationships is difficult given the molecular nature of the ions in Py-MS (molecular ions are very rarely seen, rather complex pyrolysate and fragments thereof are detected but remain unidentified).
Despite this limitation of the data, rather than the BN, we see two separate sub-networks for species classifying when both spores and vegetative cells are included in the BN analysis. These relationships are not directly related to the differences between spores and vegetative cells, nor are these probabilistic relationships among variables wholly mirrored in PC scores (Figure 4(a)), and we see a mixture of selected ions from the different areas of PCA. For example, whilst m/z 89, 136, 65 are highly positively correlated in both the BN and PCA the BN extends this network via a negative correlation to m/z 108 and m/z 57 which are located diagonally opposite in the PC loadings plot, but not m/z 70 which is not used in the BN at all. In addition, despite m/z 52 and 53 close relationship in PCA these are found to be separated in the BN. Thus this suggests that additional information could be generated from the BN when compared to PC loadings plots, and this will be an area of future work using ions of known origin.
Species as classes: vegetative cells only
Species: classification results for vegetative bacilli only.
Confusion Matrices Species - vegetative bacilli only | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
predicted class | |||||||||||||||
all 150 m / z intensities | 25 GA selected m / z intensities | ||||||||||||||
sph | sub | lic | lat | cer | amy | meg | sph | sub | lic | lat | cer | amy | meg | ||
actual class | sph sub lic lat cer amy meg | 15 0 0 0 0 0 3 | 0 19 3 0 0 4 0 | 0 1 12 0 0 0 0 | 0 0 0 12 0 0 0 | 0 0 0 0 15 0 0 | 0 1 0 0 0 11 0 | 0 0 0 0 0 0 12 | 15 0 0 0 0 0 0 | 0 19 3 0 0 4 0 | 0 0 12 0 0 0 0 | 0 0 0 12 0 0 0 | 0 0 0 0 15 0 0 | 0 2 0 0 0 11 0 | 0 0 0 0 0 0 15 |
Statistics | |||||||||||||||
class | TP | FP | precision | sensitivity | TP | FP | precision | sensitivity | |||||||
all 150 m/z intensities | 25 GA selected m/z intensitie | s | |||||||||||||
sph | 1 | 0.032 | 0.833 | 1 | 1 | 0 | 1 | 1 | |||||||
sub | 0.905 | 0.08 | 0.731 | 0.905 | 0.905 | 0.08 | 0.731 | 0.905 | |||||||
lic | 0.8 | 0.011 | 0.923 | 0.8 | 0.8 | 0 | 1 | 0.8 | |||||||
lat | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 1 | |||||||
cer | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 1 | |||||||
amy | 0.733 | 0.011 | 0.917 | 0.733 | 0.733 | 0.022 | 0.846 | 0.733 | |||||||
meg | 0.8 | 0 | 1 | 0.8 | 1 | 0 | 1 | 1 | |||||||
w. avg. | 0.889 | 0.023 | 0.902 | 0.889 | 0.917 | 0.019 | 0.926 | 0.917 |
The Bayesian network model built on the 25 GA selected variables is shown in Figure 5(b).
Species as classes: spores only
Species: classification results for sporulated bacilli only.
Confusion Matrices Species - sporulated bacilli only | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
predicted class | |||||||||||||||
all 150 m / z intensities | 39 GA selected m / z intensities | ||||||||||||||
sph | sub | lic | lat | cer | amy | meg | sph | sub | lic | lat | cer | amy | meg | ||
actual class | sph sub lic lat cer amy meg | 14 0 0 0 1 0 0 | 0 21 0 0 0 1 0 | 0 0 14 0 0 0 0 | 0 0 0 11 0 0 1 | 1 0 0 1 14 0 0 | 0 0 1 0 0 14 0 | 0 0 0 0 0 0 14 | 15 0 0 1 0 0 0 | 0 21 0 0 0 0 0 | 0 0 14 0 0 0 0 | 0 0 0 11 0 0 0 | 0 0 0 0 15 0 0 | 0 0 1 0 0 15 0 | 0 0 0 0 0 0 15 |
Statistics | |||||||||||||||
class | TP | FP | precision | sensitivity | TP | FP | precision | sensitivity | |||||||
all 150 m/z intensities | 39 GA selected m/z intensities | ||||||||||||||
sph | 0.933 | 0.011 | 0.933 | 0.933 | 1 | 0.011 | 0.938 | 1 | |||||||
sub | 1 | 0.011 | 0.955 | 1 | 1 | 0 | 1 | 1 | |||||||
lic | 0.933 | 0 | 1 | 0.933 | 0.933 | 0 | 1 | 0.933 | |||||||
lat | 0.917 | 0.01 | 0.917 | 0.917 | 0.917 | 0 | 1 | 0.917 | |||||||
cer | 0.933 | 0.022 | 0.875 | 0.933 | 1 | 0 | 1 | 1 | |||||||
amy | 0.933 | 0.011 | 0.933 | 0.933 | 1 | 0.011 | 0.938 | 1 | |||||||
meg | 0.933 | 0 | 1 | 0.933 | 1 | 0 | 1 | 1 | |||||||
w. avg. | 0.944 | 0.009 | 0.946 | 0.944 | 0.981 | 0.003 | 0.983 | 0.981 |
GA-Bayesian network vs. PLS-DA
Classification results: comparison GA-Bayesian network vs. PLS-DA.
True positive rate | # of variables selected | ||||
---|---|---|---|---|---|
Class type | GA | PLS-DA | GA | PLS-DA | Overlap |
physiological state | 99.5% | 97.2% | 17 | 15 | 73.2% |
species both | 84.3% | 73.6% | 22 | 47 | 12.7% |
species veg. only | 91.7% | 78.7% | 25 | 66 | 1.0% |
species spo. only | 98.1% | 75.9% | 39 | 11 | 45.4% |
Conclusions
In this study Py-MS data from a diverse group of Bacillus species were analysed using a novel approach of combining variable selection from GA with the probabilistic relationship inference from BN. This chemometrics-fusion approach was first used for the successful classification of spores versus vegetative biomass and subsequently the same data were used to identify the Bacillus species that was under analysis. The results of the physiological classification confirm that m/z 105 which is a pyridine ketonium ion known to arise from DPA [8] plays a significant part in discriminating the spores from vegetative bacilli. Moreover, m/z 77 was also selected which is known to be a fragment ion that results from pyridine ketonium [32]. A very parsimonious rule was constructed that only used four ions and had a 100% classification rate on the validation data. Taken together this shows that the GA-BN was able to discover novel biomarkers for spores and that these were validated by the know physiological differences that occur during sporulation [1]. Variable selection is an important aspect of any multivariate data analysis as it seeks to simplify a data set by reducing its dimensionality and identifying relevant underlying variables without sacrificing predictive accuracy. As a result for species classification the GA-BN significantly reduced the redundancy in the information provided by the variables actually used for prediction from 150 m/z to between 22-39 depending on the subset of the data analysed. As no single classifier works best on all given classification problems (see [42]), the present work designed a specific classification model for each partition of the data set analyzed. The results show that using significantly less m/z intensities, the classifiers obtained, on average, a better performance than the classifiers using all 150 m/z intensities available.
Taking the true positive (TP) rate as an example for analysing both spores and vegetative cells together the prediction from using 150 m/z to just 22 increased from 0.755 to 0.843. When only vegetative cells were analysed the TP rate was 0.889 for all 150 m/z and 0.917 for when the 22 GA selected variables were employed. By contrast, the TP rate increased from 0.944 to an impressive 0.981 when spores were analysed by Py-MS using either all 150 m/z or 39 selected ions respectively. This result indicates that not only are individual classifiers better than combining both spores and vegetative biomass, but that Bacillus speciation is better when spores are analysed. This is in contrast to what is expected from classical physiology studies and indicates that a lot more than just the production of DPA and specific proteins is occurring. This has implication for rapid analysis as one may be able to speciate the bacilli directly without the need for cultivation. Notwithstanding our results show that a hierarchical-like, or informed, classification of the bacilli into classes has shown a higher predictive accuracy than the classification without previous knowledge of physiological state.
The GA-BN algorithm has also outperformed a traditional classification method used in chemometrics, namely PLS-DA, in all cases tested. Although GA-BN did not always select the smallest subset of features, the classification accuracy indicated that it always selected the most relevant ones when compared to PLS-DA.
Bayesian networks explore two main characteristics of the target data set: associations among variables and the strength of these associations. The graphical model output from the GA-BN explicitly informs one about probabilistic associations. A conditional probability table stores the strength of the correlations given the associations displayed on the graphical model. Expert knowledge and statistical information can easily be introduced in BNs, as demonstrated in this study. BNs model the probability distribution of the problem domain and, therefore, can compute the predictive distribution on the outcomes of possible outputs.
In conclusion, we have developed a novel genetic algorithm-Bayesian network and demonstrated its implementation on a well described data set comprising pyrolysis mass spectra from a wide variety of different Bacillus species analysed both as vegetative cells and spores. The physiological assessment of these data reconfirmed that dipicolinic acid is a valuable biomarker for spore identification; whilst our hierarchical-informed classification structure showed excellent identification of the different species in the sporulated state, a finding that to our knowledge has not been shown before for Py-MS data.
Declarations
Acknowledgements
EC and RG would like to thank the "Systems Biology of Microorganisms" (SysMO) project and in particular BBSRC for financial support.
Authors’ Affiliations
References
- Atrih A, Foster SJ: The role of peptidoglycan structure and structural dynamics during endospore dormancy and germination. Antonie van Leeuwenhoek 1999, 75(4):299–307. 10.1023/A:1001800507443View ArticlePubMedGoogle Scholar
- Doyle MP, Beuchat LR, Montville TJ, (Eds): Food Microbiology: Fundamentals and Frontiers. Washington DC: Amercian Society of Microbiology; 1997.Google Scholar
- Barnaby W: Plague Makers: The Secret World of Biolgoical Warfare. Vision; 1999.Google Scholar
- Inglesby TV, Henderson DA, Bartlett JG, Ascher MS, Eitzen E, Friedlander AM, Hauer J, McDade J, Osterholm MT, O'Toole T, Parker G, Perl TM, Russell PK, Tonat K: Anthrax as a Biological Weapon - medical and Public Health Management. JAMA - Journal of the American Medical Association 1999, 281(18):1735–1745. 10.1001/jama.281.18.1735View ArticlePubMedGoogle Scholar
- Ghiamati E, Manoharan R, Nelson WH, Sperry JF: UV Resonance Raman Spectra of Bacillus Spores. Applied Spectroscopy 1992, 46(2):357–364. 10.1366/0003702924125609View ArticleGoogle Scholar
- Tabor MW, MacGee J, Holland JW: Rapid determination of dipicolinic acid in the spores of Clostridium species by gas-liquid chromatography. Applied and Environmental Microbiology 1976, 31: 25–28.PubMed CentralPubMedGoogle Scholar
- Warth AD: Liquid Chromatographic Determination of Dipicolinic Acid from Bacterial Spores. Applied and Environmental Microbiology 1979, 38(6):1029–1033.PubMed CentralPubMedGoogle Scholar
- Goodacre R, Shann B, Gilbert RJ, Timmins EM, McGovern AC, Alsberg BK, Kell DB, Logan NA: Detection of the Dipicolinic Acid Biomarker in Bacillus Spores Using Curie-Point Pyrolysis Mass Spectrometry and Fourier Transform Infrared Spectroscopy. Analytical Chemistry 2000, 72: 119–127. 10.1021/ac990661iView ArticlePubMedGoogle Scholar
- DeLuca SJ, Sarver EW, Voorhees KJ: Direct analysis of bacterial glycerides by Curie-point pyrolysis-mass spectrometry. Journal of Analytical and Applied Pyrolysis 1992, 23: 1–14. 10.1016/0165-2370(92)80008-AView ArticleGoogle Scholar
- Snyder AP, Dworzanski JP, Tripathi A, Maswadeh WM, Wick CH: Correlation of mass spectrometry identified bacterial biomarkers from a fielded pyrolysis-gas chromatography-Ion mobility spectrometry biodetector with the microbiological gram stain classification scheme. Analytical Chemistry 2004, 76(21):6492–6499. 10.1021/ac040099iView ArticlePubMedGoogle Scholar
- Jensen FV: Bayesian networks and decision graphs. Springer; 2001.View ArticleGoogle Scholar
- Neapolitan RE: Learning Bayesian networks. Prentice Hall; 2003.Google Scholar
- Heckerman D: A tutorial on learning with Bayesian networks. Tech rep, Microsoft Research 1995.Google Scholar
- The R Project for Statistical Computing: R programming language.[http://www.r-project.org/]
- Shute LA, Gutteridge CS, Norris JR, Berkeley RCW: Curie-point Pyrolysis Mass Spectrometry Applied to Characterization and Identification of Selected Bacillus Species . Journal of General Microbiology 1984, 130: 343–355.PubMedGoogle Scholar
- Lopez-Diez EC, Goodacre R: Characterization of Microorganisms Using UV Resonance Raman Spectroscopy and Chemometrics. Analytical Chemistry 2004, 76(3):585–591. 10.1021/ac035110dView ArticlePubMedGoogle Scholar
- Witten IH, Frank E: Data mining: practical machine learning tools and techniques. second edition. The Morgan Kaufmann Series in Data Management Systems, Morgan Kaufmann; 2005.Google Scholar
- Holland JH: Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. The MIT Press; 1992.Google Scholar
- Goldberg DE: Genetic algorithms in search, optimization and machine learning. Addison-Wesley; 1989.Google Scholar
- Mitchell M: An introduction to genetic algorithms. MIT Press; 1998.Google Scholar
- Goldberg DE: The design of innovation: lessons from and for competent genetic algorithms. Kluwer Academic; 2002.View ArticleGoogle Scholar
- Pearl J: Probabilistic reasoning in intelligent systems: networks of plausible inference. In The Morgan Kaufmann series in representation and reasoning. San Mateo, CA, USA: Morgan Kaufmann; 1988.Google Scholar
- Lauritzen SL, Spiegelhalter DJ: Local computations with probabilities on graphical structures and their application to expert systems. Journal of the Royal Statistics Society 1988, 50: 157–224.Google Scholar
- Bouckaert RR: Properties of Bayesian belief network learning algorithms. In Conference on Uncertainty in Artificial Intelligence UAI 1994. Seattle, WA, USA: Morgan Kaufmann; 1994:102–109.Google Scholar
- Chickering DM, Geiger D, Heckerman D: Learning Bayesian networks is NP-hard. Tech rep, Microsoft Research 1994.Google Scholar
- Barker M, Rayens W: Partial least squares for discriminantion. Journal of Chemometrics 2003, 17: 166–173. 10.1002/cem.785View ArticleGoogle Scholar
- Karp NA, Griffin JL, Lilley KS: Application of partial least squares discriminant analysis to two-dimensional difference gel studies in expression proteomics. Proteomics 2005, 5: 81–90. 10.1002/pmic.200400881View ArticlePubMedGoogle Scholar
- Kuhn M: Classification and Regression Training (Caret). R programming language package [http://cran.r-project.org/web/packages/caret/index.html]
- Zeng X, Martinez TR: Distribution-balanced stratified cross-validation for accuracy estimation. Journal of Experimental and Theoretical Artificial Intelligence 2000, 12: 1–12. 10.1080/095281300146272View ArticleGoogle Scholar
- Seasholtz M, Kowalski B: The parsimony principle applied to multivariate calibration. Analytica Chimica Acta 1993, 277(2):165–177. 10.1016/0003-2670(93)80430-SView ArticleGoogle Scholar
- Hair JF, Black B, Babin B, Anderson RE, Tatham RL: Multivariate Data Analysis. 6th edition. Pearson Education; 2007.Google Scholar
- Beverly MB, Basile F, Voorhees KJ, Hadfield TL: A Rapid Approach for the Detection of Dipicolinic Acid in Bacterial Spores Using Pyrolysis/Mass Spectrometry. Rapid Communications in Mass Spectrometry 1998, 10(4):455–458. 10.1002/(SICI)1097-0231(19960315)10:4<455::AID-RCM500>3.0.CO;2-YView ArticleGoogle Scholar
- Havey CD, Basile F, Mowryb C, Voorhees KJ: Evaluation of a micro-fabricated pyrolyzer for the detection of Bacillus anthracis spores. Journal of Analytical and Applied Pyrolysis 2004, 72: 55–61. 10.1016/j.jaap.2004.02.002View ArticleGoogle Scholar
- Opitz J: Electron-impact ionization of benzoic acid, nicotinic acid and their n-butyl esters: An approach to regioselective proton affinities derived from ionization and appearance energy data. International Journal of Mass Spectrometry 2007, 265: 1–14. 10.1016/j.ijms.2007.04.014View ArticleGoogle Scholar
- Breiman L, Friedman J, Stone CJ, Olshen R: Classification and Regression Trees. 1st edition. Chapman & Hall; 1984.Google Scholar
- SPSS computer program used for statistical analysis Website http://www.spss.com/ Website
- Shute LA, Gutteridge CS, Norris JR, Berkeley RCW: Reproducibility of pyrolysis mass spectrometry: effect of growth medium and instrument stability on the differentiation of selected Bacillus species. Journal of Applied Microbiology 1988, 64: 79–88. 10.1111/j.1365-2672.1988.tb02431.xGoogle Scholar
- Sproch N, Begin KJ, Moms RJ: The Modern Student Laboratory: Chromatography: An LC/Particle Beam/MS Experiment for Undergraduates. Journal of Chemical Education 1996, 73(2):A33iA39. 10.1021/ed073pA33View ArticleGoogle Scholar
- Huang Ss, Chen D, Pelczar PL, Vepachedu VR, Setlow P, Li Yq: Levels of Ca^{2+}dipicolinic acid in individual bacillus spores determined using microfluidic Raman tweezers. The Journal of Bacteriology 2007, 189(13):4681–4687. 10.1128/JB.00282-07View ArticlePubMedGoogle Scholar
- Zhang P, Kong L, Setlow P, Li Yq: Characterization of wet heat inactivation of single spores of Bacillus species by dual-trap Raman spectroscopy and elastic light scattering. Applied and Environmental Microbiology 2010, 76(6):1796–1805. 10.1128/AEM.02851-09PubMed CentralView ArticlePubMedGoogle Scholar
- Pendukar SH, Kulkarni PR: Chemical composition of bacillus spores. Food/Nahrung 1988, 32(10):1003–1004. 10.1002/food.19880321025View ArticlePubMedGoogle Scholar
- Wolpert DH, Macready WG: No Free Lunch Theorems for Optimization. IEEE Transactions on Evolutionary Computation 1997, 1: 67–82. 10.1109/4235.585893View ArticleGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.