- Research article
- Open Access
Robust detection and verification of linear relationships to generate metabolic networks using estimates of technical errors
© Kose et al; licensee BioMed Central Ltd. 2007
- Received: 25 July 2006
- Accepted: 21 May 2007
- Published: 21 May 2007
The size and magnitude of the metabolome, the ratio between individual metabolites and the response of metabolic networks is controlled by multiple cellular factors. A tight control over metabolite ratios will be reflected by a linear relationship of pairs of metabolite due to the flexibility of metabolic pathways. Hence, unbiased detection and validation of linear metabolic variance can be interpreted in terms of biological control. For robust analyses, criteria for rejecting or accepting linearities need to be developed despite technical measurement errors. The entirety of all pair wise linear metabolic relationships then yields insights into the network of cellular regulation.
The Bayesian law was applied for detecting linearities that are validated by explaining the residues by the degree of technical measurement errors. Test statistics were developed and the algorithm was tested on simulated data using 3–150 samples and 0–100% technical error. Under the null hypothesis of the existence of a linear relationship, type I errors remained below 5% for data sets consisting of more than four samples, whereas the type II error rate quickly raised with increasing technical errors. Conversely, a filter was developed to balance the error rates in the opposite direction. A minimum of 20 biological replicates is recommended if technical errors remain below 20% relative standard deviation and if thresholds for false error rates are acceptable at less than 5%. The algorithm was proven to be robust against outliers, unlike Pearson's correlations.
The algorithm facilitates finding linear relationships in complex datasets, which is radically different from estimating linearity parameters from given linear relationships. Without filter, it provides high sensitivity and fair specificity. If the filter is activated, high specificity but only fair sensitivity is yielded. Total error rates are more favorable with deactivated filters, and hence, metabolomic networks should be generated without the filter. In addition, Bayesian likelihoods facilitate the detection of multiple linear dependencies between two variables. This property of the algorithm enables its use as a discovery tool and to generate novel hypotheses of the existence of otherwise hidden biological factors.
- Metabolic Network
- Technical Error
- Metabolomic Data
- False Positive Detection
- Linear Hypothesis
concentrations alter and hence increase variance due to intentionally changing the experimental conditions, for example by altering environmental parameters like external nutrients or by using different genotypes ,
metabolite data will found to vary in a stochastic manner caused by the imprecision of the analytical method  used for acquiring metabolite data and
interestingly, even under very controlled environmental conditions, a high degree of biological variation is found for metabolite levels due to stochastic biological events that trickle through the biochemical network and thus reflect the underlying control structure at this particular biological condition .
Therefore, if enough biological replicates are analyzed for a given organism at a given physiological situation, the metabolic phenotype can be investigated not only by its corresponding average metabolic values, but also by a snapshot of its corresponding metabolic network. However, biologists often do not know the inherent biological variability in advance and hence tend to use just a few independent biological replicates based on preliminary power analysis. Resulting data may be sufficient to estimate arithmetic means of metabolic levels but do not enable analyzing the linear control structure between different biological conditions. One of the challenges for calculating linearity networks is to compute the likelihood or significance of the presence of a truly linear relationship, with the aim of excluding both false negative and false positive detections of linearities.
For which pairs of variables can a linear relationship be hypothesized?
Are there sub sets of data that reflect differences in linear behavior of variables? For example, linearity may be given for only a group of data but absent in another group, or the linearity parameters between these groups may be different.
Linear relationships must be detected in an unbiased and observer-independent manner.
Sub sets of data need to be grouped according to presence of (multiple) linear relationships.
Criteria have to be applied that verify linear hypotheses based on test statistics.
Technical errors: varying degree of analytical-chemical measurement errors and missing data have to be accounted for.
Especially, the potential presence of multiple linear relationships and independence of both variables poses problems for simple regression analyses. As a substitute for regression, the degree of correlation has been used for detecting linear relationships despite the fact that correlation only relates the covariance to the total variance, but does not verify genuine linearities. Moreover, Pearsons' correlation coefficients lack robustness against outliers, especially for multivariate datasets, and a number of different approaches have been suggested to link estimates to better test statistics . In practice, however, empirical or heuristic thresholds are taken to distinguish strong or weak correlations, but no mathematical basis exists on which such thresholds can safely be founded. In some cases, Student's statistics p-values have been taken in an effort to validate Pearson's correlations . Unfortunately, such p-values only describe the significance of the non-randomness of data pairs but do not test hypotheses if data pairs can be described by a (single or multiple) linear functions. Consequently, correlation networks based on Pearsons correlations may be strongly distorted .
A further approach has been taken using partial correlations that deconvolute contributions by additional parameters in order to reduce the list of correlations to basic dependencies  which may present a link from correlation to causality [22, 23]. This method is valuable to investigate the control structure within a given correlation network but it does not remove the principle robustness problem of correlation estimates. Simple correlations coefficients always decline with increasing variance that is introduced by method errors during data acquisition. In contrary, partial correlation coefficients may be increasing, decreasing or even change the algebraic signs with increasing method errors . In order to remedy this situation, scientists tend to select high Pearson's correlation thresholds  which imply that the variance caused by method errors is small in relation to the biological variance. The latter assumption is often true when comparing widely different metabolic phenotypes such as certain mutant genotypes, or severe stress conditions such as acute (metabolic) diseases in comparison to healthy states. However, metabolic theory predicts that even incremental changes in enzymatic properties can have large effects on metabolic control, especially when multiple enzymes are affected . Such changes might be too subtle to cause large differences in average concentrations but would still effect the pathway control structure and hence, linearities in pairs of metabolite data. Consequently, the metabolic control structure can only be assessed with a robust tool for linearity detection.
We here present a different approach. Using the Bayesian law , a likelihood formula is derived that is based on information about the measurement error using a specific technical method. This formula is then transformed in way that allows searching for local maxima of linear parameters within the total hypothesis space. Such likelihood maxima are subsequently assessed for residuals of the corresponding linearity parameters using simulated test statistics. We demonstrate the power of this approach using a synthetic data set with a given set of true linear relationships which are subsequently subjected to both increasing technical errors and increasing number of samples.
(1) A model for the technical error in metabolomic data
(2) Maximum Likelihood (ML) function for a general linear problem
In what follows we collect the coefficients of the above equation in a vector α = (α1,..., α n ) t and express the linear relationship as α t x•j= β. By x•jwe denote the metabolic profile of the j th sample. The entirety of the parameters α and β results in A. The probability p (A) is the a priori probability of the parameters α and β before the measurement has been performed. Because no preference can be given, the a priori probability is constant for all A. The same is true for p (B) with B representing the measured metabolite concentrations. Therefore, p (A | B) is the likelihood for parameter A if the pair of variables B is given. We have used an unbiased approach here assuming random and unrelated technical errors, and we cannot know beforehand if a certain metabolite will be detectable or not, and how large the concentration of such metabolite could be. These assumptions result in a constant probability for p(A) and p(B), because otherwise certain values for A and B would be more likely than others. From the Bayesian law it can be concluded
p (A | B) = c · p (B | A).
The constant value c can be neglected because the objective is to compare different linear hypotheses. Consequently, a hypothetical metabolic profile has the same probability at a given linear hypothesis as a hypothetical linear hypothesis at a given metabolic profile. The expression p (B|A) is therefore the probability that the measured metabolic profile B is determined at a given set of parameters A, which can be calculated using the function which describes the probability distribution of the technical error. We are now in position to state the following general theorem:
Let x = (x1, ..., x n ) t include the measurements of n metabolites in a biological sample with technical errors that follow a Gaussian distribution with covariance matrix Σ. Let a (n-N)-dimensional surface in the n-dimensional metabolite space be defined by the equations
αk 1x1 + ... + α kn x n = β k for k = 1, ..., N.
The coefficients of these equations comprise a matrix α = (α ki ) and a vector β = (β 1 , ..., β N ) t . The matrix elements can also be arranged in vectors α k :(αk 1, ..., α kn ) t . It is assumed the hyperplanes defined by (8) are orthogonal in pairs with respect to the covariance matrix, i.e.
α k t Σ α l = 0 for k, l = 1, ..., N and k ≠ l.
Maximizing p (A|B) or L (A|B) gives the maximum likelihood. The resulting estimator for the considered linear relationship is called the simple ML-estimator. The likelihood takes values between 0 and 1. Likelihoods are different to probabilities  with respect to p (B|A) which is maximized in order to find the most likely parameters for a given hypothesis, here: a linear hypothesis.
(3) An adapted Maximum Likelihood estimator for robust verification of linear hypotheses
Additional File 2 gives the impact of the magnitude of the constant c on the total likelihood. It is demonstrated in an empirical way that the total likelihood is not decreased by any c ≥ 1. In what follows we fix the constant at the value c = 1 und consider an adapted ML-estimator that is constructed by maximization of L1(A | B).
Additional considerations are outlined for the case of missing data (NANs, not-a-number) which are often found in metabolomic data sets. In such cases, the probability function p (B|A) needs to be adapted. This function then represents the information about the missing value: for example, data could get lost due to measurement instrument malfunctions or the variable (i.e. a metabolite level) might be below the limit of detection in a given biological situation. In both cases, the probability density function is uniform, i.e. the probability is constant in a certain range. For the case of 'below detection limit', the probability density is limited, for the case of 'instrument malfunction' the probability density is zero at all levels. However, for both cases, the undefined integral is one (we must assume a false negative metabolite detection). If we knew the true cause of the missing value (i.e. either false negative or true negative), the correct probability density function could be modeled. For now, however, we need to assume an infinite technical error which demands to add the maximal likelihood of ln2 to these data points. Accordingly, missing data do not have a diminishing impact on L. An extreme case of data set that exclusively comprises missing data would result in a maximal likelihood for arbitrary linear hypotheses. This interpretation is correct because all hypotheses would be equally probable and could not be denied, which, however, results to an interpretive power of zero. Consequently, for real cases a maximal number of missing values needs to be defined in order to deny any linear hypothesis that might be due to missing explanatory power. The upper limit of the number of such missing data has to be set by the user who may call in further biological or analytical background information for individual metabolite pairs.
The adapted ML-estimator considers technical errors.
The adapted ML-estimator detects linear patterns and groups sub sets of data accordingly.
The adapted ML-estimator is robust against outliers.
The adapted ML-estimator relies on background information on missing values and therefore does not distort interpretations.
Therefore, the adapted ML-estimator realizes a solution to several of the challenges of unbiased and robust detection of multiple linear hypotheses in complex data sets.
(4) Algorithm for the detection of linear relationships
(5) Determination of false positive and false negative error rates
We here assume that linear relationships between two metabolites are only confused by technical errors, but not by other biological factors, so the degree of noise here is only induced by technical errors. In order to test the algorithm described above, a data set was simulated that closely describes the problem. This model data set comprised 200 variables which were grouped into 20 clusters of equal size. All variables within a cluster were described by a linear relationship y = ax + b, but between clusters, no linearity was modeled apart from random relationships. For each test, a different number of samples was taken to assume experimental data from metabolomic snapshots, with further and various levels of technical errors that were added to the modeled measurements. Technical errors were assumed to follow a Gaussian distribution. In total, the total data set was investigated for 19,900 pair-wise relationships of which 900 were modeled to be described by linear relationships in order to assess false positive and false negative error rates. The parameters were varied in an exhaustive permutation of the sample size from 3–150 samples and relative technical errors from 0.1–100%. Error rates were determined four times for each combination of ,number of samples' and ,technical errors', and the average of these four determinations was taken. Technical errors may be divided into the absolute error and a relative error. The absolute error, for example, is constituted by the resolution of an analytical instrument or constant background through chemical impurities of reagents and solvents. Such errors can be carefully controlled in validated chemical procedures and are usually less important than relative errors. In most cases in metabolomics, the total technical error is dominated by relative errors that relate to the true value, originating for example by sample storage, extraction and sample preparation procedures, and by cross-contamination and carry over between samples. Technical errors can be estimated by reproducing all sample preparation steps multiple times from small aliquots of a larger homogenized pool, and subsequent data acquisition. The magnitude of relative errors varies by the vulnerability of the compounds to be altered during the sample preparation and measurement process. However, for the sake of clarity, identical technical errors were used in the simulations for each pair of metabolites.
Use of the technical error concomitant with a maximum likelihood assessment of linearity parameters and verification by simulated test statistics enables a robust detection and verification of liner relationships in complex data sets. An implementation of this algorithm will enable biologists to calculate and compare linearity networks in metabolomic or other multivariate data sets, from which biological hypotheses may be derived. The algorithm can be modified with respect to the ratio of type I and type II errors depending on the biological focus of a study. It is highly advised to use more than 20 biological replicates for each condition that is to be tested in a biological experimental design of genotypes x environments (G x E), unless advances in analytical chemistry and instrumentation decrease the overall technical error to very low levels, i.e. below 5%. Even the existence of more than one linear relationship per pair of variables can be detected using the maximum likelihood algorithm, which has so far been hard to compute with classical approaches.
The work was funded by the NIEHS through the R01 project ES13932 granted to OF and by a fellowship granted to FK by the Max-Planck Society, Germany. Helpful comments by Joachim Selbig are appreciated.
- Morgenthal K, Weckwerth W, Steuer R: Metabolomic networks in plants: Transitions from pattern recognition to biological interpretation. Biosystems. 2006, 83 (2–3): 108-117. 10.1016/j.biosystems.2005.05.017.View ArticlePubMedGoogle Scholar
- Ratcliffe RG, Shachar-Hill Y: Measuring multiple fluxes through plant metabolic networks. Plant Journal. 2006, 45 (4): 490-511. 10.1111/j.1365-313X.2005.02649.x.View ArticlePubMedGoogle Scholar
- Kose F, Weckwerth W, Linke T, Fiehn O: Visualizing plant metabolomic correlation networks using clique-metabolite matrices. Bioinformatics. 2001, 17 (12): 1198-1208. 10.1093/bioinformatics/17.12.1198.View ArticlePubMedGoogle Scholar
- Fiehn O: Metabolic networks of Cucurbita maxima phloem. Phytochemistry. 2003, 62 (6): 875-886. 10.1016/S0031-9422(02)00715-X.View ArticlePubMedGoogle Scholar
- Weckwerth W, Loureiro ME, Wenzel K, Fiehn O: Differential metabolic networks unravel the effects of silent plant phenotypes. Proceedings of the National Academy of Sciences of the United States of America. 2004, 101 (20): 7809-7814. 10.1073/pnas.0303415101.PubMed CentralView ArticlePubMedGoogle Scholar
- Steuer R, Kurths J, Fiehn O, Weckwerth W: Observing and interpreting correlations in metabolomic networks. Bioinformatics. 2003, 19 (8): 1019-1026. 10.1093/bioinformatics/btg120.View ArticlePubMedGoogle Scholar
- Camacho D, de la Fuente A, Mendes P: The origin of correlations in metabolomics data. Metabolomics. 2005, 1: 53-63. 10.1007/s11306-005-1107-3.View ArticleGoogle Scholar
- Lin H, Bennett GN, San KY: Chemostat culture characterization of Escherichia coli mutant strains metabolically engineered for aerobic succinate production: A study of the modified metabolic network based on metabolite profile, enzyme activity, and gene expression profile. Metabolic Engineering. 2005, 7 (5–6): 337-352. 10.1016/j.ymben.2005.06.002.View ArticlePubMedGoogle Scholar
- Grubbs FE: Errors of Measurement, Precision, Accuracy and Statistical Comparison of Measuring-Instruments. Technometrics. 1973, 15 (1): 53-66. 10.2307/1266824.View ArticleGoogle Scholar
- Tocher JF: Pigmentation survey of school children in Scotland. Biometrika. 1908, 6: A1-A67. 10.2307/2331470.View ArticleGoogle Scholar
- Horton NJ, Laird NM: Maximum likelihood analysis of generalized linear models with missing covariates. Statistical Methods in Medical Research. 1999, 8 (1): 37-50. 10.1191/096228099673120862.View ArticlePubMedGoogle Scholar
- Lindsey KJ: Applying generalized linear models. 1997, New York: Springer, 1Google Scholar
- Davis PL: Aspects of robust linear regression. Annals of Statistics. 1993, 21 (4): 1843-1899.View ArticleGoogle Scholar
- Andrews DF: Robust method for multiple linear-regression. Technometrics. 1974, 16 (4): 523-531. 10.2307/1267603.View ArticleGoogle Scholar
- Wald A: The fitting of straight lines if both variables are subject to error. Annals of Mathematical Statistics. 1940, 11: 284-300.View ArticleGoogle Scholar
- Berkson J: Are There 2 Regressions. Journal of the American Statistical Association. 1950, 45 (250): 164-180. 10.2307/2280676.View ArticleGoogle Scholar
- Scheffe H: Fitting Straight-Lines When One Variable Is Controlled. Journal of the American Statistical Association. 1958, 53 (281): 106-117. 10.2307/2282571.Google Scholar
- Cressie N, Read TRC: Pearsons-X2 and the Loglikelihood Ratio Statistic-G2 – a Comparative Review. International Statistical Review. 1989, 57 (1): 19-43.View ArticleGoogle Scholar
- Urbanczyk-Wochniak E, Luedemann A, Kopka J, Selbig J, Roessner-Tunali U, Willmitzer L, Fernie AR: Parallel analysis of transcript and metabolic profiles: a new approach in systems biology. Embo Reports. 2003, 4 (10): 989-993. 10.1038/sj.embor.embor944.PubMed CentralView ArticlePubMedGoogle Scholar
- Chen YP, Popovich PM: Correlation: Parametric and nonparametric measures. 2002, Sage Publications, 1Google Scholar
- de la Fuente A, Bing N, Hoeschele I, Mendes P: Discovery of meaningful associations in genomic data using partial correlation coefficients. Bioinformatics. 2004, 20 (18): 3565-3574. 10.1093/bioinformatics/bth445.View ArticlePubMedGoogle Scholar
- Perl J: Causality: Models, reasoning and inference. 2000, New York: Cambridge University Press, 1Google Scholar
- Wright S: Correlation and causation Part I. Method of path coefficients. Journal of Agricultural Research. 1920, 20: 0557-0585.Google Scholar
- Morgenthal K, Wienkoop S, Scholz M, Selbig J, Weckwerth W: Correlative GC-TOF-MS-based metabolite profiling and LC-MS-based protein profiling reveal time-related systemic regulation of metabolite-protein networks and improve pattern recognition for multiple biomarker selection. Metabolomics. 2005, 1: 109-121. 10.1007/s11306-005-4430-9.View ArticleGoogle Scholar
- Thomas S, Fell DA: The role of multiple enzyme activation in metabolic flux control. Advances in Enzyme Regulation. 1998, 38: 65-85. 10.1016/S0065-2571(97)00012-5.View ArticlePubMedGoogle Scholar
- Bayes T: An Essay Towards Solving a Problem in the Doctrine of Chances. Biometrika. 1958, 45 (3-4): 296-315. 10.1093/biomet/45.3-4.296.View ArticleGoogle Scholar
- Lee PM: Bayesian statistics: An introduction. 1989, New York: Oxford University PressGoogle Scholar
- Box GEP, Tiao GC: Bayesian inference in statistical analysis. 1973, Reading, MA: Addison-Wesley Publishing CompanyGoogle Scholar
- Fisher RA: On the 'probable error' of a coefficient of correlation deduced from a small sample. Metron. 1921, 1: 1-32.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.