Volume 10 Supplement 12

## Bioinformatics Methods for Biomedical Complex System Applications

# Conditional independence relations among biological markers may improve clinical decision as in the case of triple negative breast cancers

- Federico M Stefanini
^{1}Email author, - Danila Coradini
^{2}Email author and - Elia Biganzoli
^{3}Email author

**10(Suppl 12)**:S13

https://doi.org/10.1186/1471-2105-10-S12-S13

© Stefanini et al; licensee BioMed Central Ltd. 2009

**Published: **15 October 2009

## Abstract

The associations existing among different biomarkers are important in clinical settings because they contribute to the characterisation of specific pathways related to the natural history of the disease, genetic and environmental determinants. Despite the availability of binary/linear (or at least monotonic) correlation indices, the full exploitation of molecular information depends on the knowledge of direct/indirect conditional independence (and eventually causal) relationships among biomarkers, and with target variables in the population of interest. In other words, that depends on inferences which are performed on the joint multivariate distribution of markers and target variables. Graphical models, such as Bayesian Networks, are well suited to this purpose. Therefore, we reconsidered a previously published case study on classical biomarkers in breast cancer, namely estrogen receptor (ER), progesterone receptor (PR), a proliferative index (Ki67/MIB-1) and to protein HER2/neu (NEU) and p53, to infer conditional independence relations existing in the joint distribution by inferring (learning) the structure of graphs entailing those relations of independence. We also examined the conditional distribution of a special molecular phenotype, called triple-negative, in which ER, PR and NEU were absent. We confirmed that ER is a key marker and we found that it was able to define subpopulations of patients characterized by different conditional independence relations among biomarkers. We also found a preliminary evidence that, given a triple-negative profile, the distribution of p53 protein is mostly supported in 'zero' and 'high' states providing useful information in selecting patients that could benefit from an adjuvant anthracyclines/alkylating agent-based chemotherapy.

## Keywords

## Background

Oncological patients with similar clinical features could have heterogeneous dynamics of disease recurrence and response to therapies. Such a behaviour is prevalently associated to biological features [1]. For this reason, molecular oncology is actually focused on the identification of cancer phenotypes with homogeneous biological profile that could explain the differential response of the disease to the therapies and associable to specific biomarkers. In such a perspective, according to the pharmacogenomic paradigm, biomolecular cancer staging systems have been proposed as alternative to classical systems [2]. However, the use of "omic" techniques that have initially opened potential developments it has been followed by frustrations and doubts about the real clinical usefulness of results [3]. Whereas the majority of the oncologists is still far from the application of the so-called "genomic signatures" to support clinical decision, physicians interest is focusing on the identification of subgroups of patients responsive to the pharmacological treatments better exploiting the interrelationships among different biomarkers that in a statistical perspective, are observable variable (presence/absence of a given protein, mRNA or protein level, cell morphology traits) possibly associated to at least one target (outcome) variable. Two typical questions involve biomarkers: the current patients state, referred to disease profiling or subtyping and the patients outcome (for example, the five-year horizon since surgery), referred to disease dynamics. As regard the disease profiling, a shared interest by biomedical scientists is about the associations existing among the different biomarkers that characterize specific metabolic assets of the disease according to its natural history, genetic and environmental determinants. To study such associations, the use of binary/linear (or at least monotonic) correlation measures is a general choice as the application of multivariate analysis techniques aimed to the clustering of subjects and their biological features. However, such conventional analysis tools could be limiting since binary associations, although related, provide few insights about features of the joint multivariate distribution. In fact, from an inferential point of view, the full exploitation of a biological information is based on the knowledge of all direct/indirect conditional independence relations [4] among the biomarkers analyzed and with the target variables in the population of interest. Graphical models are aimed to face such a problem and among them, Bayesian Networks (BNs) have interesting properties that allow to address the above arose questions in a full probabilistic setting. Indeed, among the leading technologies, BNs are able to describe and derive the conditional independence (CI) relations existing in highly structured stochastic systems ([5], and references therein). Besides simplifying communication among experts of different fields, BNs support causal reasoning [6] and the development of efficient algorithms for conditioning and marginalization through exact (local) computation [6]. Although the increasing hype surrounding BNs [7] partially comes from records of success in processing biomedical [8] and molecular data [9], Directed Acyclic Graphs (DAGs) are a valuable tool for reasoning on the design of a study [10]. To better understand the information provided by biomarkers, in the present paper a probabilistic interpretation of DAGs was applied in a case study previously published by Ambrogi et al. [11], although the algorithms employed to learn DAGs structure was tailored to learn causal BNs too. Such an analysis was performed to further characterize CI relations among five biomarkers: estrogen receptor (ER), progesterone receptor (PR), a proliferative index (PROLN) from the determination of the marker Ki67/MIB-1, the receptor tyrosine kinase HER2/neu (NEU) normally involved in the signal trasduction pathways leading to cell growth/differentiation and the p53 (P53) involved in cell cycle arrest and DNA repair or apoptosis. In particular, the possible heterogeneity of CI relationships for certain classes of patients was addressed by learning the structure of MultiDAGs, a generalization of DAGs developed to represent some context-specific conditional independence relationships. Finally, to challenge the tool we examined a peculiar breast cancer molecular phenotype, the so-called triple-negative group, in which ER, PR and HER2 are absent. Since, in triple-negative tumors p53 protein appears heterogeneously expressed [13], suggesting that it may be associated with specific subgroups, we investigated the distribution of p53 conditioned to such a phenotype.

## Results and discussion

### Structural learning without AGE

*N*equal to 9. The prior distribution on structures was taken as uniform, so that

*p*(

*z*|

*ξ*) ∝ 1 does not make any structure more plausible a-priori. The inspection of top scored networks always confirmed the results shown in Figure 1. The selected structures are members of an equivalence class defined by the same set of conditional independence relations, a statement derived from the application of the Directed Markov Factorization (DMF) theorem. Variable ER separates all other pairs of variables, therefore pairs of variables separated by ER are conditionally independent given ER. The BDe log-score is equal to -3202.7056.

In Figure 1(e), one of the learned BNs is displayed using belief bars representing marginal probability values at each node after parameter learning based on the 633 instances of the case study.

From the learned structures we judged that pairs of variables are typically correlated despite the fact that conditioning on ER make them independent. This is a reasonable but not trivial finding, because the usual practice of inspecting the empirical distribution of pairs of variables is not prone to reveal such CI relations. From the DMF theorem applied to sets of nodes {*P* 53}, {*NEU*, *PROLN*, *PR*} and {*ER*}, it follows that, for example, given ER no further information is provided by other markers on p53.

### Structural learning including AGE

It is well known that the metabolism of oestrogens and of progesterone is related to patient's AGE, even though AGE might also affect other markers as regards their conditional distribution. Therefore, the second structural learning task was performed on the full set of 633 molecular profiles composed of five biomarkers including variable AGE among nodes in *V*.

Several runs of greedy search and simulated annealing algorithms were performed with equivalent sample size equal to 9 and a uniform prior distribution for *Z*. The inspection of top scored networks allowed to find the equivalence class of structures and to inspect CI relationships. The DBe log-score is equal to -3752.4043, while the log-score of the same network with node AGE disconnected from other nodes is -3757.7314.

### Structural learning of a multiDAG: AGE

The role played by age on estrogen receptors is well documented in the literature, therefore it is very interesting to investigate about the presence of heterogeneous CI relations within groups of patients belonging to different age classes. In other words, CI relationships among markers could be different within the three age classes.

*N*was always equal to 9. Within the class of low AGE the equivalence class of structures is similar to (a, b, d, e) in Figure 1 after removing edge from-to PROLN because it is not connected to any other node. Within the class of medium AGE the equivalence class of structures is equal to DAGs in Figure 1. Within the AGE class high we obtained the equivalence class of structures shown in Figure 3.

Then, we compared the best DAG against the multiDAG for the distinguished variable AGE by means of the Bayes factor (BF). The log-BF is greater than 31 therefore the best DAG is better supported by data than multiDAG AGE.

### Structural learning of a multiDAG: ER

Variable ER have been found to play a key-role in making all the other pairs of variables conditional independent. Moreover, from a theoretical point of view, the absence of estrogen receptors could modify the pattern of association among other biomarkers.

*N*was always equal to 9. Results are shown in Figure 4 in which one member of the equivalence class of DAGs is shown for each value of the distinguished variable ER. Given ER, CI holds in general among biomarkers but with some exceptions. PR is not independent on AGE for ER Null, PROLN is not independent of PR given ER Null. Moreover, for ER Medium, PR is not independent on NEU and PROLN is not independent on p53. Finally, for ER High, NEU is not independent on PR.

We compared the best DAG against the multiDAG for the distinguished variable ER by calculating the Bayes factor (BF). The log-BF is greater than 6.4 therefore the multiDAG-ER model is substantially favoured as explanation of observed data.

### Triple-negative profiles

Triple-negative cancers are defined as those tumors having an ER, PR and HER2/neu-negative status. Although they account for 10 – 17% of all breast carcinomas, triple-negative cancers represent a relevant clinical issue because of the high incidence in younger patients and the higher aggressiveness than tumors pertaining to other molecular subgroups [12, 13]. This aggressiveness is best illustrated by the fact that the peak risk of recurrence is between the first and third years of follow up and the majority of deaths occur in the first five years following therapy [16]. From a biological point of view, salient features of triple-negative breast cancers include overexpression of EGFR and c KIT, high proliferative rates, frequent genomic alterations, phenotypic similarity to BRCA1-associated cancers and frequent mutations of Tp53 [14, 15]. In particular, p53 appears heterogeneously expressed, suggesting that it may be associated with specific subgroups. Since TP53 gene mutations are predictive of response to taxanes, p53 expression represents a useful biological marker to select, among the triple-negative tumors, those more likely to benefit from taxane versus anthracyclines/alkylating agent-based chemotherapy [16, 17]. Therefore, we examined the p53 marginal distribution conditioned on the subset of triple-negative cancers included in the case series analyzed by Ambrogi et al. [11].

*z*is performed by calculating the posterior distribution of

*θ*

^{(z)}given the database of cases . The expected value of

*θ*

^{(z)}is a point estimate of networks parameters, as such it may be used to perform inferential tasks like marginalization and conditioning. It is of some interest to show belief bars representing marginal distributions at each node calculated from the point estimates of :

where *V*\*v*_{
i
}is the set difference made by all nodes but *v*_{
i
}. Moreover, here the interest is also focused to the conditional distribution of p53 given *ER* = *Null*, *p*(*x*_{P 53}| *x*_{
ER
}= 0,
, *z*,
, *ξ*), which is obtained by using an exact algorithm for evidence propagation.

The multiDAG with ER as distinguished variable is the best structure to be exploited while obtaining the above mentioned point estimates. In the our case study, given *ER* = *Null*, the best DAG and the best MultiDAG-ER provide essentially the same point estimate of the distributions for *P* 53, up to some rounding, so that in Figure 2(a) the marginal distribution of p53 is shown after parameter learning. The marginal distribution of p53 is for about one half on the null value (0.46) and about one quarter on the two other values each. The distribution of p53 changes by conditioning on a triplo-negative state, namely to *ER* = *Null*. Similar considerations motivate the use of Figure 2(b) to inspect the conditional probability table (CPT) of node P53 after conditioning to *ER* = *Null*. The probability of a null value for P53 decreases to 0.35 and the probability of a medium value is lowered to 0.10, while 0.54 is the probability of a *P* 53 value equal to high. The estimate of the marginal distribution puts a relevant fraction of the mass, 90%, on the two extreme states, Null or High. Heterogeneous patients dynamics might depend on such pretty much substantial difference which is worth to be further characterized.

*P*53 =

*Null*} under different models, Figure 5. The more disperse curve on the left (dashed line) refers to the prior belief for such event before learning structure and parameters when marginal independence is assumed among biomarkers, thus P53 is disconnected. The peaked curve on the right (dotted line) represents the posterior distribution of {

*P*53 =

*Null*} for a DAG without connections from to P53, thus P53 is disconnected. Finally, the continuous line in the middle is the final marginal distribution obtained after structural and parameter learning given a triplo-negative profile under a multiDAG ER model. The comparison reveals that the initial (prior) distribution is quite disperse while posterior distributions based on two different DAGs substantially differ. The Bayes factor is strongly in favour of the learned multiDAG structure therefore we can also estimate the bias induced by a poorly supported model, like a marginal independence model as the difference between point estimates under the two mentioned models.

### Comparison of learned structures against expert belief

Structural learning of BNs has been performed under a constant prior distribution on the space of structures. We used prior information elicited from molecular biologists about the presence of marginal association on pair of variables to evaluate the performances of the learning algorithm.

Stating the degree in a verbal way, the following associations were considered AGE-ER (strong), AGE-PR (weak), AGE-NEU (weak), ER-p53 (strong), PR-p53 (strong), ER-PR (strong), NEU-p53, NEU-PROLN (weak). By applying the separation theorem for directed graphs [6] on DAG shown in Figure 2 with an empty separating set, we checked out that all the stated marginal associations hold true in the learned structure. More formal and computational heavy approaches for structural learning are needed to exploit prior information about association in a quantitative way, for example by using an informed scoring function [18].

## Conclusion

Although the research trend in molecular phenotyping of cancer is aimed to the identification of biologic profiles related to the response to therapies, statistical approaches adopted so far in papers published on clinical journals, mainly resort to a conventional bivariate assessment of Pearson correlation coefficients among different single biomarkers. The examination of correlation matrices looking to pairs of variables, is performed implicitly assuming a joint Gaussian distribution and the appropriateness of linear associations. Moreover conditional associations are often neglected. The use of more advanced multivariate techniques for clustering and projection, has only partially supplied the need of dealing, in a more extended way, the bulk of information provided by multiple markers determinations such those arising from high-throughput genomic/proteomic assays. Such techniques are mainly set up on bivariate distances based on pairs of canonical variables, thus preventing a deeper view of high order associations among biomarkers. The use of graphical models for the study of conditional independence structures in joint multivariate distributions could represent an appropriate solution for the above issues. However, such techniques are still far from a wide diffusion, even within the biostatistical community. Within the graphical model class, Bayesian Networks (BNs) show interesting properties for the study of conditional independence (CI) relationships, addressing the above questions in a full probabilistic setting. Having their major relevance in the study of causal relationships, BNs can be also extended to account for latent unmeasured variables. In addition, the chance of heterogeneity in CI relationships for certain classes of patients can be also addressed by learning the structure of MultiDAGs. In the example considered in the present work, five conventional biomarkers and patients age were related by learning probabilistic networks. Although the central role of ER in breast cancer biology is well established, particularly as prognosticator of response to an endocrine therapy, less evident is the result of conditional independence among other markers given ER. The comparison between the best multiDAG structure and the top scored DAG revealed that inferences on p53, given a triple-negative profile, was substantially stable, and that the shift of probability mass towards extreme p53 values (low and high) unchanged. Such a novel information, initially explored with clustering and visualisation [11] and now confirmed by BN analysis could be relevant in the treatment of triple-negative patients who now appear split according to p53 values. This finding is not trivial because, if so far, the clinical class of triple-negative cancers has been assimilated to basal-like tumors (one of the five main phenotypes identified by gene expression analysis), present evidence support the emerging opinion that triple-negative and basal like breast cancers are not synonymous as the triple negative group, in addition to basal-like tumors, encompasses also normal breast like cancers [14]. Taking into consideration that normal breast-like tumors do not respond to neoadjuvant chemotherapy as well as basal-like cancers do [23], the identification by p53 of the subset of patients that could benefit from an adjuvant anthracyclines/alkylating agent-based chemotherapy is great clinical relevance.

In this work we supported a probabilistic semantic for BNs, but structural learning using the BDe score is also suited to learn causal relationships. In a causal framework the learned structures should be considered as tentative hypotheses to be further investigated in controlled experiments, possibly under randomization. While a (validated) causal network is essential to predict the effect of intervention, like a drug therapy, the quality of inferences strongly depend on the causal sufficiency of the considered variable, that is the lack of unmeasured (hidden) variables affecting two or more observed markers. Recent research has addressed the issue of estimating causal effects in presence of hidden variables but in those settings the structure is assumed known. Therefore, we plan to extend our analysis by investigating the presence of relevant hidden variables. Structural learning of CI relationships was performed after including variable AGE, known to be associated with estrogen plasma concentration and corresponding estrogen receptor levels. Within the equivalence classes of learned structures we preferred DAGs carrying the oriented edge AGE-to-ER, even if a deeper casual explanation might recognize that variable AGE per-se is deprived of a biological meaning, although related to the biological process of cancer development.

The prior distribution *p*(*z* | *ξ*) formally appearing in equation (3) was omitted during the maximization of the score because a uniform distribution on all the set of DAGs on the six variables was chosen. Some prior beliefs on the presence of marginal associations were used only to check the quality of learned structures. Nevertheless, further work should address the issue of formally eliciting expert beliefs both about associations and causal relationships [19]. Suitable heuristics might reduce the burden due to elicitation by focusing on preminent features characterizing expert's prior belief [18]. Issues still open are related to the need of discretisation of the variables considered in the BN model. Since such an operation should be based on sensible cut-off values often unavailable, every result and possible conclusions should be taken at exploratory level.

## Methods

In this section we present the case study due to Ambrogi et al. [11], then a short introduction to Bayesian Networks is provided. The Bayesian Dirichlet equivalent score is defined as the objective function to be optimized by search algorithms for structural learning. This section ends with the definition of MultiDAGs, a generalization of DAGs developed to represent some context-specific conditional independence relationships.

Original data were processed into transformed variables using R [20], which has been also used in some prototyping of calculations and displays. Much of the computation has been performed in Java http://java.sun.com using the Eclipse platform http://www.eclipse.org. Our own Java code complements two commercial BN engines, and it was developed especially to extend their functionalities and to check critical steps performed by mean of software libraries.

### A case study on bioprofiles

We consider a subset made by 633 archival tissue samples originating 5 validated markers from patients who underwent surgery for primary infiltrating breast cancer between 1983 and 1992 at the University of Ferrara, Italy [11]. We also considered the variable AGE for its well known role in estrogen expression. The original study aimed to identify tumor profiles of clinical relevance based on immunohistochemical molecular markers measured within a single hospital.

The biomarkers here considered are: estrogen receptors (ER), progesterone receptors (PR), a proliferation index (PROLN = Ki-67/MIB1), and two proteins (HER2-NEU) and (p53). In the present study we also considered the variable AGE due to the important relationship between patient age, which reflects woman menopausal status, and estrogen status.

Aggregation of original data

(a) Original classes | (b) Absolute frequencies in aggregated classes | ||||||||
---|---|---|---|---|---|---|---|---|---|

1 | 2 | 3 | 4 | 5 | 6 | 1 | 2 | 3 | |

PR | 1 | 2 | 2 | 2 | 3 | 3 | 182 | 220 | 231 |

ER | 1 | 2 | 2 | 2 | 3 | 3 | 116 | 247 | 270 |

NEU | 1 | 2 | 2 | 2 | 3 | 3 | 328 | 203 | 102 |

PROLN | 1 | 2 | 2 | 3 | 3 | 129 | 268 | 236 | |

P53 | 1 | 2 | 3 | 3 | 293 | 175 | 165 | ||

AGE | < 50 | [50, 60] | > 60 | 50 | 198 | 385 |

### Bayesian networks

A directed graph
is a pair (*V*, *E*), with *V* = {*v*_{1}, *v*_{2},...,*v*_{
K
}} a finite set of nodes which label the elements of random vector
and *E* a subset of the Cartesian product *V* × *V*. If (*v*_{
i
}, *v*_{
j
}) ∈ *E* then (*v*_{
j
}, *v*_{
i
}) ∉ *E* and the ordered pair (*v*_{
i
}, *v*_{
j
}) corresponds to the oriented edge *v*_{
i
}→ *v*_{
j
}. Only oriented edges are allowed in
.

Let (
, *v*_{
j
}), (
, *v*_{
j
}),... be all the elements of *E* in which *v*_{
j
}follow another node (oriented edges into *v*_{
j
}), then the set of parents of node *v*_{
j
}is *pa*(*v*_{
j
}) = {
,
,...}. If (*v*_{
i
},
), (*v*_{
i
},
),... are all the elements in which *v*_{
i
}precedes another node then the set of children of node *v*_{
i
}is
. Two nodes are connected if an edge joins them. A path (*v*_{0},..., *v*_{
k
}) is a sequence of nodes in which pairs *v*_{
i
}, *v*_{i +1}are connected by an edge. A directed path is a path in which each edge is oriented from *v*_{
i
}to *v*_{i +1}. Set *an*(*v*_{
i
}) collects the ancestors of node *v*_{
i
}, that is nodes originating directed paths reaching node *v*_{
i
}. All nodes of a directed path originated in *v*_{
i
}are descendants of *v*_{
i
}, and they are elements of set *de*(*v*_{
i
}). A cycle in a directed graph is a directed path where the first and last node are equal, *v*_{0} = *v*_{
k
}. A directed graph
without cycles is a Directed Acyclic Graph (DAG).

*v*

_{ i }∈

*V*refers to a random variables hereafter discrete with range and by a distribution Markov with respect to . A probability distribution for random variables indexed in

*V*is said to be Markov with respect to if the joint distribution factorizes according to the DAG parents-to-children structure:

where
is a realization of the random vector made by variables whose labels belong to parents set *pa*(*v*_{
i
}). The distribution associated to a node
is conditional to the set of random variables labeled by parent nodes, *pa*(*v*_{
j
}).

The lack of an arrow from *v*_{
i
}to *v*_{
j
}means irrelevance of *v*_{
i
}in predicting *v*_{
j
}, that is conditional independence. Further conditional independence relations may be derived using the directed global Markov criterion on moralized DAG [6]. The moral graph
of DAG
is equal to the starting DAG but without edges orientation in which further (undirected) edges are added to join pairs of nodes sharing the same child without being originally connected. Two nodes *v*_{
i
}and *v*_{
j
}are separated i
by a set of nodes *S* ⊂ *V*\*v*_{
i
}, *v*_{
j
}if all the path from *v*_{
i
}and *v*_{
j
}contain at least one node belonging to *S* in the moral graph
. The extensions of separation of two subsets of nodes is straightforward. The Directed Markov Factorization (DMF) theorem states that given three disjoint subsets *A*, *B*, *S* of *V* random vectors *X*_{
A
}and *X*_{
B
}are conditionally independent given *X*_{
S
}if *S* separates *A* from *B* in the moral subgraph made by *A* ∪ *B* ∪ *S* and their ancestral sets.

The structure of a Bayesian network is sometimes unknown and we define a variable *Z* on a subset *χ*_{
Z
}of positive integers so that *Z* is one-to-one with the set of all DAGs defined on a given collection of nodes *V*.

The expert's degree of belief about the structure of a BN is represented by a conditional probability mass function *p*(*z* | *ξ*) given the considered domain context *ξ*.

*n*

_{ d }conditionally independent realizations from the distribution are taken without missing values. Structural learning of a BN by means of a Bayesian score amounts to process the database to infer the conditional independence relations existing in the joint distribution of the random vector. A Bayesian score is a function obtained by integrating out parameters of conditional distributions appearing in (2):

where
is the vector of parameters for structure *z*, that is parameters
for all *v*_{
i
}∈ *V* are conditional probability tables (CPTs) espliciting factors *p*(
|*θ*, *z*, *ξ*). The notation *θ*_{i, j}= (*θ*_{i, j, 1},...,*θ*_{i, j, s},...) refers to the column *j* of the CPT for node *v*_{
i
}and by using *s* as a row index it follows that ∑_{
s
}*θ*_{i, j, s}= 1.

*p*( |

*θ*,

*z*,

*ξ*) is a product of multinomial probability mass functions and conjugate prior distributions for

*θ*

^{ z }s is defined by the product of Dirichlet probability density functions:

where *θ*_{i, j, s}is the probability value of *X*_{
i
}taking value in row *s* given parents state in column *j*, and where (*α*_{i, j,1},...,*α*_{i, j, s},...,
), are parameters of a Dirichlet distribution at node *v*_{
i
}given parents state *j*, with *α*_{i, j}= ∑_{
s
}*α*_{i, j, s}and *r*_{
i
}the number of states of *X*_{
i
}.

The choice of parameters (*α*_{i, j,1},...,*α*_{i, j, s},...,
) for all *i*, *j* is performed to define a likelihood equivalent metric, called Bayesian Dirichlet equivalent (BDe) metric [21], that assigns the same score to structures entailing the same CI relationships. Given a variable
and its vector of parents
, we define the number of states *r*_{
i
}of *X*_{
i
}and *q*_{
i
}of
. A value of *α*_{i, j, s}=
for each *s* defines a likelihood equivalent metric by keeping the equivalent sample size *N* fixed to a preferred value, here equal to 9 in all our computations. In other words a virtual sample of nine observations is equally allocated to each CPT, say for a 3 times 3 table one observation is allocated to each cell in the table.

with
, and where
are sums of sufficient statistics *N*_{i, j, s}, that is counts of cases in which the *i*^{
th
}variable takes the *s*^{
th
}state while its parent configuration is in the *j*^{
th
}state.

Note that the marginal distribution *p*(
|*ξ*) = ∑_{
z
}*p*(
|*z*, *ξ*)·*p*(*z*|*ξ*) becomes quickly intractable for an increasing number of nodes, and in this case the posterior distribution *p*(*z*|
, *ξ*) is not available in closed form. Model selection may be performed by scoring structures and maximizing *p*(
, *z*|*ξ*) with respect to *z*, both to select the best structure and to identify a restricted collection of structures on which approximated computation of posterior probabilities may be focused [21].

### MultiDAGs

A DAG captures a quite strong form of conditional independence relation because it must hold for each value taken by the conditioning variables. A weaker conditional independence relation is obtained by allowing the independence among variables to hold only for a subset of all possible states taken by conditioning variables. The new relation is sometimes called context-specific conditional independence relation.

*X*

_{ c },

*c*∈

*V*, is a set of component DAG models for

*X*

_{V\c}, each encoding a joint distribution that may differ for each value

*x*

_{ c }taken by the distinguished variable. The extended factorization takes the following form:

with *π*_{
c
}the marginal probability of *X*_{
c
}= *x*_{
c
}and *pa*(*v*_{
i
}, *c*) the set of parents of node *v*_{
i
}in the DAG component defined by *x*_{
c
}.

Structural learning of multiDAGs is performed under the BDe score by iterating the search algorithm over groups of observations carrying the same value *x*_{
c
}of the distinguished variable.

## Declarations

### Acknowledgements

FMS has been partially supported by an Italian PRIN grant (MIUR). EB was partly supported by the BIOPATTERN NOE grant EUFP6-2002-IST-1 no.508803 and RNBIO Italian Network for Oncology Bioinformatics. Thanks are due to Federico Ambrogi for help with data and useful discussion on triplo-negative profiles.

This article has been published as part of *BMC Bioinformatics* Volume 10 Supplement 12, 2009: Bioinformatics Methods for Biomedical Complex System Applications. The full contents of the supplement are available online at http://www.biomedcentral.com/1471-2105/10?issue=S12.

## Authors’ Affiliations

## References

- Biganzoli E, Boracchi P, Daidone M, Gion M, Marubini E:
**Flexible modelling in survival analysis: structuring biological complexity from the information provided by tumor markers.***International Journal of Biological Markers*1998,**13:**107–123.PubMedGoogle Scholar - Gevaert O, De Smet F, Timmerman D, Moreau Y, De Moor B:
**Predicting the prognosis of breast cancer by integrating clinical and microarray data with Bayesian Networks.***Bioinformatics*2006,**22:**e184-e190. 10.1093/bioinformatics/btl230View ArticlePubMedGoogle Scholar - Biganzoli E, Lama N, Ambrogi F, Antolini L, Boracchi P:
**Prediction of cancer outcome with microarrays.***Lancet*2005,**365:**1683. 10.1016/S0140-6736(05)66537-3View ArticlePubMedGoogle Scholar - Dawid AP:
**Conditional independence in statistical theory.***Journal of the Royal Statistical Society ser. B*1979,**41:**1–31.Google Scholar - Green PJ, Hjort NL, Richardson S, Eds: Highly Structured Stochastic Systems. Oxford University Press: Oxford; 2003.Google Scholar
- Cowell RG, Dawid AP, Lauritzen SL, Spiegelhalter DJ:
*Probabilistic Networks and expert systems.*Springer-Verlag: Berlin, Heidelberg; 1999.Google Scholar - Editorial: Bayesian Networks in biomedicine and health-care. Artificial Intelligence in Medicine 2004, 30: 201–204. 10.1016/j.artmed.2003.11.001Google Scholar
- Getoor L, Rhee JT, Koller D, Small P:
**Understanding tubercolosis epidemiology using structured statistical models.***Artificial Intelligence in Medicine*2004,**30:**233–256. 10.1016/j.artmed.2003.11.003View ArticlePubMedGoogle Scholar - Friedman N, Linial M, Nachman I, Pe'er D:
**Using Bayesian networks to analyzze expression data.***Journal of Computational Biology*2000,**7:**601–620. 10.1089/106652700750050961View ArticlePubMedGoogle Scholar - Tritchler D:
**Reasoning about data with directed graphs.***Stat Med*1999,**30:**2067–2076. 10.1002/(SICI)1097-0258(19990830)18:16<2067::AID-SIM182>3.0.CO;2-2View ArticleGoogle Scholar - Ambrogi F, Biganzoli E, Querzoli P, Ferretti S, Boracchi P, Alberti S, Marubini E, Nenci I:
**Molecular Subtyping of Breast Cancer from Traditional Tumor Marker Profiles Using Parallel Clustering Methods.***Clinical Cancer Research*2006,**12:**781–790. 10.1158/1078-0432.CCR-05-0763View ArticlePubMedGoogle Scholar - Dent R, Trudeau M, Pritchard KI, Hanna WM, Kahn HK, Sawka CA, Lickley LA, Rawlinson E, Sun P, Narod SA:
**Triple-negative breast cancer: clinical features and patterns of recurrence.***Clinical Cancer Research*2007,**13:**4429–4434. 10.1158/1078-0432.CCR-06-3045View ArticlePubMedGoogle Scholar - Tischkowitz M, Brunet JS, Bégin LR, Huntsman DG, Cheang MC, Akslen LA, Nielsen TO, Foulkes WD:
**Use of immunohistochemical markers can refine prognosis in triple negative breast cancer.***BMC Cancer*2007,**7:**134. 10.1186/1471-2407-7-134PubMed CentralView ArticlePubMedGoogle Scholar - Lakhani SR, Vijver MJ, Jacquemier J, Anderson TJ, Osin PP, McGuffog L, Easton DF:
**The pathology of familial breast cancer: predictive value of immunohistochemical markers estrogen receptor, progesterone receptor, HER-2, and p53 in patients with mutations in BRCA1 and BRCA2.***Journal of Clinical Oncology*2002,**20:**3752–3753. 10.1200/JCO.2002.09.023View ArticleGoogle Scholar - Pusztai M, Ayers Land, Stec J, Clark E, Hess K, Stivers D, Damokosh A, Sneige N, Buchholz TA, Esteva FJ, Arun B, Cristofanilli M, Booser D, Rosales M, Valero V, Adams C, Hortobagyi GN, Symmans WF:
**Gene expression profiles obtained from fine-needle aspirations of breast cancer reliably identify routine prognostic markers and reveal large-scale molecular differences between estrogen-negative and estrogen-positive tumors.***Clinical Cancer Research*2003,**9:**2406–2415.PubMedGoogle Scholar - Harris NL, Broadwater G, Lin NU, Miron A, Schnitt SJ, Cowan D, Lara J, Bleiweiss I, Berry D, Ellis M, Hayes DF, Winer EP, Dressler L:
**Harris LN, Broadwater G, Liu NU: Molecular subtypes of breast cancer in relation to paclitaxel response and outcomes in women with metastatic disease: results from CALGB 9342.***Breast Cancer Research*2006,**8:**R66. 10.1186/bcr1622PubMed CentralView ArticlePubMedGoogle Scholar - Cleator S, Heller W, Coombes RC:
**Triple-negative breast cancer: therapeutic options.***Lancet Oncology*2007,**8:**235–244. 10.1016/S1470-2045(07)70074-8View ArticlePubMedGoogle Scholar - Mascherini M, Stefanini FM:
**Using weak prior information on structures to learn Bayesian Networks.**In*KES 2007/WIRN 2007, Part I, LNAI 4692*. Edited by: BA et al. Springer-Verlag: Berlin, Heidelberg; 2007:413–420.Google Scholar - Stefanini FM:
**Eliciting expert beliefs on the structure of a Bayesian network.***Proceedings of the Fourth European Workshop on Probabilistic Graphical Models*2008. [http://pgm08.cs.aau.dk/Papers/32_Paper.pdf]Google Scholar - R Development Core Team:
*R: A language and environment for statistical computing, reference index version 2.4.1*. R Foundation for Statistical Computing: Vienna; 2005. [http://www.R-project.org]Google Scholar - Heckerman D, Geiger D, Chickering DM:
**Learning Bayesian Networks: The Combination of Knowledge and Statistical Data.***Machine Learning*1995,**20:**197–243.Google Scholar - Geiger D, Heckerman D:
**Beyond Bayesian Networks: similarity networks and Bayesian multinets.***Artificial Intelligence*1996,**82:**45–74. 10.1016/0004-3702(95)00014-3View ArticleGoogle Scholar - Thiesson B, Meek C, Chickering DM, Heckerman D:
**Learning Mixtures of DAG models.***Technical Report MSR-TR-97–30, Microsoft Research*1997.Google Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.