 Software
 Open access
 Published:
CRA toolbox: software package for conditional robustness analysis of cancer systems biology models in MATLAB
BMC Bioinformatics volume 20, Article number: 385 (2019)
Abstract
Background
In cancer research, robustness of a complex biochemical network is one of the most relevant properties to investigate for the development of novel targeted therapies. In cancer systems biology, biological networks are typically modeled through Ordinary Differential Equation (ODE) models. Hence, robustness analysis consists in quantifying how much the temporal behavior of a specific node is influenced by the perturbation of model parameters. The Conditional Robustness Algorithm (CRA) is a valuable methodology to perform robustness analysis on a selected output variable, representative of the proliferation activity of cancer disease.
Results
Here we introduce our new freely downloadable software, the CRA Toolbox. The CRA Toolbox is an ObjectOriented MATLAB package which implements the features of CRA for ODE models. It offers the users the ability to import a mathematical model in Systems Biology Markup Language (SBML), to perturb the model parameter space and to choose the reference node for the robustness analysis. The CRA Toolbox allows the users to visualize and save all the generated results through a userfriendly Graphical User Interface (GUI). The CRA Toolbox has a modular and flexible architecture since it is designed according to some engineering design patterns. This tool has been successfully applied in three nonlinear ODE models: the Prostatespecific Pten^{−/−} mouse model, the Pulse Generator Network and the EGFRIGF1R pathway.
Conclusions
The CRA Toolbox for MATLAB is an opensource tool implementing the CRA to perform conditional robustness analysis. With its unique set of functions, the CRA Toolbox is a remarkable software for the topological study of biological networks. The source and example code and the corresponding documentation are freely available at the web site: http://gitlab.ict4life.com/SysBiOThe/CRAMatlab.
Background
In Systems Biology, mathematical modeling and computational software are important tools to unravel the complexity of biological systems and predict their behavior under different perturbations [1]. Typically, many models consist of a set of Ordinary Differential Equations (ODEs) which allow understanding and reproducing the dynamic behavior of molecular interactions through simulations and integration of the ODEs [2]. To support mathematical modeling of biological networks, the use of software tools has grown substantially in recent years. These software are designed to assist the users at different stages of the modeling process, from model generation to parameter estimation and model analysis.
In cancer research, the use of systems biology approaches is particularly useful to elucidate mechanisms of tumorigenesis and tumor resistance. Computational predictive models, integrated with patient data, help scientists in the validation of new and durable therapies [3]. In order to discover effective and targeted drugs, robustness is one of the most relevant properties of cancer signaling networks to investigate. Robustness is defined as the ability of a biological system to maintain its functionalities against internal and external perturbations [4]. In more detail, cancer robustness is a quantitative measure of the tumor proliferation attitude against extracellular inputs. Thus, understanding new ways to reduce robustness of the cell proliferation activity is a key issue in cancer systems biology. Since cell growth is driven by protein interaction networks, the proliferation activity can be quantified by looking at the activation of a protein involved in the proliferation process [5]. In mathematical modeling, this can be done by perturbing model parameters and analyze how the concentration of the protein of interest changes over time. An algorithm developed for this purpose is the Conditional Robustness Algorithm (CRA) proposed in [5]. This algorithm, through computational perturbations and simulations, identifies a small number of nodes in the cancer network which influences most the activity of the proliferation indicator. As a result, by conditioning these nodes with specific drugs, it may be possible to reduce the tumor robustness.
Robustness of mathematical model problem is well studied in literature except when the models are based on nonlinear ODE. A class of methods is aimed at analyzing the geometry and the volume of the feasible region, which is the region in the parameter space that allows the system to properly work [6]. Moreover, there are other algorithms that infer the robustness of a model looking at its topology, such as the number and the structure of positive and negative loops [7]. However, these techniques are typically applied to mathematical models whose parameters are not kinetic. Another and different category of methods is the Global Sensitivity Analysis (GSA) class of algorithms [8]. They are similar to CRA and are involved in the analysis of the uncertainties in kinetic model parameters through the sampling of the parameter space. Despite that, GSA and CRA have clear distinct goals. GSA is typically interested in the variation of a performance index with the respect to the model parameters. Since many times this is basically implemented through the derivatives, GSA tools are useful when an optimization of the system is required [9]. In the CRA algorithm, on the other hand, the purpose is not to maximize or minimize a certain optimization function, but the main interest is in finding the conditioning set, which is the subset of parameters that more likely is able to impose a specific behavior to one output of the model.
In order to facilitate the study of cancer robustness and the application of CRA, we develop the CRA Toolbox, a software package for MATLAB. It is an open source tool which allows non expert users to apply the CRA to any ODE model in a simple and quick way. The CRA Toolbox consists in a easy to use Graphical User Interface (GUI) and in a set of functions which can be easily extended by the users in order to achieve specific requirements.
In the following subsection, we briefly describe the CRA method implemented in the toolbox. A detailed description of the method can be found in [5].
Conditional Robustness Algorithm (CRA)
The main underlying theoretical principle of CRA is the definition of conditional robustness proposed by Kitano in [10]: it is the quantitative measure of the ability of a system S to maintain a specific property τ against some perturbations of the parameter vector p of S. The mathematical formulation is the following:
where f_{P}(p) is the probability density function of p, P is the parameter space and \(\zeta _{\tau }^{S}(p)\) is a function that quantifies and represents the property τ that is under investigation.
The CRA is a stochastic approach for performing conditional robustness analysis of mathematical models, such as ODE models representing biochemical interaction networks. Its purpose is to quantify the influence of each model parameter on the behavior of a specific output node. Let denote with S the following ODE system:
where x∈R^{n} is the state space vector that contains the species included in the biological model under study; p∈R^{q} denotes the parameter vector; u∈R^{j} and y∈R^{m} are the input and output vectors respectively. The key features of this algorithm are:

simultaneous perturbation of model parameters;

definition and computation of the evaluation function;

estimation of the conditional probability density functions (pfds) for each model parameter.
The parameter vector p is perturbed through Latin Hypercube sampling (LHS) and the model S is integrated for each one of the N_{S} samples generated in R^{q}. This procedure allows the collection of N_{S} vectors of the observables y. Then, the CRA is based on the definition and the in silico computation of an evaluation function on a specific output node i.e., on a specific observable y_{i}. In more details, the evaluation function can be formalized as follows:
where the index i represents the selected output variable of the model. Thus, the evaluation function, that depends on the time behavior of y_{i} (which, in turn, depends on the selected parameter vector p), can be considered as a user defined summary statistic that stands for a specific property of the chosen output node y_{i}. The set of computed evaluation functions, for a specific output node y_{i}, has cardinality equal to N_{S}, i.e. the number of sampled parameter vectors. Let denote with\(f_{Z_{i}}(z_{i})\) the pdf of the set of evaluation functions previously defined.
The CRA algorithm aims at quantifying the influence of each model parameter on a specific output node through \(f_{Z_{i}}(z_{i})\). In more detail, it is interested in the estimation of the distribution of the parameter vector p only when the lower and upper tail of \(f_{Z_{i}}(z_{i})\) are selected. To this purpose, the domain of \(f_{Z_{i}}(z_{i})\) can be partitioned into two regions by the definition of L(α) and U(α) as:
where α is the level of probability that represents the area under the lower and upper tail of \(f_{Z_{i}}(z_{i})\) and a is the corresponding threshold value in the domain of the pdf.
The partition defined in the domain of \(f_{Z_{i}}(z_{i})\) allows the estimation of two conditional pdfs for each parameter, \(f_{p_{i}L}\) and \(f_{p_{i}U}\), respectively. These two pdfs are the distributions of the parameters of S when the values of the evaluation function belong to the lower and upper tail of \(f_{Z_{i}}(z_{i})\) respectively. Here the purpose of the estimation of \(f_{p_{i}L}\) and \(f_{p_{i}U}\) is to select a subset of the N_{S} samples of the parameters that give rise to the most divergent behaviors of the evaluation function. The two conditional densities defined above are employed for the calculus of the Moment Independent Robustness Indicator (MIRI) according to the following formula:
The MIRI is an index that measures the level of separation between \(f_{p_{i}U}\) and \(f_{p_{i}L}\) for each parameter of the model. An high value of the MIRI for a parameter p_{i} means that the perturbation of the parameter space along the p_{i} direction leads to high variation of the evaluation function. Thus, the higher the value of a MIRI, the higher is the influence of that parameter on the dynamical behavior of the selected output node.
Finally, the output of CRA is the vector μ that contains the value of the MIRI associated to each parameter of the model. For further details about CRA, see [5].
Implementation
The CRA Toolbox is an open source software developed as a MATLAB package. Its core is a set of functions that the user can run locally in a MATLAB environment by downloading the folder containing the toolbox. This software automates all the functionalities required by CRA to perform robustness analysis of an ODE model.
The CRA Toolbox includes a GUI that runs within MATLAB to encourage the employment of the software also for non expert users. In more detail, the tool firstly performs the import of a mathematical model written in Systems Biology Markup Language (SBML) and saved in .xml file format. Then, it allows the user to set the tuning parameters to regulate the parameter space perturbation and the model integration, such as the specific ODE solver to use. Before selecting the reference node from a scrollbar that lists all the outputs of the model, it is necessary to start the simulations by clicking on a specific button. Once the in silico measures are completed, the tool requires the selection of a specific evaluation function in a predefined list and the method for the computation of the lower and higher tail of the pdf of the evaluation function. Finally, it is possible to plot and save in a user defined directory all the in silico measures, the estimated pdfs and the boxplot of MIRIs. In order to guarantee the reliability of results, the toolbox supports the generation of multiple realizations of the entire procedure and of the resulting MIRIs and pdfs. In order to speed up the model simulation we use parallel processing through the Parallel Computing Toolbox ^{TM} [11].
Moreover, we also provide an alternative implementation of the CRA Toolbox that allows the user to run the algorithm in batch mode directly from the command line. The core functions and the architecture of the software remains unchanged, but for this version we removed the GUI and we also avoided the use of Simbiology to enhance the portability of the code. Indeed, in this version of the software, the mathematical model can be given in input as a Matlab function where all the ODEs are specified and it is not required to use the SBML language and the corresponding Simbiology Object.
The source code of the CRA Toolbox is written according to the ObjectOriented programming paradigm as it is shown in the UML class diagram in Fig. 1. For a detailed description of all the components of the tool see (Additional file 1). The architecture of the software is modular because we implement it using software engineering design patterns to model relationships and interactions between classes. As an example, we use the behavioral Strategy pattern [12] twice between the three main classes of the tool: once between the TimeBehavior and EvaluationFunction classes and the other between TimeBehavior and Tail classes. This makes the code easily to extend because if a user wants to add another type of evaluation function or wants to implement another method for the pdf tail calculus, he does not have to change any other part of the code.
Results
In this section we show how to use the CRA Toolbox and we report the results of the application of CRA to three different ODE models: the Prostatespecific Pten^{−/−} mouse model, the Pulse Generator Network and the EGFRIGF1R pathway. The second and the third examples are used in order to verify that the CRA Toolbox produces results in agreement with those in [5]. Figure 2, Additional files 2 and 3 contain a flowchart and two images to guide the user in the use of the tool.
Prostatespecific Pten ^{−/−} mouse model
In this section, we use the ODE model proposed in [13] to illustrate the functionalities of the CRA Toolbox. This model was developed to study the interactions between prostate cancer and immune microenvironment. In more detail, it is a prostatespecific Pten^{−/−} mouse model for analyzing the effect of the combined therapies with vaccines and Androgen deprivation therapy (ADT) in prostate tumor. The original model consists of two compartments, prostate and lymphoid, 11 state variables and four types of therapeutic strategies, resulting in a system of 15 ODEs and 29 parameters. The pathway of the model is shown in Fig. 3. In this example, we analyze a simplified version of this model because we consider only the offtreatment condition (shamcastration). As a result, the mathematical model consists of 12 ODEs and 23 parameters. Equations of the model are:
Parameter values and initial conditions of state variables are shown, respectively, in Tables 1 and 2. Since initial condition of androgen is set to 1, i.e. A_{0}=1, the concentration of androgen keeps unchanged. Moreover, parameters p_{C}, p_{R} and p_{D} represent probabilities fixed all to 0.5 in [13] and thus they are not perturbed in the CRA procedure.
We apply the CRA Toolbox to the ODE model by setting tuning parameters of the procedure as follows: number of samples N_{S} equal to 10000, lower boundary and upper boundary of the LHS equal to 0.1 and 10 respectively. We run 100 independent realizations to verify the reliability and stability of the procedure. We choose different output nodes and evaluation functions in order to show results of the CRA Toolbox in a complete and comprehensive way. Specifically, we select as output nodes both variables C_{2} and C_{1}, which represent cytotoxic T lymphocyte (CTL) in prostate and lymphoid respectively. For C_{2}, we measure all the three evaluation functions offered by the software, i.e. the area under the curve, the maximum and the time of maximum reached by the time behavior of CTL, as shown in Fig. 4. Conversely, for C_{1}, we perform robustness analysis using as evaluation function only the area under the curve. In all cases, we set equal to 1000 the dimension of the upper and lower tail of the evaluation function pdf, in order to guarantee a stable estimation of the conditional parameter pdfs [5].
Results of CRA applied to variable C_{2} to measure the area are shown in Fig. 5. Parameters α_{DC} and k_{RC} have MIRI values above 1, thus they have a great impact on the chosen evaluation function. Other parameters influencing the selected output are μ_{R}, α_{XD} and π_{C}, having MIRI values between 0.5 and 1.
Similar results are obtained for the maximum value of C_{2}, as shown in Fig. 6. Parameters with the highest MIRI values (∼1) are k_{RC} and α_{DC} as before, while parameters r_{p1}, α_{XD} and μ_{R} have all MIRIs around 0.5.
Figure 7 shows results obtained for the time of maximum of variable C_{2}. In this case, MIRIs have values lower if compared to the previous examples. The most influential parameters are α_{DC}, k_{RC} and μ_{R}, with MIRI values around 0.6.
As regards variable C_{1}, results of the measured area are shown in Fig. 8. Two are the parameters with MIRIs above 1: r_{p1} and α_{DC}. All the remaining parameters have low values, except for α_{XD} and \(\alpha _{D_{C}D_{R}}\) with values around 0.5.
Table 5 contains the time necessary to perform all the simulations.
Pulse generator network
We test the CRA Toolbox on a small toy system belonging to the field of Synthetic Biology because synthetic models are one of the best examples of the importance of theoretical modeling in the biological reality [14]. The pulse generator network consists of three nodes, representing three genes, aimed at producing a transient output response to a persistent input stimulus [14]. Figure 9 shows the interaction schema of the model. Node S1 is the input step signal that activates both R2 and Y. R2 is the so called repressor because it acts as a deactivator of the product Y. The corresponding ODE model has two state variables, eight kinetic parameters and one input signal. The following ODEs are written using a Hill function for the activation and repression function [5, 15]:
Nominal values for the parameters in Eq. 6 are k_{1}=5 nM/min, k_{12}=20 nM/min, λ_{2}=0.01 nM/min, λ=0.04 nM/min, K_{1}=1 nM, K_{2}=100 nM and n_{1}= n_{2}=3. We run the CRA Toolbox setting the tuning parameters as reported in [5]. More in detail, we set the number of realizations, the lower boundary, the upper boundary and the number of samples equal to 100, 0.1, 10 and 10000 respectively. Parameters n_{1} and n_{2} remain fixed to their nominal values since they are not included in robustness analysis. We select as reference node the observable Y and we progressively perform the CRA using all the three evaluation functions provided by the tool, i.e. the area under the curve, the maximum value and the time of maximum. Figure 10 shows the pdf of the area and the corresponding boxplot of MIRIs when choosing 1000 as the dimension of both the lower and higher tails. The other subfigures of Fig. 10 show the conditional pdfs of each parameter that are used for the calculus of MIRIs. Figure 11 shows the results of robustness analysis when the maximum of output variable Y is selected as evaluation function. Figure 12 reports the output generated by the CRA Toolbox about the time of maximum of variable Y. From Figs. 10b, 11b and 12b, it is clear how parameter λ has a great impact on the output behavior of Y, since it influences all the three evaluation functions with an high value of the corresponding MIRI. Moreover, parameter k_{12} is the one with highest value of the MIRI in Fig. 11b and thus it especially influences the maximum value reached by the Y node. Finally, parameter K_{2} is the most relevant when dealing with the time of maximum of variable Y because it has the highest MIRI value in Fig. 12b. Table 5 reports the time required to complete all the simulations described in this section.
EGFRIGF1R pathway in lung cancer
The last example of application of the CRA Toolbox is the EGFRIGF1R pathway, which is one of the most relevant interaction network for the study of cancer pathogenesis and progression in NonSmall Cell Lung Cancer (NSCLC). Figure 13 depicts the pathway. For detailed information about the biological importance of this network and the role of the different nodes see [16]. The corresponding mathematical ODE model is published in [17] (id:MODEL1209230000). The dynamical ODE model is composed of ten equations (Eq. 7), containing two types of kinetic laws: the law of mass action and the MichaelisMenten kinetics.
Table 3 explicits names and initial concentrations of the ten state variables, of the three input signals and of the eight total protein parameters. Table 4 lists all the kinetic model parameters and their nominal values. We run the CRA Toolbox according to the guidelines in [5]: the number of realizations, the lower boundary, the upper boundary and the number of samples are set equal to 100, 0.1, 10 and 10000 respectively. We select as reference node the active form of ERK protein, since it is one of the best indicator of the proliferation attitude of lung cancer. More in detail, we perform robustness analysis of the model choosing as evaluation function the area under the curve of the time behavior of ERK. Figure 14a shows the pdf of the evaluation function and Fig. 14b the boxplot for each one of the 39 MIRI parameters. This figure clearly shows that four parameters have a MIRI higher than 0.6 and thus they significantly influence the dynamical behavior of the output node. More in detail, these parameters are: k_{ERKPP2A}, KM_{ERKPP2A}, k_{MEKPP2A} and KM_{MEKPP2A} and Fig. 14c, d, e and f show the corresponding conditional pdfs.
Table 5 reports the time required to complete the robustness analysis through the CRA algorithm.
Discussion
The CRA is an algorithm to study the robustness of complex biological networks and it allows the identification of few parameters that have a major impact on the behavior of a selected output variable. One of its main innovations is the introduction of a sensitivity measure, the MIRI, that takes advantage of all the conditional distributions of the parameters, without reference to a specific moment. In [18] there are the mathematical details of this class of indicators and the comparison with the variancebased uncertainty importance measures.
Here we present the CRA Toolbox, a software package for MATLAB aimed at performing the robustness analysis based on the paradigm of the CRA. The tool consists of a set of MATLAB functions that automate all the necessary mathematical steps from the integration of an ODE model until the calculus of the MIRIs. We decide to use the ObjectOriented programming paradigm because it allows us the development of an extendable and flexible architecture through the implementation of different engineering design patterns. In this way, other users can add blocks of software to define novel evaluation functions and other methods for the identification of the pdf tails without modifying the structure of the software and the source code of the existing classes.
Here we tested the CRA on three ODE models that contain different kinetic laws and different number of state variables. All the simulations were performed on a Intel Core i74700HQ CPU, 2.40GHz 8, 16GB memory, Ubuntu 16.04 LTS (64bit). From Table 5 it is clear how the time to complete a realization of the CRA highly depends both on the dimension of the model and on the number of samples N_{S} of the LHS. Indeed, from a computational point of view, the most intensive part of the algorithm is the integration of the mathematical model N_{S} times. Moreover, the choice of N_{S} influences the estimation of the evaluation function pdf, whose cost increases with N_{S}. On the other hand, the computation of the MIRIs is pretty fast, independently of the type of evaluation function selected. For more details about the choice of the tuning parameters and the computational costs of the CRA for different settings of tuning parameters see Additional file 4.
One of the key ideas in [5] is that the theoretical statements of the CRA do not depend on the specific modeling technique used to represent a biological phenomenon. For this reason, one of the possible future development of the tool is to augment the number and types of formats of mathematical models taken in input. Finally, the code of the CRA Toolbox can be easily adapted to other open source programming languages such as Octave and Python.
Conclusions
The CRA Toolbox is unique in the category of the robustness analysis tools because it is the specific implementation of the CRA with all its features. It has the scope to enlarge and facilitate the usage of this algorithm and to disclosure it also to non expert users. This can significantly help the oncological research of physicians in discover novel targeted therapies. Moreover, in [19], the Conditional Robustness Calibration (CRC) algorithm is presented, which is an upgrade of the CRA that allows the generation of MIRIs for a given model taking into account multiple nodes simultaneously. This novel algorithm suggests that the CRA Toolbox can be modified and extended in the future in order to implement also the functionalities of CRC.
Availability data and requirements
Project name: CRA Toolbox
Project home page: http://gitlab.ict4life.com/SysBiOThe/CRAMatlab
Operating system(s): Platform independent
Programming language: MATLAB
Other requirements: MATLAB
License: MATLAB
Any restrictions to use by nonacademics: License needed for MATLAB
Availability of data and materials
The most recent version of the software and the documentation can be found in a public available GitLab repository using the following link: http://gitlab.ict4life.com/SysBiOThe/CRAMatlab.
References
Kitano H. Systems biology: a brief overview. Science. 2002; 295(5560):1662–4.
Ghosh S, Matsuoka Y, Asai Y, Hsin KY, Kitano H. Software for systems biology: from tools to integrated platforms. Nat Rev Genet. 2011; 12(12):821.
Werner HM, Mills GB, Ram PT. Cancer systems biology: a peek into the future of patient care?. Nat Rev Clin Oncol. 2014; 11(3):167.
Kitano H. Biological robustness. Nat Rev Genet. 2004; 5(11):826.
Bianconi F, Baldelli E, Luovini V, Petricoin EF, Crinò L, Valigi P. Conditional robustness analysis for fragility discovery and target identification in biochemical networks and in cancer systems biology. BMC Syst Biol. 2015; 9(1):70.
Dayarian A, Chaves M, Sontag ED, Sengupta AM. Shape, size, and robustness: feasible regions in the parameter space of biochemical networks. PLoS Comput Biol. 2009; 5(1):1000256.
Kwon YK, Cho KH. Quantitative analysis of robustness and fragility in biological networks based on feedback dynamics. Bioinformatics. 2008; 24(7):987–94.
Iooss B, Lemaître P. A review on global sensitivity analysis methods. In: Uncertainty management in simulationoptimization of complex systems: 2015. p. 101–22.
Rizk A, Batt G, Fages F, Soliman S. A general computational method for robustness analysis with applications to synthetic gene networks. Bioinformatics. 2009; 25(12):169–78.
Kitano H. Towards a theory of biological robustness. Mol Syst Biol. 2007; 3(1):137.
Perform Parallel Computations on Multicore Computers, GPUs, and Computer Clusters. https://it.mathworks.com/products/parallelcomputing.html.
Helm R, Johnson RE, Gamma E, Vlissides J. Design Patterns: Elements of Reusable Objectoriented Software: Addison Wesley; 2000.
Peng H, Zhao W, Tan H, Ji Z, Li J, Li K, Zhou X. Prediction of treatment efficacy for prostate cancer using a mathematical model. Sci Rep. 2016; 6:21599.
Szallasi Z, Stelling J, Periwal V. System Modeling in Cellular Biology: the MIT Press; 2006.
Alon U. Network motifs: theory and experimental approaches. Nat Rev Genet. 2007; 8(6):450.
Bianconi F, Baldelli E, Ludovini V, Crinò L, Flacco A, Valigi P. Computational model of egfr and igf1r pathways in lung cancer: a systems biology approach for translational oncology. Biotechnol Adv. 2012; 30(1):142–53.
Li C, Donizelli M, Rodriguez N, Dharuri H, Endler L, Chelliah V, Li L, He E, Henry A, Stefan MI, et al.Biomodels database: An enhanced, curated and annotated resource for published quantitative kinetic models. BMC Syst Biol. 2010; 4(1):92.
Borgonovo E. A new uncertainty importance measure. Reliab Eng Syst Saf. 2007; 92(6):771–84.
Bianconi F, Antonini C, Tomassoni L, Valigi P. Robust calibration of high dimension nonlinear dynamical models for omics data: An application in cancer systems biology. IEEE Trans Control Syst Technol. 2018; 99:1–12.
Acknowledgements
The authors would like to thank ICT4life srl group for the helpful discussions about implementation, potential extensions/uses of modules within the algorithm and make freely available a public project with GitLab ICT4life repository.
We thank Italian Association of Cancer Research (AIRC) for supporting this work.
Funding
CA and TL are funded by Italian Association for Cancer Research (AIRC) grant 15713/2014. The funding body had no role in the design of the study and collection, analysis, interpretation of data and in writing the manuscript.
Author information
Authors and Affiliations
Contributions
FB, CA, and LT conceived and designed the toolbox. FB, CA and LT wrote the code. CA and LT wrote the user’s documentation and developed the examples. FB, CA, LT and PV wrote the paper. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional files
Additional file 1
This .pdf file is a detailed description of all the classes and methods implemented in the tool and it is a useful guide for users to understand how to run and use the software package. (PDF 62 kb)
Additional file 2
This .png file is a screenshot of the first part of the GUI of the CRA Toolbox. (PNG 47 kb)
Additional file 3
This .png file is a screenshot of the second part of the GUI of the CRA Toolbox. (PNG 60 kb)
Additional file 4
This .pdf file is the user guide of the CRA Toolbox. (PDF 327 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Bianconi, F., Antonini, C., Tomassoni, L. et al. CRA toolbox: software package for conditional robustness analysis of cancer systems biology models in MATLAB. BMC Bioinformatics 20, 385 (2019). https://doi.org/10.1186/s128590192933z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s128590192933z