 Research
 Open Access
 Published:
Validation of a yellow fever vaccine model using data from primary vaccination in children and adults, revaccination and doseresponse in adults and studies with immunocompromised individuals
BMC Bioinformatics volume 21, Article number: 551 (2020)
Abstract
Background
An effective yellow fever (YF) vaccine has been available since 1937. Nevertheless, questions regarding its use remain poorly understood, such as the ideal dose to confer immunity against the disease, the need for a booster dose, the optimal immunisation schedule for immunocompetent, immunosuppressed, and pediatric populations, among other issues. This work aims to demonstrate that computational tools can be used to simulate different scenarios regarding YF vaccination and the immune response of individuals to this vaccine, thus assisting the response of some of these open questions.
Results
This work presents the computational results obtained by a mathematical model of the human immune response to vaccination against YF. Five scenarios were simulated: primovaccination in adults and children, booster dose in adult individuals, vaccination of individuals with autoimmune diseases under immunomodulatory therapy, and the immune response to different vaccine doses. Where data were available, the model was able to quantitatively replicate the levels of antibodies obtained experimentally. In addition, for those scenarios where data were not available, it was possible to qualitatively reproduce the immune response behaviours described in the literature.
Conclusions
Our simulations show that the minimum dose to confer immunity against YF is half of the reference dose. The results also suggest that immunological immaturity in children limits the induction and persistence of longlived plasma cells are related to the antibody decay observed experimentally. Finally, the decay observed in the antibody level after ten years suggests that a booster dose is necessary to keep immunity against YF.
Background
At the time this paper was written, a significant global outbreak of COVID19 was in course. This pandemic clearly illustrates the need for new tools to assist the fast development of vaccines against emerging or unknown diseases. Even vaccines developed decades ago, such as the yellow fever vaccine (YFV), could benefit from new tools.
Although YFV is considered safe, there are rare but serious adverse effects that need to be reassessed, such as viscerotropic and neurotropic events [1]. There are also questions regarding the safety of vaccinating specific populations such as the elderly, people living with Human Immunodeficiency Virus (HIV)/AIDS, and other immunocompromised populations. Studies suggest that the immunological immaturity of infants and young children limits the induction/persistence of longlived plasma cells [2] and, for this reason, a booster dose is needed. The same occurs with the elderly due to immunosenescence.^{Footnote 1}
In the vaccinology field, computer tools have been used to assist the vaccine development process [4,5,6,7,8,9,10,11,12,13]. Several computational modelling techniques can be used to achieve this objective [14]. Most of them focus on nonclinical trials. In previous work, we proposed a novel application of computer tools to vaccinology in the clinical development stage [15]. With mathematical and computational models, it is possible to evaluate in silico different scenarios related to vaccination and answer important questions which remain open, such as the minimal dose that confers immunity and immunity duration. The idea of using computer tools during the clinical development stage was then applied to model the immune response to the YFV [1, 16]. Results showed that mathematical models could capture the immune response to the YFV, and in subsequent work the model was validated quantitatively [17]
This work presents new numerical experiments showing that our model can reproduce experimental data from scenarios such as booster dose, immune response in individuals under immunomodulatory therapy, and primovaccination in children. We also discuss, in more detail, simulations for primovaccination in adults and doseresponse, extending the initial results obtained in a previous work [17].
Another work in the literature also uses an ODEbased approach to model the human immune response to vaccination against both YF and smallpox [18] using distinct data and equations sets, one for each disease. The authors aimed to primarily evaluate the dynamics of CD8+ T cells, while our work evaluates the immune response as a whole. The model proposed here differs from that presented by Le et al. [18], since it considers important populations at each stage of the immune response to YF vaccination, from virus inoculation to antigen presentation and consequent activation of lymphocytes, generation of antibodies, and memory cells. Furthermore, our validated model is a great tool to assist specialists in answering some open questions regarding YFV, which were not taken into account by Le et al. [18].
Results
This section presents the predictions of the mathematical model presented in “Methods” section, comparing them with experimental data from several studies conducted by the Immunobiological Technology Institute (BioManguinhos)/Oswaldo Cruz Foundation (BioManguinhos/FIOCRUZ), René Rachou Research Center/Oswaldo Cruz Foundation (FIOCRUZ/Minas) and University of Brasilia (UnB) on human YFV [3, 19,20,21,22,23,24,25], such as viremia and antibody titers,^{Footnote 2} for distinct scenarios. For all experimental data, we present antibody interquartile range, lower limit, and upper limit. In order to facilitate comparison with numerical results, we also present the geometric mean of the experimental antibody titers (GMT—Geometric Mean Titers).
The first scenario simulates an adult individual being vaccinated for the first time with the full dose of the vaccine against YF. The second scenario represents the revaccination of adult individuals. There are situations in which some individuals’ immune response differs from the response usually obtained by vaccination in immunocompetent adults. This is the case of children and individuals with autoimmune diseases, respectively, the third and fourth scenarios. Finally, the fifth scenario evaluates the use of different doses of the vaccine against YF, all below the full dose.
Numerical results are presented and compared to experimental data [3, 19,20,21,22,23,24,25]. More specifically, experimental results from primary vaccination in adults, booster dose in adults, primovaccination in children and individuals using immunomodulatory therapy, and doseresponse studies are used to qualitatively and quantitatively validate the numerical results obtained by the mathematical model. A quantitative comparison was performed when experimental and numerical results were in the same unit. However, in some scenarios, the results generated by the model and the experimental data are in different units, mIU/mL, and reciprocal dilution, respectively. This is due to the experimental method used. Neutralising antibody levels in serum was measured by the Plaque Reduction Neutralisation Test (PRNT), either in reciprocal dilution or in International Units. If the standard serum for quantification in International Units is available, this unit’s values are also obtained. What often occurs is the lack of this serum and, consequently, the lack of values in the mIU/mL unit, which precludes a quantitative comparison. For these cases, graphics are constructed with two Yaxes, each representing a unit. The experimental data in reciprocal dilution will be represented by the Yaxis on the left, while the results obtained by the model simulation, in mIU/mL, will be represented by the Yaxis on the right. This allows for a qualitative assessment of the model’s results, by comparing the trends it predicts with those observed experimentally.
First scenario: primovaccination in adults
The first scenario was used to calibrate the model. In other words, its parameters and initial conditions were chosen to reproduce the experimental results of an individual vaccinated for the first time against YF using the full dose of the vaccine developed by BioManguinhos/Fiocruz (17DDYFV). After the model was calibrated, most of the parameters and initial conditions values found were kept for the experiments presented in the next sections.
After vaccination, the antibody levels of the subjects who participated in the experiment were measured at different times. These samples were grouped in the following way:

NV (day 0): Naïve (NV), immediately before vaccination;

PV (30–45 days): primovaccinated (PV), 30–45 days after vaccination;

PV (1–5 years): 1–5 years after vaccination;

PV (> 5–9 years): 5–9 years after vaccination;

PV (10 years): 10 years or more after vaccination.
These groups, in general, will also be used for other studies that will be described in the following sections.
Figure 1 shows the comparison between the levels of antibodies obtained experimentally and numerically, after calibration. These are crosssectional data so that different individuals will be represented in the categories of postvaccination time described above and the same categories are used to present numerical results. A pattern of marked increase in antibody levels 30–45 days after vaccination and a reduction, which was more pronounced after 1–5 years but was sustained for 10 years after vaccination.
The model errors were computed for each postvaccination intervals and the results obtained are shown in Table 1. The model errors were small, an evidence that the model is likely suitable, and has been successfully calibrated.
Figure 2 presents experimental data and numerical results for the entire time simulated, which was 5000 days. Although experimental data for this scenario were used to adjust the model, as one can observe, experimental data are restricted to some days. Due to the total simulation time, it is not possible, in main graph, to observe the model results and experimental data for the two initial groups, NV and PV (30–45 days). To facilitate the visualisation of the curve in the first days of simulation, a secondary graphic is presented in the same figure, which presents experimental data only for the first 100 days after vaccination, as well as the numerical results.
It is possible to notice in Fig. 2 that, between days 1 and 41, no experimental data were obtained. Thus, it was not possible to make the adjustment or even evaluate the quality of the curve generated by the model in this interval.
A booster dose is required if the antibody level is below the the seropositivity threshold. Figure 3 presents the simulation for 10,000 days after the first vaccination. As one can observe, the curve generated by the model for a single dose suggests that the amount of antibodies is below the protective level about 10,000 days after vaccination, thus indicating the need of administration of a booster dose.
Second scenario: booster dose in adults
In addition to assessing the immune response to the first dose of the YFV, the Fiocruz research group also collected experimental data from revaccinated (RV) individuals. In this study, the antibody levels of the subjects who participated in the experiment were measured at different times, and these samples were grouped in the following way:

PV (> 5–9 years): 5–9 years after first vaccination;

PV (10 years): 10 years or more after first vaccination;

RV (30–45 days): 30–45 days after booster dose;

RV (1–5 years): 1–5 years after booster dose;

RV (> 5–9 years): 5–9 years after booster dose;

RV (10 years): 10 years or more after booster dose.
Data obtained for this scenario were used to validate the model, without changing or adjusting the parameters and initial values found during calibration. For this purpose, the following method was adopted. Initially, a simulation of a primovaccinated individual was performed. After simulating the equivalent of 5500 days since the application of the vaccine, the simulation was paused, the current values for all populations of the model were saved and only the value associated to the virus population was modified, from its current value, zero, to the adjusted full vaccine dose. The simulation was then resumed, 4500 additional days were simulated to reach 10,000 days.
These specific numbers of days after vaccination, 5500 and 10,000, were chosen based on experimental data available. The PV group (10 years), that is, adult individuals 10 years after the first vaccine dose, had samples collected up to 5475 days (15 years) after vaccination. For this reason, the booster dose was simulated in the model 5500 days after the first dose. Likewise, in the RV group (10 years), individuals 10 years after the booster dose, had samples collected up to 3650 days after the second dose, and consequently up to 9125 days after the first dose. For this reason, the simulation was for 10,000 days after application of the first dose.
Figure 4 presents experimental data and numerical results for the booster dose scenario. Units for model predictions ( ) and the experimental data differ, as the latter was only available in terms of reciprocal dilution.
Third scenario: primovaccination in children
As mentioned in “Background” section, immune response in child is less pronounced than in adults. Some hypotheses explain these differences: immunological immaturity limits the induction and persistence of longlived plasma cells [27]. Longlived plasma cells are largely responsible for longterm secretion of antibodies [28].
In this scenario, these two possibilities (limitation of induction and persistence) were evaluated numerically. For this purpose, changes were made only to the values of parameters related to these hypotheses, without any further modification, except for the weight of the individual being simulated and the initial condition for the antibody population. Table 10 shows the weight, and percentage of fluids in the body that was used as a basis for calculating the initial condition of the virus that would be used in simulations of adults and children, as well as the initial amount of antibodies used for each population.
The hypothesis that immunological immaturity limits the persistence of longlived plasma cells was evaluated increasing the natural death rate for this type of cells (represented by parameter \(\delta _{pl}\)). However the simulations showed that changes in this value had no significant effect on the antibodies curve and, for this reason, this result was omitted. The hypothesis that the immunological immaturity limits the induction of longlived plasma cells was tested reducing the rate of differentiation of B cells into longlived plasma cells (\(\beta _{pl}\)). There was a noticeable reduction in the lifelong memory by changing only this parameter. The simultaneous alteration of \(\beta _{pl}\) and \(\delta _{pl}\) was also evaluated. Although the change in \(\delta _{pl}\) alone did not produce a significant reduction in antibodies, when combined with changes in \(\beta _{pl}\) value, the results produced the best fit to reproduce experimental data, which are described in this section.
A range of values were tested for \(\beta _{pl}\) and \(\delta _{pl}\). The simulation using a reduction of approximately 70% of the value associated to the parameter \(\beta _{pl}\) and an increase of 100% of the value associated to the parameter \(\delta _{pl}\) used for adults produced the best fit to reproduce qualitatively the immune response of children. The values of \(\beta _{pl}\) in the model were \(1.68\times 10^{6}\) and \(5.61\times 10^{6}\) to simulate children and adults, respectively. The values of \(\delta _{pl}\) in the model were \(2.4\times 10^{4}\) and \(4.8\times 10^{4}\) to simulate children and adults, respectively. Figure 5 shows that numerical results were able to reproduce the same behaviour observed in experimental data: an initial rapid increase in the amount of antibodies is followed by a decrease over the course of time. It should also be noted that these are crosssectional data, so that antibody levels in postvaccination times are from different children.
To facilitate the comparison between the immune response of adults and children when vaccinated against YF, experimental data and numerical results for these two groups are shown in Fig. 6. For adults and children, the experimental data in reciprocal dilution (Yaxis on the left) allow direct comparison. Conversely, results from the numerical experiment in mIU/mL (Yaxis on the right), allow comparisons of patterns only.
Fourth scenario: immune response in individuals using immunomodulatory therapy
A study found in the literature [25] reports differences in the immune response to the YFV in groups of individuals using different types of immunomodulatory therapies. The therapies covered in the study are divided into two main groups, those that use only synthetic DMARDs (diseasemodifying antirheumatic drugs) and those that use a combination of biological and synthetic drugs. According to the study [25], DMARDs have the ability to modify or affect the preexisting protective immunity induced by the vaccine, including the function of memory T and B cells and, as a consequence, the neutralising antibody levels specific to YF. The biggest difference was found when comparing the control group, that is, individuals without any autoimmune disease, with the group using combination therapy.
The hypotheses found in the literature to explain how DMARDs affects the preexisting protective immunity induced by the vaccine [25] were evaluated using the model. Again, changes were made only in the parameters related to the hypotheses, keeping the other values found during calibration. Simulations of individuals in two conditions, control and under the use of combination therapy, were carried out. For simulating individuals under use of combination therapy, changes were tested in the values of all parameters of the equation that describes the dynamics of B cells, as well as in their initial conditions. The following alterations were able to reproduce the antibody levels of individuals using combination immunomodulatory therapy:

\(50\%\) reduction in \(\alpha _b\) parameter (B cell homeostasis rate);

\(25\%\) reduction in parameter \(\beta _{pl}\) (B cell differentiation rate in longlived plasma cells);

\(25\%\) reduction in B cell initial condition.
These three alterations, reduction in \(\alpha _b\), reduction in \(\beta _{pl}\), and reduction in B cell initial condition, produced very similar results: all of them reproduced the immune response of an individual with autoimmune disease using combination immunomodulatory therapy. For this reason, only one of the results is presented in this section, the one which reduces the initial condition of B cells by 25%. The reduction percentages were chosen after carrying out several tests with distinct values for the parameters and initial condition of B cells. The values that produced the best adjustments in the levels of antibodies generated by the model to the experimental data obtained for the individuals in use of combination immunomodulatory therapy were chosen and are shown in Table 2.
Figure 7 presents experimental and numerical data for control individuals and those using immunomodulatory therapy. In this figure, the numerical results modify only the value associated to the initial condition of B cells (B0).
Fifth scenario: doseresponse
The literature [3] reported that doses from 27,476 IU to 587 IU of the YFV induced seroconversion rates and similar GMT in the participants of the experiment. Based on that study, we simulated the immune response after the administration of different doses of the YFV. This was done changing the values used as the initial virus condition in the model to be the same described in the literature [3]. These values adopted as initial condition were computed considering the dilution of the vaccine in the body, as well as the conversion of the units, as presented in “Experimental data” section. The values of all other parameters were kept the same.
Mean antibody titers 30–45 days after vaccination generated by model simulation approximated the actual data in the doseresponse study, which also used International Units (Fig. 8). The data showed that antibody levels increased with vaccine doses up to 587 mIU, above which no further increase in antibody levels was achieved.
Antibody levels generated by the model (Fig. 9) showed a pattern of marked increase with a peak within 20 days of vaccination, somewhat earlier and much lower for vaccine doses 31 mIU and 158 mIU. According to the model, vaccine doses 587 mIU and above induced and sustained similar antibody levels for 1000 days. The main graphic presents the antibody levels curves until 1000 days of vaccination. To better observe the curve behaviour in the first days after vaccination, a secondary graphic on the upper right presents the same result for the first 100 days after vaccination.
Figure 10 presents the numerical results for viremia curves, considering distinct vaccine doses. The main graphic does not allow a detailed observation of the curves for the smaller doses and, for this reason, a secondary graphic on the upper right presents a zoom in this figure, allowing one to observe that viremia for some of smaller doses is not equal to zero.
Discussion
The immune response to vaccination was successfully modelled in several of its relevant components presented in different scenarios. In general, the immune response described by the model provided a reasonable approximation of empirical data showing that it was built on sound mathematical relations of the key parameters.
The first scenario, primovacciation in adults, was used to adjust model parameters and initial conditions. As one could expect, the observed error presented in Table 1 was very low, below 3%. For the fifth scenario, the doseresponse experiment, except for the lowest dose whose error was about 13%, for all other doses the errors were bellow 2.5%, as Table 3 reveals. This result showed that the model, that was adjusted using only data from individuals vaccinated with the full dose, was able to satisfactorily reproduce the immune response obtained with vaccination using doses lower than the full one. For all other simulated scenarios, it was not possible to make a similar quantitative analysis either because data were not available, or because units were different. Experimental data available for antibody levels use reciprocal dilution as unit, while the model uses mIU/mL, and one unit cannot be converted into the other one with available data. Thus, it is not possible to say, for example, that an increase of 50% in the level of antibodies expressed in reciprocal dilution means an increase of the same 50% expressed in mIU/mL.
A similar pattern in experimental data and model outputs was observed in Fig. 4, in “Second scenario: booster dose in adults” section. Reduced antibody levels in individuals vaccinated 5–9 and 10 years before, were followed by a pronounced rise after a booster dose and a marked reduction after 1–5 years. Antibody levels 10 years after revaccination were almost as low as those before the booster dose.
Despite the difference in the units adopted, it was possible to notice in Fig. 5, in “Third scenario: primovaccination in children” section, that the numerical results were able to reproduce the same behaviour observed in experimental data: an initial rapid increase in the amount of antibodies is followed by a decrease over time.
As presented in Fig. 6, also in “Third scenario: primovaccination in children” section, experimental data showed that there is an evident difference in the levels of antibodies produced by adults and children. It should be noted that the model was adjusted using data from adults expressed in mIU/mL, and therefore it is not the same unit used in experimental data, which are expressed in reciprocal dilution. Still, in a qualitative way, the numerical results were able to capture this behaviour: a lower level of antibodies in children than in adults.
Three reductions in constant/initial condition values (\(\alpha _b\), \(\beta _{pl}\), and B cell initial condition) numerically evaluated in this work could explain the immune response in individuals using immunomodulatory therapy. These results could change if other aspects of the way DMARDs work in the body, and its mechanisms of interaction with each type of cell, were also considered. Some mechanisms involve the production and/or inhibition of cytokines that were not yet considered in the model.
The model was able to reproduce distinct scenarios related to the immune response to vaccination against YF. For this reason, we decided to use it to obtain some clues about the questions that remain unanswered or poorly understood about the vaccine. The first clue is that, among all evaluated doses, the lowest dose capable of conferring immunity is half of the minimum recommended by the WHO, as the numerical experiments in “Fifth scenario: doseresponse” section show. The results presented in Fig. 9 show that the antibody curve is almost the same for all doses above 587 IU; these results are similar to those presented in the literature [3].
The second clue is related to the hypothesis that immunological immaturity in children limits the induction and persistence of longlived plasma cells. Numerical results confirmed that both are responsible for the differences observed in experimental results of adults and children, and that persistence of longlived plasma had no significant effect on the antibody curves alone.
The third clue is related to the need of booster dose. A single dose apparently (as suggested by the results in Fig. 3) did not provide long lasting protection. The decay rate in the antibody level suggests that the booster dose is needed to maintain protection. In fact, about 10,000 days after vaccination, the level of antibodies in an adult is below the protective level if a single dose is given. If a booster dose is given, the protection level is improved, as depicted in Fig. 4. Moreover, the single dose is usually given to infants or children, which induces a lower amount of longlived plasma cells than adults, which reinforces the need of booster doses throughout life.
Some considerations and limitations of the model used in this study should be highlighted. The model was adjusted to reflect the geometric mean of the experiments. In this sense, conclusions reflect the typical immune response from the average individual described in Tables 10 and 11. Some individuals with distinct characteristics, such as the immunological immaturity of children or a compromised immune system due to some disease should, for example, receive a booster dose of the YFV in a shorter period of time. Furthermore, the extrapolation done to predict the antibody level after 10,000 days may suffer from the classical overfitting problem, where the model can replicate the data it is adjusted to but fails on any attempt of extrapolation or forecasting. Finally, other aspects that may influence the minimal dose to confer immunity against YF were not taken into account, such as problems with virus dieoff during transport.
Conclusions
This work presented the quantitative and qualitative validation of a mathematicalcomputational model to represent the immune response to the YFV using five distinct scenarios. The first one simulates the immune response to the administration of the full dose of the 17DDYFV for the first time. The second one simulates the immune response to distinct doses of vaccine. The third scenario simulates the administration of a booster dose ten years after the first dose. The fourth simulates the vaccination in individuals under immunomodulatory therapy. Finally, the last one simulates the primary vaccination in children. The numerical results were collected and compared to experimental data. Some results could be compared directly, and errors below 10% were observed. For other results that could not be compared directly, because distinct units were used, it was observed that the numerical results obtained by the computational model satisfactorily reproduced the behaviour observed in experimental data.
The numerical experiments show that among all vaccine doses evaluated, the lowest one capable of conferring immunity against YF is about half of the reference dose, 587 UI. The results also suggest that the hypothesis that the immunological immaturity in children limits longlived plasma cells’ persistence is not related to the antibody decay observed experimentally. The numerical experiments show that this phenomenon is due to the lower induction of longlived plasma cells. Finally, the antibody level’s decay within the ten years following vaccination suggests that a booster dose is necessary to keep immunity against YF.
Although the model presented in this work focuses on the YFV, it could be used to gain new insights in the immune response to vaccine canditates, such as those for COVID19.
We also plan, as future work, to refine the model to guide future empirical studies: (1) to determine the optimal number of doses to ensure protection against YF; (2) to determine the duration of immunity with two vaccine doses in infants; (3) to determine the interval between these two doses given to infants to maximise the duration of immunity, and (4) conduct a doseresponse study in infants.
Methods
Mathematical model
The model used in this work consists of a system of ordinary differential equations (ODEs), which were originally proposed in a previous work [1, 17], and reproduced here. These equations represent the main populations involved in the immune response to the vaccination, as well as the virus itself. They are yellow fever vaccine virus, APCs (Antigenpresenting cells), CD4\(+\) T cells, CD8\(+\) T cells, short and longlived plasma cells, B cells, memory B cells, and antibodies. The initial conditions and acronyms of these populations, as well as the parameters and their meanings, are presented in Tables 11 and 12, respectively, which are presented in “Appendix”.
Equation (1) represents the vaccine virus (V):
The virus can not proliferate by itself. It needs to infect a cell and use it as a factory for new viruses. This mechanism is implicitly considered in the term \(\pi _v V\), which represents the multiplication of the virus in the body, with a production rate \(\pi _v\). The term \(\frac{c_{v1} V}{c_{v2} + V}\) denotes a nonspecific viral clearance made by the innate immune system. This function models growth combined with a saturation effect [29]. The term \(k_ {v1} V A\) denotes specific viral clearance due to antibody signalling, where \(k_ {v1}\) is the clearance rate. The term \(k_ {v2} V T_{ke}\) denotes specific viral clearance due to the induction of apoptosis of cells infected by the YF virus, where \(k_ {v2}\) is the clearance rate.
APCs are all cells that display antigens complexes on their surfaces, such as dendritic cells and macrophages. Two stages of APCs were considered: immature and mature. The first stage, immature APCs (\(A_{p}\)), is described by Eq. (2):
The term \(\alpha _{ap} (A_{p0}  A_p)\) describes the homeostasis of APCs, where \(\alpha _{ap}\) is the homeostasis rate. The term \(\beta _{ap} A_p \frac{c_{ap1} V}{c_{ap2} + V}\) denotes the conversion of immature APCs into mature ones. So the same term appears in Eq. (3) with positive sign.
The Eq. (3) represents the mature APCs (\(A_{pm}\)):
The first term, as just explained, denotes the dynamics of APCs maturation. The second term, \(\delta _{apm}A_{pm}\), means the natural decay of the mature APCs, where \(\delta _{apm}\) is the decay rate.
Equation (4) represents the population of naïve CD4+ T cells (\(T_{hn}\)):
The term \(\alpha _{th} (T_{hn0}  T_{hn})\) represents the homeostasis of CD4+ T cells, where \(\alpha _{th}\) is the homeostasis rate. The term \(\beta _{th} A_{pm} T_{hn}\) denotes the activation of naïve CD4+ T cells, where \(\beta _{th}\) is the activation rate.
Equation (5) represents the effector CD4+ T cell population (\(T_{he}\)):
The term \(\pi _{th} A_{pm} T_{he}\) represents the proliferation of effector CD4+ T cells. The term \(\delta _{th} T_{he}\) represents the natural death of these cells, with \(\delta _{th}\) representing its decay rate.
The mechanisms used to represent CD4+ T cells were also used to model the dynamics of CD8+ T cells. Equations (6) and (7) represent the population of naïve (\(T_{kn}\)) and effector (\(T_{ke}\)) CD8+ T cells:
The term \(\alpha _{tk} (T_{kn0}  T_{kn})\) represents the homeostasis of CD8+ T cells, where \(\alpha _{tk}\) is the homeostasis rate. The term \(\beta _{tk} A_{pm} T_{kn}\) denotes the activation of naïve CD8+ T cells, where \(\beta _{tk}\) is the activation rate. The term \(\pi _{tk} A_{pm} T_{ke}\) represents the proliferation of effector CD8+ T cells, where \(\pi _{tk}\) is the activation rate. The term \(\delta _{tk} T_{ke}\) represents the natural death of these cells, with \(\delta _{tk}\) representing its decay rate.
Equation (8) represents B cells (B), both naïve and effector ones. These populations were not considered separately in order to simplify the model.
The term \(\alpha _b (B_0  B)\) represents the B cells homeostasis, where \(\alpha _b\) is the homeostasis rate. The terms \(\pi _{b1} V B\) and \(\pi _{b2} T_{he} B\) represent the proliferation of B cells activated by the Tcell independent and Tcell dependent mechanisms, respectively. The terms \(\beta _{ps} A_{pm} B\), \(\beta _{pl} T_{he} B\) and \(\beta _{bm} T_{he} B\) denote the differentiation of active B cells into shortlived plasma cells, longlived plasma cells and memory B cells, respectively. The activation rates are respectively given by \(\beta _{ps}\), \(\beta _{pl}\) and \(\beta _{bm}\).
Equation (9) represents the shortlived plasma cells (\(P_s\)):
The term \(\delta _{ps} P_s\) denotes the natural decay of shortlived plasma cells, where \(\delta _{ps}\) is the decay rate.
Equation (10) represents the longlived plasma cells (\(P_l\)):
The term \(\delta _{pl} P_l\) denotes the natural decay of longlived plasma cells, with \(\delta _{pl}\) representing the decay rate. The term \(\gamma _{bm} B_m\) represents the resupply of these cells by memory B cells, where \(\gamma _{bm}\) is the production rate.
Eq. (11) corresponds to memory B cells (\(B_m\)):
The term \(\pi _{bm1} B_m\left( 1  \frac{B_m}{\pi _{bm2}}\right)\) represents the logistic growth of memory B cells, i.e., there is a limit to this growth. \(\pi _{bm1}\) represents the growth rate, and \(\pi _{bm2}\) limits the growth.
Finally, Eq. (12) represents the antibodies:
The terms \(\pi _{ps} P_s\) and \(\pi _{pl}P_l\) are the production of the antibodies by the shortlived and longlived plasma cells, respectively. The production rates are given by \(\pi _{ps}\) and \(\pi _{pl}\), respectively. The term \(\delta _a A\) denotes the natural decay of these cells, where \(\delta _a\) is the decay rate.
Computational model
The model was implemented in the Python programming language. Numerical solution of the system of ODEs performed by the odeint function, a member of the integrate package in the scipy library [30]. This function uses the characteristics of the ODE system to select the numerical method used, with adaptivity in both timestep and convergence order.
The experiments were performed using Python version 3.7.5 using the Spyder integrated development environment (IDE). The execution environment was composed of an Intel Core i5 1.6 GHz processor, with 8 GB of RAM. The system runs macOS Mojave version 10.14.6.
Experimental data
The first set of experimental data used was the one that presents markers of the immunological response to the vaccine against YF in adults who were primed and revaccinated. The Tables 4 and 5 present a summary of data that were used for the primed individuals [31] and Table 6 for revaccinated individuals [24]. The antibody data presented in the tables represent the geometric mean of the antibody titers (GMT  Geometric Mean Titers) of all individuals in each group.
Tables 7 and 8 present a summary of data that were used on vaccination against YF in children [19, 20] and individuals using immunomodulatory therapy [25], respectively. Table 9 summarises data on antibody levels from the study evaluating the dose versus response [3, 22, 23].
It is possible to observe in these tables a difference in the unit of the antibody titers (mIU/mL and reciprocal dilution). The test that is normally performed for the quantification of antibodies, PRNT, generates results in reciprocal dilution. When, at the time of testing, the standard serum for quantification in International Units was available, the value in this unit was also obtained. What often occurs was the lack of this serum and consequently the lack of values in mIU/mL.
Thus, in some experiments, the levels of antibodies were expressed in mIU/mL while in others, in the reciprocal dilution. The unit adopted by the model for the concentration of antibodies is mIU/mL and data in that unit were used for a quantitative validation of the model. However, data expressed in reciprocal dilution were also used in the validation of the model, but in a qualitative way.
Experimental data versus numerical results
One of the main changes made in our previous work [1], after access to experimental data, was to adjust the units used in the model. The amount of vaccine virus used as the model’s initial condition was one of these changes. Previously [1], the value 27,476 IU was used, which is the average amount of virus present in the full dose, that is, in 0.5 mL. Variations in the amount of virus across vaccine lots were not considered. But now it is considered that, from the moment the vaccine is injected into an individual, it is diluted in the volume of fluids that the individual has in the body, something around 65% of the body weight (Table 10 shows the weight and percentage of fluids in the body used for adults and children). In addition, in this paper, a comparison between experimental data and the viremia curve generated by the model is done. The unit used in experimental viremia data is copies/mL, that is, number of viral particles per millilitre. To compare numerical and experimental data, both results must be expressed in the same unit. It is then necessary to convert from IU/dose (27,476 IU in 0.5 mL of the dose) to IU/mL of liquid in the body. After that, the value found has to be converted to PFU/mL^{Footnote 3} using the relationship 1 IU = 1.91 PFU [3]. To convert from PFU/mL to copies/mL, a relationship found in the literature [32], and presented in Eq. (13), was used:
With respect to other populations, except for antibodies, the values used in our previous work [1] were number of cells found in 1 \(\upmu\)l, and for this reason, they were multiplied by \(10^3\) to be converted to mL. These changes in initial conditions forced us to also readjust the model parameters.
Finally, it was observed in experimental data that, even before adults were vaccinated, some of them already had antibodies against YF. There are some hypotheses to justify the presence of antibodies prior to vaccination, one of them is the cross protection caused by contact with others flavivirus, such as the dengue virus, for example [33]. But perhaps the most likely is a previous non recorded vaccination. Due to this observation, the initial condition of the model that represents the antibody concentration in adults was set to a value similar to that observed experimentally, a value around 150 mIU/mL. For children, this value was defined as zero.
It is necessary to clarify how comparisons between experimental and numerical data were done. For all scenarios (first vaccination in adults, booster dose in adults, primovaccination in children and individuals using immunomodulatory therapy, and doseresponse), regardless of the units, data from several individuals exist at different postvaccination time intervals. For the same day there are one or more individuals and the values found may vary due to differences in immune responses that can be caused by numerous factors such as medication use, genetic inheritance, habits and many others.
Experimental data were already been grouped by postvaccination time interval and this division was kept. For each group there are individuals spread over the entire timeinterval range, which makes it difficult to identify trends in data sets. For this reason, it was decided to present data in a box diagram format (boxplot), thus facilitating a summary view of data for each of the intervals. To each boxplot it has been added the geometric mean of the antibody titers (GMT), defined as the nth root of the product of n terms and calculated using the formula presented in Eq. (14):
To compare experimental and numerical data, not only the geometric mean of the antibody titers were computed for experimental data, but it was also necessary to compute it for the numerical results. This was done as follows. For the same days where experimental antibody titers exist, the numerical results were estimated. Then we computed the GMT of the numerical values found for these days. For example, suppose that a given group (30–45 days) has five individuals with antibody titers obtained on days 32, 35, 41, 43, and 45. The geometric mean was computed using the levels of antibodies estimated by the model in those same days.
Availability of data and materials
Model parameters and initial conditions used in simulations are included in this published article. Code to solve the mathematical model can be made available upon request to the authors.
Notes
 1.
State of unregulated immune function in the elderly, which contributes to increased susceptibility to infections, cancer and autoimmunity, and reduced vaccine response. Other controversial issues are: (a) the need for a booster dose also for immunocompetent adults, and (b) the lower vaccine dose that is as immunogenic and safe as the current formulation [3].
 2.
Antibody titer indicates the level of antibodies in a blood sample, defined as the largest dilution of the blood sample with a dilution agent in which an assay, such as ELISA, still produces a positive result [26].
 3.
PlaqueForming Unit is a measure of the number of particles, such as viral particles, capable of forming plaques (visible structures formed within a cell culture) per unit of volume.
Abbreviations
 YF:

Yellow fever
 YFV:

Yellow fever vaccine
 HIV:

Human Immunodeficiency Virus
 GMT:

Geometric mean titers
 PRNT:

Plaque Reduction Neutralisation Test
 NV:

Naïve volunteers
 PV:

Primary vaccinated volunteers
 RV:

Revaccinated volunteers
 DMARDs:

Diseasemodifying antirheumatic drugs
 ODEs:

Ordinary differential equations
 APCs:

Antigenpresenting cells
 IDE:

Integrated development environment
References
 1.
Bonin CR, Fernandes GC, dos Santos RW, Lobosco M. A qualitatively validated mathematicalcomputational model of the immune response to the yellow fever vaccine. BMC Immunol. 2018;19(1):15.
 2.
Siegrist CA. Vaccine immunology. In: Plotkin’s vaccines. Amsterdam: Elsevier; 2018. p. 16–34.
 3.
Martins RM, Maia MdLS, Farias RHG, Camacho LAB, Freire MS, Galler R, Yamamura AMY, Almeida LFC, Lima SMB, Nogueira RMR, et al. 17dd yellow fever vaccine: a double blind, randomized clinical trial of immunogenicity and safety on a doseresponse study. Hum Vaccines Immunother. 2013;9(4):879–88.
 4.
Kumar N, Hendriks BS, Janes KA, de Graaf D, Lauffenburger DA. Applying computational modeling to drug discovery and development. Drug Discov Today. 2006;11(17):806–11. https://doi.org/10.1016/j.drudis.2006.07.010.
 5.
Groot ASD, Bosma A, Chinai N, Frost J, Jesdale BM, Gonzalez MA, Martin W, SaintAubin C. From genome to vaccine: in silico predictions, ex vivo verification. Vaccine. 2001;19(31):4385–95. https://doi.org/10.1016/S0264410X(01)001451.
 6.
Parvizpour S, Pourseif MM, Razmara J, Rafi MA, Omidi Y. Epitopebased vaccine design: a comprehensive overview of bioinformatics approaches. Drug Discov Today. 2020;. https://doi.org/10.1016/j.drudis.2020.03.006.
 7.
Tanwer P, Kolora SRR, Babbar A, Saluja D, Chaudhry U. Identification of potential therapeutic targets in neisseria gonorrhoeae by an insilico approach. J Theor Biol. 2020;490:110172. https://doi.org/10.1016/j.jtbi.2020.110172.
 8.
Pennisi M, Russo G, Sgroi G, Bonaccorso A, Parasiliti PG, Fichera E, Mitra D, Walker K, Cardona PJ, Amat M, Viceconti M, Pappalardo F. Predicting the artificial immunity induced by ruti^{®} vaccine against tuberculosis using universal immune system simulator (UISS). BMC Bioinform. 2019;20:1–10. https://doi.org/10.1186/s1285901930455.
 9.
Ibrahim EH, Taha R, Ghramh HA, Kilany M. Development of Rift Valley fever (RVF) vaccine by genetic joining of the RVFglycoprotein Gn with the strong adjuvant subunit B of cholera toxin (CTB) and expression in bacterial system. Saudi J Biol Sci. 2019;26(7):1676–81. https://doi.org/10.1016/j.sjbs.2018.08.019.
 10.
Pritam M, Singh G, Swaroop S, Singh AK, Pandey B, Singh SP. A cuttingedge immunoinformatics approach for design of multiepitope oral vaccine against dreadful human malaria. Int J Biol Macromol. 2020;. https://doi.org/10.1016/j.ijbiomac.2020.04.191.
 11.
De Groot AS, Moise L, Terry F, Gutierrez AH, Hindocha P, Richard G, Hoft DF, Ross TM, Noe AR, Takahashi Y, Kotraiah V, Silk SE, Nielsen CM, Minassian AM, Ashfield R, Ardito M, Draper SJ, Martin WD. Better epitope discovery, precision immune engineering, and accelerated vaccine design using immunoinformatics tools. Front Immunol. 2020;11:442. https://doi.org/10.3389/fimmu.2020.00442.
 12.
Bhattacharya M, Sharma AR, Sharma G, Patra P, Mondal N, Patra BC, Lee SS, Chakraborty C. Computer aided novel antigenic epitopes selection from the outer membrane protein sequences of aeromonas hydrophila and its analyses. Infect Genet Evol. 2020;82:104320. https://doi.org/10.1016/j.meegid.2020.104320.
 13.
Khan MAA, Ami JQ, Faisal K, Chowdhury R, Ghosh P, Hossain F, Abd El Wahed A, Mondal D. An immunoinformatic approach driven by experimental proteomics: in silico design of a subunit candidate vaccine targeting secretory proteins of Leishmania donovani amastigotes. Parasit Vectors. 2020;13(1):196.
 14.
Pappalardo F, Flower D, Russo G, Pennisi M, Motta S. Computational modelling approaches to vaccinology. Pharmacol Res. 2015;92:40–5.
 15.
Bonin CRB, Fernandes GC, dos Santos RW, Lobosco M. Mathematical modeling based on ordinary differential equations: a promising approach to vaccinology. Hum Vaccines Immunother. 2017;13(2):484–9.
 16.
Bonin CB, Fernandes GC, dos Santos RW, Lobosco M. A simplified mathematicalcomputational model of the immune response to the yellow fever vaccine. In: 2017 IEEE international conference on bioinformatics and biomedicine (BIBM). Los Alamitos: IEEE Computer Society; 2017. p. 1425–32. https://doi.org/10.1109/BIBM.2017.8217872.
 17.
Bonin CRB, Fernandes GC, Menezes RM, Camacho LAB, da Mota LMH, de Lima SMB, CampiAzevedo AC, MartinsFilho OA, dos Santos RW, Lobosco M. Quantitative validation of a yellow fever vaccine model. In: 2019 IEEE international conference on bioinformatics and biomedicine (BIBM); 2019. p. 2113–20.
 18.
Le D, Miller JD, Ganusov VV. Mathematical modeling provides kinetic details of the human immune response to vaccination. Front Cell Infect Microbiol. 2015;. https://doi.org/10.3389/fcimb.2014.00177.
 19.
LuizaSilva M, CampiAzevedo AC, Batista MA, Martins MA, Avelar RS, da Silveira Lemos D, Bastos Camacho LA, de Menezes Martins R, de Lourdes de Sousa Maia M, Guedes Farias RH, et al. Cytokine signatures of innate and adaptive immunity in 17dd yellow fever vaccinated children and its association with the level of neutralizing antibody. J Infect Dis. 2011;204(6):873–83.
 20.
CampiAzevedo AC, de AraújoPorto LP, LuizaSilva M, Batista MA, Martins MA, SathlerAvelar R, da SilveiraLemos D, Camacho LAB, de Menezes Martins R, de Sousa Maia MdL, et al. 17dd and 17d213/77 yellow fever substrains trigger a balanced cytokine profile in primary vaccinated children. PloS One. 2012;7(12):49828.
 21.
CampiAzevedo AC, CostaPereira C, Antonelli LR, Fonseca CT, TeixeiraCarvalho A, VillelaRezende G, Santos RA, Batista MA, Campos FM, PachecoPorto L, et al. Booster dose after 10 years is recommended following 17ddyf primary vaccination. Hum Vaccines Immunother. 2016;12(2):491–502.
 22.
Martins RdM, Maia MdLS, Lima SMBd, Noronha TGd, Xavier JR, Camacho LAB, Albuquerque EMd, Farias RHG, Castro TdMd, Homma A, et al. Duration of postvaccination immunity to yellow fever in volunteers eight years after a doseresponse study. Vaccine. 2018;36(28):4112–7.
 23.
CampiAzevedo AC, de Almeida Estevam P, CoelhodosReis JG, PeruhypeMagalhães V, VillelaRezende G, Quaresma PF, Maia MdLS, Farias RHG, Camacho, L.A.B., da Silva Freire M, et al. Subdoses of 17dd yellow fever vaccine elicit equivalent virological/immunological kinetics timeline. BMC Infect Dis. 2014;14(1):391.
 24.
Camacho LAB, Collaborative group for studies on yellow fever vaccines, et al. Duration of immunity in recipients of two doses of 17dd yellow fever vaccine. Vaccine. 2019;37:5129–35.
 25.
Ferreira CdC, CampiAzevedo AC, PeruhypeMagalhāes V, CoelhodosReis JG, Antonelli LRdV, Torres K, Freire LC, CostaRocha IAd, Oliveira ACV, Maia MdLdS, et al. Impact of synthetic and biological immunomodulatory therapy on the duration of 17dd yellow fever vaccineinduced immunity in rheumatoid arthritis. Arthritis Res Ther. 2019;21(1):75.
 26.
Simões M, Camacho LAB, Yamamura AM, Miranda EH, Cajaraville ACR, da Silva Freire M. Evaluation of accuracy and reliability of the plaque reduction neutralization test (microprnt) in detection of yellow fever virus antibodies. Biologicals. 2012;40(6):399–404.
 27.
Edwards SPWOPOKM. Plotkin’s Vac. 7th ed. New York: Elsevier; 2018. p. 1720.
 28.
Paul WE. Fundamental immunology. 7th ed. Philadelphia: Wolters Kluwer Health; 2012.
 29.
Goutelle S, Maurin M, Rougier F, Barbaut X, Bourguignon L, Ducher M, Maire P. The Hill equation: a review of its capabilities in pharmacological modelling. Fundam Clin Pharmacol. 2008;22(6):633–48.
 30.
Odeint. Odeint’s homepage; 2020. Accessed on Oct 2020. http://docs.scipy.org
 31.
Camacho LAB, Freire MdS, Leal MdLF, Aguiar SGd, Nascimento JPd, Iguchi T, Lozana JdA, Farias RHG. Immunogenicity of who17d and brazilian 17dd yellow fever vaccines: a randomized trial. Rev. saude publica. 2004;38:671–8.
 32.
FernandesMonteiro AG, Trindade GF, Yamamura AM, Moreira OC, de Paula VS, Duarte ACM, Britto C, Lima SMB. New approaches for the standardization and validation of a realtime qpcr assay using taqman probes for quantification of yellow fever virus on clinical samples with high quality parameters. Hum Vaccines Immunother. 2015;11(7):1865–71.
 33.
Slon Campos JL, Mongkolsapaya J, Screaton GR. The immune response against flaviviruses. Nat Immunol. 2018;19(11):1189–98. https://doi.org/10.1038/s4159001802103.
Acknowledgements
Not applicable.
About this supplement
This article has been published as part of BMC Bioinformatics Volume 21 Supplement 17 2020: Selected papers from the 3rd International Workshop on Computational Methods for the Immune System Function (CMISF 2019). The full contents of the supplement are available at https://bmcbioinformatics.biomedcentral.com/articles/supplements/volume21supplement17
Funding
The authors would like to thank the infrastructure provided by Universidade Federal de Juiz de Fora (UFJF) to perform this study. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)  Brasil  Finance Code 001 (scholarship), Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)  Brasil (scholarship) and Fundação de Amparo à Pesquisa do Estado de Minas Gerais (FAPEMIG)  Brasil (equipments). UFJF has paid the publication costs.
Author information
Affiliations
Consortia
Contributions
Conception and design of the mathematical model: CRBB, RWS and ML. Computational implementation of the mathematical model: CBBB. CRBB has also been involved in drafting the manuscript. RMM, LABC, ATC, LMHM, SMBL, ACCA, OAMF were responsible for the experimental data and their interpretation. GCF participated in writing, providing perspective from the immunological standpoint. CRBB, LABC, ACCA, OAMF, RWS and ML revised the final manuscript. All authors have read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The collection of data for this study was undertaken under a larger project that was approved by the local ethics commitee (CEP IPEC/FIOCRUZ № 052/2008, CEP INI/FIOCRUZ № 1.976.767, and CEP ENSP/FIOCRUZ \(\hbox {N}^{\underline{o}}\) 508.650) All patients filled an institutional form consenting to participate of the studies were data were taken from.
Consent for publication
All patient data were anonymised before evaluation.
Competing interests
Researchers and collaborators include employees of several units of Oswaldo Cruz Foundation (FIOCRUZ, linked to Brazilian Ministry of Health), including BioManguinhos, which is responsible for the production of the YFV used in Brazil.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Bonin, C.R.B., Fernandes, G.C., de Menezes Martins, R. et al. Validation of a yellow fever vaccine model using data from primary vaccination in children and adults, revaccination and doseresponse in adults and studies with immunocompromised individuals. BMC Bioinformatics 21, 551 (2020). https://doi.org/10.1186/s12859020038453
Received:
Accepted:
Published:
Keywords
 Vaccine
 Yellow fever
 Mathematical modeling
 Computational modeling
 Immune system
 Ordinary differential equations