Designing novel cellulase systems through agent-based modeling and global sensitivity analysis

Event Abstract Back to Event Statistical uncertainty and sensitivity analysis of intracellular signaling models - through approximate Bayesian computation and variance based global sensitivity analysis Olivia Eriksson1, 2*, Alexandra Jauhiainen1, 3, Sara Maad Sasane4, Anu G Nair5, Carolina Sartorius4 and Jeanette Hellgren Kotaleski2, 5, 6 1 Contributed equally to this work, Sweden 2 Stockholm University, Department of Numerical Analysis and Computer Science, Sweden 3 AstraZeneca AB R&D, Early Clinical Biometrics, Sweden 4 Lund University, Centre for Mathematical Sciences, Sweden 5 KTH Royal Institute of Technology, School of Computer Science and Communication, Sweden 6 Karolinska Institute, Department of Neuroscience, Sweden Computational dynamical models describing intracellular signaling pathways of nerve cells are increasing in size and complexity as more information is obtained from experiments. Models describing protein interactions within neurons can contain over hundred protein reactions [1, 2]. These models are built from knowledge about the interaction topology, inferred from e.g. gene knock-out experiments, as well as from experimental quantitative data describing the input-output relationship of the observed system. The quantitative data are often sparse as compared to the size of the system, and translating the experimental information into dynamical models often results in large uncertainties in the parameter (e.g reaction rates) values. This uncertainty is partly due to the sparseness in experimental time series data (practical unidentifiability), but it is also an intrinsic feature of the modeled system (structural unidentifiability) and could reflect the possibility for biological variation [3]; in many biological systems the same function can be achieved in partly different ways due to degeneracy and redundancy. Here we investigate the extent of this parameter uncertainty, in a model describing calcium (Ca)-dependent activation of Calmodulin (CaM), Protein phosphatase 2B (PP2B) and Ca/CaM-dependent protein kinase II (CamKII) [4], which is an intracellular pathway of importance to synaptic plasticity. We presume that the structure of the model is correct and then characterize the uncertainty in the parameters based on data. This is done by sampling the subspace of parameter values which has an equally good fit to data (corresponding to the “viable space” in [5]), through a statistical approach known as Approximate Bayesian Computation (ABC) with Markov Chain Monte Carlo (MCMC) [6]. ABC has been proposed for parameter estimation in system biology models previously, albeit in slightly different settings, e.g. [7, 8], and can be applied to a wide range of problems. In order to characterize the viable space efficiently with several experimental datasets, we employ multivariate probability distributions called copulas as a part of the ABC sampling. The result is a multivariate posterior distribution for the parameters, which represents how much they are constrained by the data (i.e. the uncertainty) as illustrated in Figure 1 (pairwise plots of viable space for four parameters indicating constraints and dependencies before and after calibration to data). The next step is to look into how the parameter uncertainty is translated to uncertainty of the predictions made from the model. We also investigate the role and importance of different parameters, with respect to different model outputs including the predictions, by means of global sensitivity analysis [9]. Figure 2 illustrates the sensitivity of one of the outputs calculated by a method based on the decomposition of the variance [10, 11, 12], showing different types of sensitivity measures. Finally, we explore how the sensitivity of different subsets of parameters change as different parts of the viable space are investigated, which is shown in Figure 3, where sensitivity profiles are clustered into groups with different sensitivity characteristics. Figure 1 Figure 2 Figure 3 Acknowledgements This research was supported by funding from the Swedish e-Science Research Centre and the Human Brain Project References [1] Gutierrez-Arenas O, Eriksson O, Hellgren Kotaleski J (2014) Segregation and Crosstalk of D1 Receptor-Mediated Activation of ERK in Striatal Medium Spiny Neurons upon Acute Administration of Psychostimulants. PLoS Comput Biol 10, e1003445. [2] Nair AG, Gutierrez-Arenas O, Eriksson O, Vincent P, and Hellgren Kotaleski J (2015) Sensing Positive versus Negative Reward Signals through Adenylyl Cyclase-Coupled GPCRs in Direct and Indirect Pathway Striatal Medium Spiny Neurons. J. Neuroscience 35, 14017-14030. [3] Marder E, Goeritz ML, Otopalik AG (2015) Robust circuit rhythms in small circuits arise from variable circuit components and mechanisms. Curr Opin Neurobiol 31, 156-163. [4] Nair AG, Gutierrez-Arenas O, Eriksson O, Jauhiainen A, Blackwell KT and Kotaleski, JH (2014). Modeling intracellular signaling underlying striatal function in health and disease. Progress in molecular biology and translational science, 123, 277 [5] Zamora-Sillero E, Hafner M, Ibig A, Stelling J, and Wagner, A. (2011). Efficient characterization of high-dimensional parameter spaces for systems biology. BMC systems biology 5, 142. [6] Marjoram P, Molitor J, Plagnol V, and Tavare S (2003) Markov chain Monte Carlo without likelihoods. Proc. Natl. Acad. Sci. U.S.A. 100, 15324–15328. [7] Toni T, Welch D, Strelkowa N, Ipsen A, and Stumpf MP. Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J R Soc Interface, 6, 187–202. [8] Liepe J, Kirk P, Filippi S, Toni T, Barnes CP, and Stumpf MP. A framework for parameter estimation and model selection from experimental data in systems biology using approximate Bayesian computation. Nat Protoc, 9, 439–456. [9] Saltelli A, Ratto M, Andres T, Campolongo F, Cariboni J, Gatelli D, Saisana M, Tarantola S Global sensitivity analysis: the primer. In Wiley 2008 New York, NY:Wiley. [10] Sobol IM (2001) Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates, Math. Comput. Simul. 55, 271–280. [11] Saltelli A (2002) Making best use of model evaluations to compute sensitivity indices. Comp Phys Comm 145, 280 – 297. [12] Halnes G, Ulfhielm E Ljunggren EE, Kotaleski JH and Rospars JP (2009) Modelling and sensitivity analysis of the reactions involving receptor, G-protein and effector in vertebrate olfactory receptor neurons. Journal of computational neuroscience 27, 471-491. Keywords: sensitivity analysis, Approximate Bayesian Computation, copulas, intracellular signalling, Dynamical Modeling, global sensitivity analysis, Markov chain Monte Carlo, variance decomposition Conference: Neuroinformatics 2016, Reading, United Kingdom, 3 Sep - 4 Sep, 2016. Presentation Type: Investigator presentations Topic: Computational neuroscience Citation: Eriksson O, Jauhiainen A, Maad Sasane S, Nair A, Sartorius C and Hellgren Kotaleski J (2016). Statistical uncertainty and sensitivity analysis of intracellular signaling models - through approximate Bayesian computation and variance based global sensitivity analysis. Front. Neuroinform. Conference Abstract: Neuroinformatics 2016. doi: 10.3389/conf.fninf.2016.20.00014 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 31 May 2016; Published Online: 18 Jul 2016. * Correspondence: PhD. Olivia Eriksson, Contributed equally to this work, Stockholm, Sweden, olivia@kth.se Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Olivia Eriksson Alexandra Jauhiainen Sara Maad Sasane Anu G Nair Carolina Sartorius Jeanette Hellgren Kotaleski Google Olivia Eriksson Alexandra Jauhiainen Sara Maad Sasane Anu G Nair Carolina Sartorius Jeanette Hellgren Kotaleski Google Scholar Olivia Eriksson Alexandra Jauhiainen Sara Maad Sasane Anu G Nair Carolina Sartorius Jeanette Hellgren Kotaleski PubMed Olivia Eriksson Alexandra Jauhiainen Sara Maad Sasane Anu G Nair Carolina Sartorius Jeanette Hellgren Kotaleski Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.

The main focus of this thesis is the uncertainty propagation (UP) and global sensitivity analysis (GSA) in complex hydrogeological numerical models. Various methods are presented with applications on numerical models for the groundwater flow and mean lifetime expectancy (MLE) in the scope of Andra's (French National Radioactive Waste Management Agency) project for the geological disposal of high-level and intermediate-level long-lived radioactive wastes in a highly impermeable layer from Callovo-Oxfordian age (COX) in France. <br> A state of the art is provided for the theory of uncertainty propagation and for the methodologies of sensitivity analyses in a broad sense. Methods for UP are provided from 2-levels Factorial Designs to quasi-random samplings. GSA techniques encompass screening methods such as the Morris Measures and the Derivative-based Global Sensitivity Measures (DGSM), and also the so-called Sobol' indices based upon the variance decomposition of the response of interest. Meta-modelling techniques such as polynomial regression and Polynomial Chaos Expansions (PCE) meta-models are employed as surrogate models for UP and GSA purpose at negligible computational-costs. A comparison of GSA techniques upon various complex analytical test-functions was undertaken with the purpose of determining a relevant method to be employed in the context of “screening” out unimportant variables in computer-intensive, high-dimensional models. <br> A numerical model of groundwater flow and lifetime expectancy is employed for assessing the effect of uncertain advection-dispersion parameters and their spatial distributions upon the MLE from a target zone inside the domain. The model is a 2-dimensions synthetic cross-section of the eastern region of the Paris Basin (Meuse/Haute-Marne sector). This model was used as an exploratory tool for sensitivity analysis methods applied upon numerous sets of uncertain hydrodynamic and dispersion parameters in 15 layers. The uncertainty characterizing the permeability-porosity values in aquifer formations encompassing the COX have proved to add much of variability to the MLE calculated from the target zone. The model also served at exploring the effect of the spatial variability of permeability-porosity parameters in two main aquifer sequences on the groundwater flow rates and MLE in the model. The variabilities of the output responses are mainly due to the uncertainty upon the means and variances of the permeability-porosity distributions, as well as the longitudinal correlation lengths, in each sequence. <br> Then, a 3-dimensions high-definition hydrogeological model representing the Meuse/Haute-Marne sector in the eastern region of the Paris Basin is a more comprehensive numerical model incorporating realistic geometries, fractures, heterogeneities and discontinuities encountered on field. A sensitivity analysis of the MLE from a given zone located in the middle of the COX layer was performed by perturbing the hydraulic conductivities and porosities values in fourteen hydrogeological formations. The uncertain permeability-porosity parameters in the aquifer formations from Bathonian in the Dogger sequence, and Rauracian-Sequanian in the Oxfordian sequence, have strong and rather non-linear effects on the variability of the output response of interest. <br> The methodologies for UP and GSA employed in the present thesis have proved to be very efficient when applied to large hydrogeological models of groundwater flow and MLE. In particular, quasi-random sampling methods offer a flexible frame for providing the uncertainty distribution of the output response of interest at low computational costs. Screening techniques provide a fast estimation for the overall contribution of each input variable to the variability of the output. Meta-modelling techniques such as PCE proved highly accurate in individualising the low- and high-order effects of each input variable upon the output response of interest.

Global Sensitivity Analysis of Arrhythmic Risk Biomarkers in Cardiac Single Cell Models

The growing body of knowledge on modeling land use systems points to epistemic uncertainty as one of the challenging obstacles in development and application of agent-based models (ABMs). To decrease outcome uncertainty, sensitivity analysis (SA) is performed as part of model verification and validation. Oftentimes, however, it is inadequately addressed, partly because of the lack of tools and techniques that focus on an explicit evaluation of ABM dynamics. The nonlinear processes, inherent in such models, necessitate longitudinal SA with time path investigation of input–output relationships of endogenous variables. In response to the outlined deficiencies, this study investigates the potential of time-dependent global sensitivity analysis (time-GSA) in examining the dynamics of outcome uncertainty of a simple ABM of land use change. Specifically, we apply first and total order sensitivity indices to decompose variance of output landscape fragmentation, apportioned to model inputs for multiple time steps and multiple realizations of the ABM. We focus the analysis on selected complex systems characteristics including preference uncertainty, path dependence, access to information, and magnitude of interactions and feedbacks. We conclude that the factor sensitivity measures vary significantly during model execution. Consequently, a static snapshot of ABM sensitivity, taken at the end of the simulation, is inadequate when deciding on factor prioritization and reduction. Assuming that ABM dynamics is a result of factor interaction, we observe a distinct time lag of nonlinearity, which unfolds after the formation of the seeds of development. Therefore, we argue for further application of time-GSA in ABM as one of the visual quantitative techniques contributing to evaluation of ABM nonlinearity.

Dimensionality reduction for surrogate model construction for global sensitivity analysis: Comparison between active subspace and local sensitivity analysis

Abstract. Integrated hydrological modeling of domains with complex subsurface features requires many highly uncertain parameters. Performing a global uncertainty analysis using an ensemble of model runs can help bring clarity as to which of these parameters really influence system behavior and for which high parameter uncertainty does not result in similarly high uncertainty of model predictions. However, already creating a sufficiently large ensemble of model simulation for the global sensitivity analysis can be challenging, as many combinations of model parameters can lead to unrealistic model behavior. In this work we use the method of active subspaces to perform a global sensitivity analysis. While building up the ensemble, we use the already-existing ensemble members to construct low-order meta-models based on the first two active-subspace dimensions. The meta-models are used to pre-determine whether a random parameter combination in the stochastic sampling is likely to result in unrealistic behavior so that such a parameter combination is excluded without running the computationally expensive full model. An important reason for choosing the active-subspace method is that both the activity score of the global sensitivity analysis and the meta-models can easily be understood and visualized. We test the approach on a subsurface-flow model including uncertain hydraulic parameters, uncertain boundary conditions and uncertain geological structure. We show that sufficiently detailed active subspaces exist for most observations of interest. The pre-selection by the meta-model significantly reduces the number of full-model runs that must be rejected due to unrealistic behavior. An essential but difficult part in active-subspace sampling using complex models is approximating the gradient of the simulated observation with respect to all parameters. We show that this can effectively and meaningfully be done with second-order polynomials.

Background:The cellulase enzyme is one of the most industrially important enzymes. Its cost represents a significant barrier to other valuable commercial products. Reducing the cost of cellulase production is an important approach. Objectives: For this purpose, this work investigated the production of cellulase enzyme using olive oil production waste (olive mill wastewater (OMW). Materials and methods: The ability of Trichoderma viride to utilize OMW as a substrate for cellulase production was studied. Optimization of cellulase production was investigated to find out the optimum OMW concentration, agitation speed, aeration rate, and cellulose addition. Results:The results showed that 75% v/v OMW submerged shake flask culture was the most suitable culture for T. viride growth and cellulase enzyme production (0.82 U/ml endoglucanase activity and 0.25 U/ml exoglucanase activity). When this culture was supplemented with cellulose, the activity of endoglucanase and exoglucanase was significantly improved (10.24 U/ml and 2.17 U/ml respectively).The agitation speed of 200 rpm enhanced the production to reach 9.1 U/ml of endoglucanase and 6.38 U/ml of exoglucanase. The effect of the aeration rate on enzyme production was studied under batch cultivation. The highest cellulase activity was at 2.0 vvm, where the endoglucanase and exoglucanase activities were 55.96 U/ml and 32.62 U/ml respectively. Conclusions: Therefore, it is claimed that OMW is a suitable medium for cellulase enzyme production after optimization of the process.

Sensitivity analyses are frequently used during the design of engineering systems to qualify and quantify the effect of parametric variation in the performance of a system. Two primary types of sensitivity analyses are generally used: local and global. Local analyses, generally involving derivative-based measures, have a significantly lower computational burden than global analyses but only provide measures of sensitivity around a nominal point. Global analyses, generally performed with a Monte Carlo sampling approach, and variation-based measures provide a complete description of sensitivity but incur a large computational burden and require information regarding the distributions of the design parameters in a concept. Local analyses are generally suited to the early stages of design when parametric information is limited, and a large number of concepts must be evaluated (necessitating a light computational burden). Global analyses are more suited to the later stages of design when more information about parametric distributions is available and fewer concepts are under consideration. Current derivative-based local approaches provide a different and incompatible set of measures than a global variation-based analysis. This makes a direct comparison of local to global measures ill posed. To reconcile local and global sensitivity analyses, a hybrid local variation-based sensitivity (HyVar) approach is presented. This approach has a similar computational burden to a local approach but produces measures or percentage contributions. The HyVar approach is directly comparable to global variation-based approaches. In this paper, the HyVar sensitivity analysis method is developed in the context of a functional based behavioral modeling framework. An example application of the method is presented along with a summary of results produced from a more comprehensive example.

Tree-based ensemble methods for sensitivity analysis of environmental models: A performance comparison with Sobol and Morris techniques

Global sensitivity analysis (GSA) is useful to recognize important inputs for assigning priority and unimportant inputs for simplifying models by exploring whole distribution ranges. Meanwhile, regional sensitivity analysis (RSA) is also studied for finding the contribution of the critical region of an input, which can be viewed as the complementary of GSA. However, there is a lack of GSA and RSA research in presence of fuzzy uncertainty. Thus, a new global sensitivity index (GSI) under the fuzzy uncertainty is devoted on the credibility distribution function (CrDF), a comprehensive distribution description under the fuzzy uncertainty. The CrDF-based GSI is defined by the fuzzy expectation of the difference between the CrDF and the conditional CrDF of the output on fixing the fuzzy input over its whole distribution range, which can quantify the contribution of the fuzzy input to the output CrDF. Then, a new fuzzy RSA technique, the contribution to this CrDF based index (shortened by CCI) plot, is also proposed, and it can assess the effect of given regions of important inputs on output CrDF. Besides, mathematical properties of the CrDF based GSI and the CCI plot are discussed, and their solution are established by use of the fuzzy simulation with the same set of samples. After the accuracy of established fuzzy simulation solution for the CrDF based GSI and the CCI plot are verified by an analytical example, other examples are used to demonstrate the reasonability and applicability of proposed CrDF based GSI and CCI plot under fuzzy uncertainty.

Sensitivity analysis and calibration of phenomenological models for seismic analyses

Simulation of fate and transport mechanisms in the porous systems from contaminant transport models are affected by uncertainty associated with input model parameters. Sensitivity analysis (SA) provides tools to quantify the sources of uncertainty to the variations in the model output metrics. To quantify the uncertainty associated with physical non-equilibrium contaminant transport model, global SA was conducted for the problem mimicking reactive transport in the saturated soil column conditions. Five global SA methods, namely Morris, RSA (Regionalized Sensitivity Analysis), Sobol, FAST (Fourier Amplitude Sensitivity Test), and PAWN, were tested based on the temporal moments of contaminant concentrations for two output metrics: zeroth temporal moment (ZTM) and mean residence time (MRT). The ranking order of ten input model parameters from global SA methods for two output metrics was compared. Morris SA implied that the ZTM at outlet of the soil column is highly sensitive to sorption distribution coefficient in the mobile and immobile regions and less sensitive to dispersion coefficient and degradation rate constant in the immobile region. The mass-transfer coefficient showed highest non-linear interactions with other flow and transport parameters based on the highest value of standard deviation of elementary effects (EEs) for ZTM output metric. The sorption distribution coefficient in the mobile region and mass-transfer coefficient showed highest sensitivity and non-linear effect toward MRT based on the Morris method. The comparison of global SA methods revealed that the top two sensitive parameters affecting ZTM and MRT were the same from all the considered methods. However, large difference in the ranking order of bottom three sensitive parameters was observed. The sorption distribution coefficient of mobile region and mass-transfer coefficient were observed as the most sensitive parameters affecting ZTM and MRT based on the comparison of all five global SA methods. Overall results suggest that the non-linear contaminant transport model should be examined based on multiple sensitivity output metrics via a multi-model approach. The multi-model global SA approach implemented in this study highlighted its significance in quantifying the interplay of non-linear model parameters.

In drug development decision-making is often supported through model-based methods, such as physiologically-based pharmacokinetics (PBPK). Global sensitivity analysis (GSA) is gaining use for quality assessment of model-informed inference. However, the inclusion and interpretation of correlated factors in GSA has proven an issue. Here we developed and evaluated a latent variable approach for dealing with correlated factors in GSA. An approach was developed that describes the correlation between two model inputs through the causal relationship of three independent factors: the latent variable and the unique variances of the two correlated parameters. The latent variable approach was applied to a set of algebraic models and a case from PBPK. Then, this method was compared to Sobol’s GSA assuming no correlations, Sobol’s GSA with groups and the Kucherenko approach. For the latent variable approach, GSA was performed with Sobol’s method. By using the latent variable approach, it is possible to devise a unique and easy interpretation of the sensitivity indices while maintaining the correlation between the factors. Compared methods either consider the parameters independent, group the dependent variables into one unique factor or present difficulties in the interpretation of the sensitivity indices. In situations where GSA is called upon to support model-informed decision-making, the latent variable approach offers a practical method, in terms of ease of implementation and interpretability, for applying GSA to models with correlated inputs that does not violate the independence assumption. Prerequisites and limitations of the approach are discussed.

Global sensitivity analysis of biological multiscale models

We present a global sensitivity analysis that quantifies the impact of parameter uncertainty on model outcomes. Specifically, we propose variance‐decomposition‐based Sobol' indices to establish an importance ranking of parameters and univariate effects to determine the direction of their impact. We employ the state‐of‐the‐art approach of constructing a polynomial chaos expansion of the model, from which Sobol' indices and univariate effects are then obtained analytically, using only a limited number of model evaluations. We apply this analysis to several quantities of interest of a standard real‐business‐cycle model and compare it to traditional local sensitivity analysis approaches. The results show that local sensitivity analysis can be very misleading, whereas the proposed method accurately and efficiently ranks all parameters according to importance, identifying interactions and nonlinearities. Computational techniques uncertainty quantification sensitivity analysis polynomial chaos expansion C60 C63