Sensitivity analysis for transit equilibrium assignment and applications to uncertainty analysis

On the use of uncertainty analyses to test hypotheses regarding deterministic model predictions of environmental processes

Uncertainty analysis is a key element of sound techno-economic analysis (TEA) of CO2 Capture and Storage (CCS) technologies and systems, and in the communication of TEA results. Many CCS technologies are relatively novel, with only few large-scale projects constructed and in operation to date. Therefore, uncertainties in technology performance and costs are often substantial, making it imperative that they be characterized and reported. Although uncertainty analysis itself is not novel, with some methods already frequently used by the CCS TEA community, a document that provides a comprehensive overview of methods and approaches, as well as guidance on their selection and use, is still lacking. Given its importance, we seek to fill this gap by providing a critical review of uncertainty analysis methods along with guidance on the selection and use of these methods for CCS TEAs, highlighting good practice and examples from the CCS literature. The paper starts by identifying the different audiences for CCS TEAs, the different modelling approaches available for CCS technology performance and cost analysis, and the different roles that uncertainty analysis may play. It then continues to discuss established, as well as emerging, uncertainty analysis methods and addresses how and when each method is best used, as well as common pitfalls. We argue that the most commonly used method of one-parameter-at-a-time ‘local’ sensitivity analysis may often be a suboptimal choice, and that other approaches may be more suitable or lead to more insight, especially since uncertainty analysis software is becoming more widespread and easier to use. Finally, the paper discusses the benefits of advanced uses of uncertainty analysis in, for instance, the design of CCS experiments or in the design and planning of CCS infrastructure. Sound uncertainty analysis has an important role to play in TEAs of CCS technologies and systems, and there are many opportunities to bring the use of uncertainty analysis to a higher level than currently practiced. This review of and guidance on available methods is intended to help accelerate continued methods development and their application to more robust and meaningful CCS performance and costing studies.

Development, uncertainty and sensitivity analysis of the simple SALUS crop model in DSSAT

Dynamic and mechanistic models of an Electrical Submersible Pump (ESP) lifted oil field are frequently used for understanding the process dynamics and the interactions occurring between the oil wells under varying operating conditions. They are also used to calculate the total fluid produced from the oil field. In this article, uncertainty and sensitivity analysis of such a model is studied. If the model is used for control and optimization of an oil field, it is important to see if the output calculated using the mathematical model lies within a confidence interval under the presence of uncertainties. It is also important to understand which parameters have strong/weak influence on the model output. The uncertainty analysis is performed by using the Monte Carlo simulation method. Morris method of elementary effect is used for input factor screening. To quantify the effect of the input factors on the model output, a variance based method of sensitivity analysis is used.

Sensitivity and uncertainty analysis within a methodology for evaluating environmental restoration technologies

A probabilistic model (SHEDS-Wood) was developed to examine children's exposure and dose to chromated copper arsenate (CCA)-treated wood, as described in Part 1 of this two-part article. This Part 2 article discusses sensitivity and uncertainty analyses conducted to assess the key model inputs and areas of needed research for children's exposure to CCA-treated playsets and decks. The following types of analyses were conducted: (1) sensitivity analyses using a percentile scaling approach and multiple stepwise regression; and (2) uncertainty analyses using the bootstrap and two-stage Monte Carlo techniques. The five most important variables, based on both sensitivity and uncertainty analyses, were: wood surface residue-to-skin transfer efficiency; wood surface residue levels; fraction of hand surface area mouthed per mouthing event; average fraction of nonresidential outdoor time a child plays on/around CCA-treated public playsets; and frequency of hand washing. In general, there was a factor of 8 for the 5th and 95th percentiles and a factor of 4 for the 50th percentile in the uncertainty of predicted population dose estimates due to parameter uncertainty. Data were available for most of the key model inputs identified with sensitivity and uncertainty analyses; however, there were few or no data for some key inputs. To evaluate and improve the accuracy of model results, future measurement studies should obtain longitudinal time-activity diary information on children, spatial and temporal measurements of residue and soil concentrations on or near CCA-treated playsets and decks, and key exposure factors. Future studies should also address other sources of uncertainty in addition to parameter uncertainty, such as scenario and model uncertainty.

This paper reviews five related types of analysis, namely (i) sensitivity or what-if analysis, (ii) uncertainty or risk analysis, (iii) screening, (iv) validation, and (v) optimization. The main questions are: when should which type of analysis be applied; which statistical techniques may then be used? This paper claims that the proper sequence to follow in the evaluation of simulation models is as follows. 1) Validation, in which the availability of data on the real system determines which type of statistical technique to use for validation. 2) Screening: in the simulation‘s pilot phase the really important inputs can be identified through a novel technique, called sequential bifurcation, which uses aggregation and sequential experimentation. 3) Sensitivity analysis: the really important inputs should be subjected to a more detailed analysis, which includes interactions between these inputs; relevant statistical techniques are design of experiments (DOE) and regression analysis. 4) Uncertainty analysis: the important environmental inputs may have values that are not precisely known, so the uncertainties of the model outputs that result from the uncertainties in these model inputs should be quantified; relevant techniques are the Monte Carlo method and Latin hypercube sampling. 5) Optimization: the policy variables should be controlled; a relevant technique is Response Surface Methodology (RSM), which combines DOE, regression analysis, and steepest-ascent hill-climbing. The recommended sequence implies that sensitivity analysis procede uncertainty analysis. Several case studies for each phase are briefly discussed in this paper.

Sensitivity analysis in the context of uncertainty analysis for computationally intensive models

Best estimate calculation and uncertainty quantification of sodium-cooled fast reactor using MARS-LMR code

An interactive graphical interface tool for parameter calibration, sensitivity analysis, uncertainty analysis, and visualization for the Soil and Water Assessment Tool

Uncertainty and sensitivity analyses as a validation tool for BWR bundle thermal–hydraulic predictions

A novel procedure to analyse the uncertainty associated to the output of GIS-based models is presented. The procedure can handle models of any degree of complexity that accept any kind of input data. Two important aspects of spatial modelling are addressed: the propagation of uncertainty from model inputs and model parameters up to the model output (uncertainty analysis); and the assessment of the relative importance of the sources of uncertainty in the output uncertainty (sensitivity analysis). Two main applications are proposed. The procedure allows implementation of a GIS-based model whose output can reliably support the decision process with an optimized allocation of resources for spatial data acquisition. This is possible in low cost strategy, based on numerical simulations on a small prototype of the GIS-based model. Furthermore, the procedure provides an effective model building tool to choose, from a group of alternative models, the best one in terms of cost-benefit analysis. A comprehensive case study is described. It concerns the implementation of a new GIS-based hydrologic model, whose goal is providing near real-time flood forecasting.

Recent literature on building energy performance simulation leans toward implementing uncertainty analysis (UA), instead of deterministic solutions, to handle ever-existing and pivotal uncertainties in building design decision-making process. Variations in weather temperature, degradation of building envelope material properties over time, and random behavior of occupants, among all, are the key sources of uncertainty in building energy consumption predictions. The UA couples to the sensitivity analysis (SA) to identify the most influential inputs on the uncertainties of the building energy consumption. This paper describes a newly-developed UA and SA predictive tool for building energy performance simulations. Energy performance simulations are based on a resistance-capacitance thermal model for the building. For a hypothetical residential building in College Station, Texas, USA, the present work describes and compares predicted probability distribution and sensitivity indexes produced by the UA-SA tool using a transient (dynamic) response analysis (TRA) and static response analysis (SRA). For brevity, the analysis considers uncertainty only for the exterior walls’ parameters including thickness, thermal conductivity, heat transfer coefficient, density, and heat capacity; i.e., a five-dimensional problem is solved. Compared to the TRA, predictions from the SRA underestimate the annual energy consumption up to 30%; however, SRA is significantly faster. Nonetheless, sensitivity indexes from the SRA and TRA closely match.

Global environmental losses of plastics across their value chains

Global sensitivity analysis of a three-dimensional nutrients-algae dynamic model for a large shallow lake