Uncertainty and sensitivity analysis of building-stock energy models: sampling procedure, stock size and Sobol' convergence

• Published in: Journal of building performance simulation Vol. 16; no. 6; pp. 749 - 771
• Main Authors: Van Hove, M. Y. C., Delghust, M., Laverge, J.
• Format: Journal Article
• Language: English
• Published: Abingdon Taylor & Francis 02-11-2023; Taylor & Francis Ltd
• Subjects: Abbreviations; building stock size; building-stock energy model; Convergence; convergence criteria; IEA EBC Annex 70; Mathematical models; Parameter sensitivity; Parameter uncertainty; Robustness (mathematics); Sampling; sampling procedure; Sensitivity analysis; Uncertainty analysis; uncertainty and sensitivity analysis; Variance
• ISSN: 1940-1493; 1940-1507
• DOI: 10.1080/19401493.2023.2201816

Despite broad recognition of the need for applying Uncertainty (UA) and Sensitivity Analysis (SA) to Building-Stock Energy Models (BSEMs), limited research has been done. This article proposes a scalable methodology to apply UA and SA to BSEMs, with an emphasis on important methodological aspects: input parameter sampling procedure, minimum required building stock size and number of samples needed for convergence. Applying UA and SA to BSEMs requires a two-step input parameter sampling that samples 'across stocks' and 'within stocks'. To make efficient use of computational resources, practitioners should distinguish between three types of convergence: screening, ranking and indices. Nested sampling approaches facilitate comprehensive UA and SA quality checks faster and simpler than non-nested approaches. Robust UA-SA's can be accomplished with relatively limited stock sizes. The article highlights that UA-SA practitioners should only limit the UA-SA scope after very careful consideration as thoughtless curtailments can rapidly affect UA-SA quality and inferences.
BEM: Building Energy Model; BSEM: Building-Stock Energy Model; UA: Uncertainty Analysis focuses on how uncertainty in the input parameters propagates through the model and affects the model output parameter(s); SA: Sensitivity Analysis is the study of how uncertainty in the output of a model (numerical or otherwise) can be apportioned to different sources of uncertainty in the model input factors; GSA: Global Sensitivity Analysis (e.g. Sobol' SA);LSA: Local Sensitivity Analysis (e.g. OAT); OAT: One-At-a-Time; LOD: Level of Development;
: The model output;
: The
-th model input parameter and
denotes the matrix of all model input parameters but
;
: The first-order sensitivity index, which represents the expected amount of variance reduction that would be achieved for
, if
was specified exactly. The first-order index is a normalized index (i.e. always between 0 and 1);
: The total-order sensitivity index, which represents the expected amount of variance that remains for
, if all parameters were specified exactly, but
. It takes into account the first and higher-order effects (interactions) of parameters
and can therefore be seen as the residual uncertainty;
: The higher-order effects index is calculated as the difference between
and
and is a measure of how much
is involved in interactions with any other input factor;
: The second order sensitivity index, which represents the fraction of variance in the model outcome caused by the interaction of parameter pair (
,
); M: Mean (µ); SD: Standard deviation (σ); Mo: Mode; n: number of buildings in the modelled stock;N: number of samples (i.e. matrices of
or
stock model runs; batches of
or
are required to calculate Sobol' indices); K: number of uncertain parameters; ME: number of model evaluations (i.e. stocks to be calculated); *: Table 1: Aleatory uncertainty: Uncertainty due to inherent or natural variation of the system under investigation;Epistemic uncertainty: Uncertainty resulting from imperfect knowledge or modeller error; can be quantified and reduced.