Uncertainty analysis - Revision history

Jan: Add 1 watermarked SVG illustrations from the Expert visual plan

2026-11-02T16:47:56Z

Add 1 watermarked SVG illustrations from the Expert visual plan

← Older revision		Revision as of 17:47, 2 November 2026
Line 85:		Line 85:

	A probabilistic statement of performance makes the role of uncertainty explicit. It contains at least four elements: a probability, a time, a performance criterion and a threshold value.<ref name="N-5-53">Notarianni (2002), pp. 5-53–5-54.</ref> An example is a requirement that the design gives a probability of 0.9 of having 4 min or more before the temperature in a corridor reaches 65 °C.<ref name="N-5-53" /> Where values must be rounded for a comparison with limits, the safe direction is preferred: required times are rounded up and available times down.<ref name="VR-1.7" />		A probabilistic statement of performance makes the role of uncertainty explicit. It contains at least four elements: a probability, a time, a performance criterion and a threshold value.<ref name="N-5-53">Notarianni (2002), pp. 5-53–5-54.</ref> An example is a requirement that the design gives a probability of 0.9 of having 4 min or more before the temperature in a corridor reaches 65 °C.<ref name="N-5-53" /> Where values must be rounded for a comparison with limits, the safe direction is preferred: required times are rounded up and available times down.<ref name="VR-1.7" />
			[[File:fse-uncertainty-analysis-v4.svg\|thumb\|upright=1.5\|alt=Falling curve of the probability of having at least a given time before a critical value, with a marked point at 0.9 and 80 s.\|Probability of having at least a given time before a critical value is reached, from many design fire scenarios; a requirement of 0.9 is met for times up to about 80 s. Based on Notarianni (2002), pp. 5-56 and 5-59.]]

	== Limits and practical difficulties ==		== Limits and practical difficulties ==

Jan: Add 3 watermarked SVG illustrations from the Expert visual plan

2026-11-02T16:44:28Z

Add 3 watermarked SVG illustrations from the Expert visual plan

← Older revision		Revision as of 17:44, 2 November 2026
Line 9:		Line 9:

	For a typical design calculation, scientific uncertainties fall into five groups. These are theory and model uncertainties, data and input uncertainties, calculation limitations, the level of detail of the model, and how well the design fire scenarios represent reality.<ref name="N-5-45">Notarianni (2002), p. 5-45.</ref> A two-zone model, for example, assumes that each room consists of two uniform layers. The heat release rate of a three-cushion sofa may be uncertain because no test data exist for a sofa of the same size and materials. Even the choice of the control volume matters. Modelling a single area under draft curtains, instead of the whole building, predicts higher temperatures and faster activation of fire protection devices.<ref name="N-5-45" />		For a typical design calculation, scientific uncertainties fall into five groups. These are theory and model uncertainties, data and input uncertainties, calculation limitations, the level of detail of the model, and how well the design fire scenarios represent reality.<ref name="N-5-45">Notarianni (2002), p. 5-45.</ref> A two-zone model, for example, assumes that each room consists of two uniform layers. The heat release rate of a three-cushion sofa may be uncertain because no test data exist for a sofa of the same size and materials. Even the choice of the control volume matters. Modelling a single area under draft curtains, instead of the whole building, predicts higher temperatures and faster activation of fire protection devices.<ref name="N-5-45" />
			[[File:fse-uncertainty-analysis-v1.svg\|thumb\|upright=1.5\|alt=Tree diagram: uncertainty splits into scientific, human behaviour and values; scientific splits into five groups; each is aleatory or epistemic.\|Main sources of uncertainty in fire safety engineering calculations. Based on Notarianni (2002), pp. 5-41–5-46, and Nowlen et al. (2005b), pp. 15-3 and U-2–U-3.]]

	The fire probabilistic risk assessment (PRA) method for nuclear power plants groups uncertainties more simply. It distinguishes modelling uncertainties, including the completeness of the model, from data or parameter uncertainties.<ref name="NW-15-3">Nowlen et al. (2005b), p. 15-3.</ref> Data uncertainties can be described by probability distributions, while modelling uncertainties can be handled by several alternative models, each given a probability of being correct.<ref name="NW-15-4">Nowlen et al. (2005b), p. 15-4.</ref>		The fire probabilistic risk assessment (PRA) method for nuclear power plants groups uncertainties more simply. It distinguishes modelling uncertainties, including the completeness of the model, from data or parameter uncertainties.<ref name="NW-15-3">Nowlen et al. (2005b), p. 15-3.</ref> Data uncertainties can be described by probability distributions, while modelling uncertainties can be handled by several alternative models, each given a probability of being correct.<ref name="NW-15-4">Nowlen et al. (2005b), p. 15-4.</ref>
Line 21:		Line 22:
	== Switchover and false precision ==		== Switchover and false precision ==
	Direct measurement of the fire safety performance of a building is not usually possible, so designs rely on predictions by fire models and other tools.<ref name="N-5-42" /> A single predicted value hides the uncertainty around it. In an example in the ''SFPE Handbook of Fire Protection Engineering'', the upper layer of a room was predicted to reach the limit of 100 °C after 175 s. A sprinkler was predicted to activate after 171.2 s, so the design seemed acceptable.<ref name="N-5-55">Notarianni (2002), p. 5-55.</ref> If the predicted time to 100 °C is uncertain by 20 s, however, the limit could be reached after 155 s, before the sprinkler activates.<ref name="N-5-55" />		Direct measurement of the fire safety performance of a building is not usually possible, so designs rely on predictions by fire models and other tools.<ref name="N-5-42" /> A single predicted value hides the uncertainty around it. In an example in the ''SFPE Handbook of Fire Protection Engineering'', the upper layer of a room was predicted to reach the limit of 100 °C after 175 s. A sprinkler was predicted to activate after 171.2 s, so the design seemed acceptable.<ref name="N-5-55">Notarianni (2002), p. 5-55.</ref> If the predicted time to 100 °C is uncertain by 20 s, however, the limit could be reached after 155 s, before the sprinkler activates.<ref name="N-5-55" />
			[[File:fse-uncertainty-analysis-v2.svg\|thumb\|upright=1.5\|alt=Time axis with sprinkler activation at 171.2 s and predicted time to 100 °C at 175 s, with a band from 155 to 195 s overlapping the sprinkler time.\|A point prediction (175 s) suggests that the sprinkler activates first; with an uncertainty of 20 s, the limit may be reached earlier. Based on Notarianni (2002), p. 5-55.]]

	The choice of criteria is itself uncertain. Two engineers who presented performance-based case studies for real buildings at one conference had both followed the design guidelines. Yet they selected very different performance criteria, in the parameters, the critical values and the use of a time element.<ref name="N-5-43" /> Because model predictions are compared with such criteria, a different choice can make the same design pass or fail.<ref name="N-5-43" />		The choice of criteria is itself uncertain. Two engineers who presented performance-based case studies for real buildings at one conference had both followed the design guidelines. Yet they selected very different performance criteria, in the parameters, the critical values and the use of a time element.<ref name="N-5-43" /> Because model predictions are compared with such criteria, a different choice can make the same design pass or fail.<ref name="N-5-43" />
Line 41:		Line 43:

	The same study found the layer height to be much less sensitive. A 15 % to 25 % increase in heat release rate lowers the layer height by only 1 % to 2 %.<ref name="HM-5-2" /> Such approximations have limits. In a NIST study, a 10 % higher heat release rate should have raised the upper layer temperature by about 6.7 % according to the correlation. A computer simulation gave 9 %, at temperatures above the range of the data behind the correlation.<ref name="M5F-28">McGrattan et al. (2005), p. 28.</ref>		The same study found the layer height to be much less sensitive. A 15 % to 25 % increase in heat release rate lowers the layer height by only 1 % to 2 %.<ref name="HM-5-2" /> Such approximations have limits. In a NIST study, a 10 % higher heat release rate should have raised the upper layer temperature by about 6.7 % according to the correlation. A computer simulation gave 9 %, at temperatures above the range of the data behind the correlation.<ref name="M5F-28">McGrattan et al. (2005), p. 28.</ref>
			[[File:fse-uncertainty-analysis-v3.svg\|thumb\|upright=1.5\|alt=Chart: temperature uncertainty rises at two-thirds of the heat release rate uncertainty, while layer height uncertainty stays near 1 to 2 %.\|Relative uncertainty of the hot gas layer temperature rise and layer height caused by uncertainty in the heat release rate. Based on Hamins and McGrattan (2007), pp. 5-1–5-2.]]

	Independent uncertainties are combined as the square root of the sum of their squares.<ref name="HM-1-10">Hamins and McGrattan (2007), p. 1-10.</ref> The same study compared each model prediction with a measurement through the relative difference <math>\varepsilon</math> between the predicted and measured rise. It judged the difference significant when it exceeded the combined relative expanded uncertainty:<ref name="HM-1-11">Hamins and McGrattan (2007), p. 1-11.</ref>		Independent uncertainties are combined as the square root of the sum of their squares.<ref name="HM-1-10">Hamins and McGrattan (2007), p. 1-10.</ref> The same study compared each model prediction with a measurement through the relative difference <math>\varepsilon</math> between the predicted and measured rise. It judged the difference significant when it exceeded the combined relative expanded uncertainty:<ref name="HM-1-11">Hamins and McGrattan (2007), p. 1-11.</ref>

Mark: New FSE wiki article: Uncertainty analysis (written by Claude Opus 5.5)

2026-11-01T22:17:22Z

New FSE wiki article: Uncertainty analysis (written by Claude Opus 5.5)

New page

'''Uncertainty analysis''' is the part of a fire safety engineering calculation that identifies what is not known exactly and shows how this affects the result. An uncertainty study determines how uncertainties in the input data and in the methods used are reflected in the outputs of the analysis.<ref name="IFEG-1.2-24">National Research Council of Canada et al. (2005), p. 1.2-24.</ref> The sources of uncertainty range from measurement errors and missing data to randomness, simplified models, human behaviour and disagreement about the criteria for a safe design.<ref name="N-5-41">Notarianni (2002), p. 5-41.</ref><ref name="N-5-43">Notarianni (2002), p. 5-43.</ref> The treatment of uncertainty helps to maintain an appropriate level of public safety while leaving room to reduce costs.<ref name="N-5-40">Notarianni (2002), p. 5-40.</ref>

The central question is whether reasonable changes in the inputs, assumptions or criteria could change the design decision. This change of decision is called switchover.<ref name="N-5-42">Notarianni (2002), p. 5-42.</ref> Simple approaches use bounding values, safety factors and sensitivity studies. More complete approaches describe uncertain inputs as probability distributions and propagate them through the calculation, for example by Monte Carlo sampling.<ref name="N-5-50">Notarianni (2002), p. 5-50.</ref><ref name="N-5-51">Notarianni (2002), p. 5-51.</ref> In [[fire modelling]], an uncertainty analysis combines the uncertainty of the inputs with the uncertainty of the model itself, which is estimated from validation studies.<ref name="S-7-2">Stroup et al. (2016), p. 7-2.</ref>

== Sources of uncertainty ==
Uncertainty is often treated as if it meant only measurement uncertainty, that is, doubt about the result of a measurement. Measurement uncertainty has a random part, estimated from repeated observations, and a systematic part, linked to corrections and reference standards. Together they form the total error.<ref name="N-5-41" /> Measurements of heat release rate, burning rate or radiative fraction are typical examples of such empirical quantities in fire safety engineering.<ref name="N-5-49">Notarianni (2002), p. 5-49.</ref>

Many other sources of uncertainty do not fit the standard treatment of measurements. The heat release rate of a mixed fuel package may simply be unknown. Where and how a fire starts is a matter of chance. The occupancy and furnishings of a building may be different after 10 or 20 years.<ref name="N-5-41" /> Occupants may act in many ways after hearing an alarm, and data sources can disagree, for example on the yields of combustion products. Even a goal such as "an equivalent level of fire safety" can be defined in several ways.<ref name="N-5-41" />

For a typical design calculation, scientific uncertainties fall into five groups. These are theory and model uncertainties, data and input uncertainties, calculation limitations, the level of detail of the model, and how well the design fire scenarios represent reality.<ref name="N-5-45">Notarianni (2002), p. 5-45.</ref> A two-zone model, for example, assumes that each room consists of two uniform layers. The heat release rate of a three-cushion sofa may be uncertain because no test data exist for a sofa of the same size and materials. Even the choice of the control volume matters. Modelling a single area under draft curtains, instead of the whole building, predicts higher temperatures and faster activation of fire protection devices.<ref name="N-5-45" />

The fire probabilistic risk assessment (PRA) method for nuclear power plants groups uncertainties more simply. It distinguishes modelling uncertainties, including the completeness of the model, from data or parameter uncertainties.<ref name="NW-15-3">Nowlen et al. (2005b), p. 15-3.</ref> Data uncertainties can be described by probability distributions, while modelling uncertainties can be handled by several alternative models, each given a probability of being correct.<ref name="NW-15-4">Nowlen et al. (2005b), p. 15-4.</ref>

== Aleatory and epistemic uncertainty ==
Two kinds of uncertainty are distinguished in most risk analyses. Aleatory uncertainty is due to random variation and chance outcomes. It is also called randomness, stochastic uncertainty or statistical uncertainty. In principle, it cannot be reduced, although it can be characterised better through study.<ref name="N-5-42" /> Epistemic uncertainty arises from a lack of knowledge. In principle, it can be reduced by collecting more information or data.<ref name="N-5-42" />

The fire PRA method illustrates the difference with a pump. Whether a pump fails within a given period is a random event, so the probability of at least one failure expresses aleatory uncertainty. The value of the failure rate of that pump is a fixed but unknown number, so the uncertainty about it is epistemic.<ref name="NW-U-3">Nowlen et al. (2005b), p. U-3.</ref> With few failure data, the epistemic uncertainty in the failure rate is large. After a large enough sample has been collected, the failure rate can be estimated well.<ref name="NW-U-3" />

The two kinds should be kept apart where possible. In a fire PRA, the aleatory part is represented in the event tree, while the epistemic part is treated when probability distributions are propagated through the model.<ref name="NW-U-5">Nowlen et al. (2005b), p. U-5.</ref> Probability itself can be read in two ways. In the frequentist view, it is the frequency of an event in a long series of similar trials. In the Bayesian view, it is the degree of belief of a person, given all the information available to that person.<ref name="N-5-41" />

== Switchover and false precision ==
Direct measurement of the fire safety performance of a building is not usually possible, so designs rely on predictions by fire models and other tools.<ref name="N-5-42" /> A single predicted value hides the uncertainty around it. In an example in the ''SFPE Handbook of Fire Protection Engineering'', the upper layer of a room was predicted to reach the limit of 100 °C after 175 s. A sprinkler was predicted to activate after 171.2 s, so the design seemed acceptable.<ref name="N-5-55">Notarianni (2002), p. 5-55.</ref> If the predicted time to 100 °C is uncertain by 20 s, however, the limit could be reached after 155 s, before the sprinkler activates.<ref name="N-5-55" />

The choice of criteria is itself uncertain. Two engineers who presented performance-based case studies for real buildings at one conference had both followed the design guidelines. Yet they selected very different performance criteria, in the parameters, the critical values and the use of a time element.<ref name="N-5-43" /> Because model predictions are compared with such criteria, a different choice can make the same design pass or fail.<ref name="N-5-43" />

Uncertainty also affects how results should be reported. Input data for fire safety calculations, such as fire loads, heat release curves, walking speeds and material properties, are often uncertain by tens of percent. A result such as "an available escape time of 187.4 seconds" then suggests a precision that the calculation cannot deliver.<ref name="VR-1.7">Van Rossum (2027), §1.7.</ref> Two, or at most three, significant figures are realistic for most results. For critical decisions, a sensitivity or uncertainty analysis says more than strict rounding rules.<ref name="VR-1.7" />

== Methods of analysis ==
Measured quantities can be handled by classical uncertainty analysis, which uses probability and statistics. A Type A evaluation is based on a statistical treatment of data, such as the standard deviation of a series of observations. A Type B evaluation relies on scientific judgement and other information, such as manufacturer's specifications and calibration reports.<ref name="N-5-49" /> Decision variables, such as the acceptable level of fire safety, and value parameters, such as the value placed on a life, have no true value to measure.<ref name="N-5-49" /> For these, the effect of different choices on the outcome is shown explicitly.<ref name="N-5-50" />

Several simpler techniques make such effects visible. Bounding evaluates the extremes of the possible range: if both ends give acceptable results, a more costly analysis may be avoided. A [[sensitivity analysis]] tests how responsive the results are to changes in individual parameters, and so identifies the most important ones.<ref name="N-5-50" /> An importance analysis ranks the uncertain inputs by the rank-order correlation between each input and the output, on a scale from 0 to 1. Where no data exist, the judgement of experts can be gathered in a structured way through expert elicitation.<ref name="N-5-50" />

For complex computer models, three approaches have been compared: direct calculation of derivatives, replacement of the model by a fitted response surface, and Monte Carlo sampling.<ref name="N-5-51" /> In Monte Carlo sampling, each uncertain input is described by a probability distribution. The model is run many times with randomly chosen input values, and the results approximate the probability distribution of the output.<ref name="N-5-51" /> A comparison by Iman and Helton found that [[Monte Carlo simulation]] performed best overall, while response surfaces were not recommended because fire models are too complex for a simple function.<ref name="N-5-52">Notarianni (2002), pp. 5-51–5-52.</ref> Fire PRAs for nuclear power plants propagate epistemic uncertainties with Monte Carlo or Latin hypercube sampling.<ref name="NW-15-2">Nowlen et al. (2005b), p. 15-2.</ref>

In practice, a full analysis is seldom possible for every variable. When the handbook chapter was written, common practice consisted of a series of sensitivity studies that change one variable at a time. This becomes impractical for a design with hundreds of variables.<ref name="N-5-44">Notarianni (2002), p. 5-44.</ref> A complete analysis therefore treats quantitatively only the parameters that could cause switchover, and uses best estimates for the rest.<ref name="N-5-44" />

== Propagating input uncertainty ==
For simple relations, the effect of an input uncertainty can be estimated without running a model many times. A validation study for nuclear power plants used empirical correlations for this purpose.<ref name="HM-5-1">Hamins and McGrattan (2007), p. 5-1.</ref> According to the correlation of McCaffrey, Quintiere and Harkleroad, the temperature rise of the hot gas layer is proportional to the heat release rate raised to the power 2/3.<ref name="HM-5-1" /> A small relative uncertainty in the heat release rate therefore produces a relative uncertainty in the temperature rise of two-thirds that size:<ref name="HM-5-2">Hamins and McGrattan (2007), p. 5-2.</ref>

<math display="block">\Delta T \propto \dot{Q}^{2/3} \quad \Rightarrow \quad \frac{\delta(\Delta T)}{\Delta T} \approx \frac{2}{3} \, \frac{\delta \dot{Q}}{\dot{Q}}</math>

The same study found the layer height to be much less sensitive. A 15 % to 25 % increase in heat release rate lowers the layer height by only 1 % to 2 %.<ref name="HM-5-2" /> Such approximations have limits. In a NIST study, a 10 % higher heat release rate should have raised the upper layer temperature by about 6.7 % according to the correlation. A computer simulation gave 9 %, at temperatures above the range of the data behind the correlation.<ref name="M5F-28">McGrattan et al. (2005), p. 28.</ref>

Independent uncertainties are combined as the square root of the sum of their squares.<ref name="HM-1-10">Hamins and McGrattan (2007), p. 1-10.</ref> The same study compared each model prediction with a measurement through the relative difference <math>\varepsilon</math> between the predicted and measured rise. It judged the difference significant when it exceeded the combined relative expanded uncertainty:<ref name="HM-1-11">Hamins and McGrattan (2007), p. 1-11.</ref>

<math display="block">U_\varepsilon \approx \sqrt{\tilde{U}_M^2 + \tilde{U}_E^2}, \qquad |\varepsilon| > U_\varepsilon</math>

{| class="wikitable"
! Symbol !! Description !! Unit
|-
| <math>\Delta T</math> || temperature rise of the hot gas layer above ambient || K
|-
| <math>\dot{Q}</math> || heat release rate || kW
|-
| <math>\delta(\cdot)</math> || uncertainty of the quantity in brackets || unit of that quantity
|-
| <math>\varepsilon</math> || relative difference between predicted and measured rise || –
|-
| <math>\tilde{U}_M</math> || relative expanded uncertainty of the prediction due to its inputs || –
|-
| <math>\tilde{U}_E</math> || relative expanded uncertainty of the measurement || –
|-
| <math>U_\varepsilon</math> || combined relative expanded uncertainty || –
|}

An expanded uncertainty with an expansion factor of two corresponds to two standard deviations and a confidence level of about 95 %.<ref name="HM-1-8">Hamins and McGrattan (2007), p. 1-8.</ref> This combined uncertainty does not include the intrinsic uncertainty of the model, such as the two-layer assumption of a zone model or the grid size of a CFD model.<ref name="HM-1-8" /><ref name="HM-1-11" /> The two-thirds rule describes small changes, and it holds only within the range of the data behind the correlation.<ref name="HM-5-3">Hamins and McGrattan (2007), p. 5-3.</ref><ref name="M5F-28" /> The root-sum-square rule assumes that the two uncertainties are independent.<ref name="HM-1-10" />

=== Worked example ===
The measured heat release rates in the experiments of the validation study had uncertainties of 15 % to 25 %.<ref name="HM-5-1" /> By the two-thirds rule, an uncertainty of 15 % in the heat release rate gives about 10 % in the predicted temperature rise of the hot gas layer. An uncertainty of 25 % gives about 17 %.<ref name="HM-5-2" />

The study illustrates the combination with an upper layer temperature. The predicted rise was about 330 °C and the measured rise about 270 °C, so the relative difference is (330 − 270) / 270, or about 0.22.<ref name="HM-1-12">Hamins and McGrattan (2007), p. 1-12.</ref> The two relative expanded uncertainties were about 20 % and 10 %. Combined, they give the square root of 0.20² + 0.10², which is also about 0.22.<ref name="HM-1-12" />

The relative difference is therefore about as large as the combined uncertainty. The data cannot show whether the model really over-predicts, because the difference lies at the edge of what the uncertainties allow.<ref name="HM-1-11" /> With smaller uncertainties of 10 % each, the combined value would be about 0.14, and the same difference would be significant.

== Uncertainty in design decisions ==
Many designs deal with uncertainty through safety factors. A safety factor multiplies a design value, while a safety margin is the difference between the design value and the value that would no longer be safe.<ref name="N-5-47">Notarianni (2002), p. 5-47.</ref> Safety factors can be implied, for example in conservative assumptions, or explicit. An example of an explicit factor is multiplying the time needed for escape by 2.<ref name="N-5-47" />

Safety factors behave less simply than they appear. Doubling the heat release rate does not provide a safety factor of 2 on the time available for escape, because the heat release rate is not linearly related to the time to a critical temperature.<ref name="N-5-48">Notarianni (2002), p. 5-48.</ref> Factors applied to two parameters do not simply add up. A choice that is conservative for one outcome can work the other way for another. Doubling the heat of combustion is conservative for the upper layer temperature, while doubling the radiative fraction has the opposite effect.<ref name="N-5-48" />

The ''International Fire Engineering Guidelines'' (2005) link these choices to the [[acceptance criteria]] of a design. For an absolute evaluation, the criteria should take into account the uncertainties in the analysis and the factors of safety employed.<ref name="IFEG-1.2-26">National Research Council of Canada et al. (2005), p. 1.2-26.</ref> The size of the factors should consider, among other things, the redundancy and reliability of the fire safety systems, the methods and assumptions, and the results of an uncertainty analysis. Factors of safety should be applied only at the end of a calculation sequence, because applying them throughout could lead to overly conservative outcomes.<ref name="IFEG-1.2-26" />

A probabilistic statement of performance makes the role of uncertainty explicit. It contains at least four elements: a probability, a time, a performance criterion and a threshold value.<ref name="N-5-53">Notarianni (2002), pp. 5-53–5-54.</ref> An example is a requirement that the design gives a probability of 0.9 of having 4 min or more before the temperature in a corridor reaches 65 °C.<ref name="N-5-53" /> Where values must be rounded for a comparison with limits, the safe direction is preferred: required times are rounded up and available times down.<ref name="VR-1.7" />

== Limits and practical difficulties ==
Uncertainty analysis meets several practical obstacles. There is no agreed quantitative method for performance-based designs, and a mathematically rigorous analysis may seem impractical. Large amounts of data would be needed to define the ranges of inputs such as heats of combustion and species yields.<ref name="N-5-44" /> Some uncertainties go unrecognised, such as values hard-wired into tools, the choice of tenability criteria and the selection of design fires.<ref name="N-5-44" />

Not every uncertainty can or should be quantified. Some quantities, such as societal values, become policy or regulatory issues rather than engineering issues.<ref name="N-5-44" /> In fire PRA, some uncertainties are treated only qualitatively. A basis must then be given for those that are not addressed.<ref name="NW-15-4" /> An importance analysis can point to the inputs that matter most, but a correlation between an input and an output does not prove that one causes the other.<ref name="N-5-59">Notarianni (2002), p. 5-59.</ref>

The uncertainty of the model itself is the hardest part to estimate. [[Verification and validation]] studies provide a bias factor and a relative standard deviation for each predicted quantity. These must be combined with the uncertainty of the inputs chosen by the user, and a sensitivity analysis may be needed in addition.<ref name="S-7-2" /> The ''International Fire Engineering Guidelines'' (2005) suggest that comparing the outputs of several suitable methods can also give an indication of the uncertainty associated with the methods.<ref name="IFEG-1.2-24" />

== See also ==
* [[Ethics in fire safety engineering]]
* [[Quantitative risk assessment]]
* [[Reliability of fire protection systems]]
* [[Fire risk assessment]]
* [[Fire statistics]]

== Notes ==
<references />

== References ==
* Hamins, A., & McGrattan, K. (2007). ''Verification and validation of selected fire models for nuclear power plant applications: Vol. 2. Experimental uncertainty'' (NUREG-1824; EPRI 1011999). U.S. Nuclear Regulatory Commission, Office of Nuclear Regulatory Research; Electric Power Research Institute.
* McGrattan, K. B., Bouldin, C., & Forney, G. P. (2005). ''Computer simulation of the fires in the World Trade Center towers'' (NIST NCSTAR 1-5F). National Institute of Standards and Technology.
* National Research Council of Canada, International Code Council, Department of Building and Housing, & Australian Building Codes Board. (2005). ''International fire engineering guidelines'' (2005 ed.). Australian Building Codes Board.
* Notarianni, K. A. (2002). Uncertainty. In P. J. DiNenno, D. Drysdale, C. L. Beyler, W. D. Walton, R. L. P. Custer, J. R. Hall Jr., & J. M. Watts Jr. (Eds.), ''SFPE handbook of fire protection engineering'' (3rd ed., pp. 5-40–5-64). National Fire Protection Association; Society of Fire Protection Engineers.
* Nowlen, S. P., Najafi, B., Wyant, F. J., Forester, J., Kazarians, M., Kolaczkowski, A., Joglar, F., Funk, D., Hannaman, G., & Anoba, R. (2005b). ''EPRI/NRC-RES fire PRA methodology for nuclear power facilities: Vol. 2. Detailed methodology'' (NUREG/CR-6850; EPRI 1011989). Electric Power Research Institute; U.S. Nuclear Regulatory Commission, Office of Nuclear Regulatory Research.
* Stroup, D., Lindeman, A., McGrattan, K., Peacock, R., Overholt, K., Joglar, F., LeStrange, S., & Montanez, S. (2016). ''Verification and validation of selected fire models for nuclear power plant applications: Supplement 1'' (NUREG-1824, Supplement 1; EPRI 3002002182). U.S. Nuclear Regulatory Commission, Office of Nuclear Regulatory Research; Electric Power Research Institute.
* Van Rossum, E. (2027). ''Introduction to Fire Safety Engineering''. Fire Safety Academy.

[[Category:Fire Risk Analysis]]