Summary of Meeting Paper

The 1996 Annual Meeting of the Society for Risk Analysis-Europe

Evaluating Uncertainty of Computing Methods in Estimating Consequences of Major Industrial Hazards. M. E. Soggiu, L. Lauria, and G. Marsili, Istituto Superiore di Sanità, Rome, Italy

The uncertainty affecting individual death risk estimates in Probabilistic Risk Assessment (PRA) is a key variable in regulatory decision-making about major industrial hazards and it must be evaluated Despite the numerous and different sources of uncertainty, some main contributors to the overall uncertainty can be identified In this paper an exercise of accidental liquid chlorine release was conducted and the uncertainty contributions due to the intrinsic variability of input variables, the discharge and dispersion models, and the computational procedures were evaluated Results point out that variability of input variables accounts for most of the overall uncertainty closer to the release source, while the discharge and dispersion model uncertainty accounts for most of the overall uncertainty at greater distances. However, due to the large positive skewness of frequency distribution of individual death risk, attention should always be paid to the computational procedures. In particular, a sensitivity analysis of the numerical integration models, such as the Monte Carlo method, should always be carried out in order to determine the reliability of the reference values selected for the PRA.

Introduction

The estimate of consequences in Probabilistic Risk Assessment (PRA) of major industrial hazards requires that the uncertainty of results be evaluated. In a recent study comparing true uncertainty and variability affecting risk estimates for an accidental release of liquid chlorine, we found that the overall uncertainty increases with distances from release source. Additionally, at increasing distance, true uncertainty accounts for an ever greater proportion of total uncertainty (Marsili et al., this meeting).

Risk estimate for an accidental toxic chemical release is quite complex and requires the consideration of a large number of input variables as well as the assumption of hypotheses and approximations in modelling the phenomena involved. Consequently, uncertainty due to a large number of sources will affect the risk estimates.

From a theoretical point of view, the overall uncertainty can be divided into the intrinsic variability of the input variables and into the true uncertainty due to modelling, computation and simulation methods.

In this paper we discuss the different kinds of true uncertainty, from hereon referred to simply as uncertainty, in order to evaluate the contributions of each of them to the risk estimates.

Materials and methods

Frequency distributions of individual death risk were estimated by a model employing:

  1. the sampling of 34 hole diameters from the range of possible values and estimating, for each one of them the expected concentration and individual death probability using the Phast package;

  2. the identification of two best fitting functions, the first one relating hole diameter to expected concentration and the second one relating concentration to death probability;

  3. the application of the identified functions to the frequency distributions of hole diameters in order to obtain a frequency distribution of individual death probability. Individual risk is then estimated by the product between release probability multiplied by individual death probability. All distributions were numerically integrated using the Monte Carlo (MC) method.

For this procedure two different sources of uncertainty can be identified. The first one is due to the Phast package model and the second one due to the two best-fitting functions.

Uncertainty due to the discharge and dispersion model was evaluated from field experiments and is represented by a fractional bias (FB), in this case indicating an underestimation by the Phast package, and by the normal mean square error (NMSE), which accounts for casual error (Hanna S.R. et al., 1991).

The two best-fitting functions, identified by a pseudo Gauss-Newton algorithm (Ralston M.L. et al. 1978) are:

Cd = a+bF+cF2

and

Pr = e+f Ln(Cd)

where a,b,c,e and f are best-fit function parameters

Cd = expected concentration at distance d

F   = hole diameter

Pr = probit value by which death probability can be estimated by integrating the normal
       distribution (with mean 5 and variance 1) up to Pr.

Uncertainty introduced in the results by these functions was estimated by the standard errors of the relative fits and is reported in table I, along with FB and NMSE.


Table I

Results

Frequency distributions of individual death risk, reported in figure 1, were computed at distances of 200, 250, 300 and 600 meters from the release source for the three following cases:

Results show that at increasing distance from release source, variability accounts less and less for the overall uncertainty. This finding is particularly emphasized in positively skewed frequency distribution when the right tail of distribution is considered. In our study, at distances of 200 and 600 m, variability respectively accounts for 91% and 22% of the overall uncertainty at the 95th percentile.

Figure 1: Frequency distributions for individual death risk. First point on the left = 5th percentile; second point = 50th percentile; third point = 95th percentile.


Within the uncertainty, the contribution of both the uncertainties of the model and of the computing procedure can be evaluated for the same percentile. In particular, at every distance the model uncertainty is predominant, but it counts ever less at greater distances. Overall, the results suggest that considering the 95th percentile of frequency distribution of individual death risk, the model uncertainty and the computing procedure uncertainty, respectively, account for 8.9% and 0.1% at 200 m and for 64% and 14% at 600 m from release source.

In this exercise, the input distributions are strongly positive skewed and the higher percentiles are used as reference values for the PRA study. Since the tails are invariably less stable than the central percentiles it is therefore important to investigate the numerical stability of the output frequency distribution.

Therefore, a sensitivity analysis of the Monte Carlo method (Burmaster D.E. et al., 1994) used in the exercise was implemented for cases A, B, and C above. For each case, a 1000 trial MC simulation was performed and the sensitivity of the method was tested re-running the simulation 500 times with different random input numbers. The 95th percentile for each simulation was taken; when case A and B were compared, the resulting distributions overlapped. This overlap might hide a real difference between the two models. Consequently a second simulation using 10000 trials was used. The same sensitivity analysis permitted the demonstration of the difference in the 95th percentile distributions of the two cases. In table II, the 5th, 50th and 95th percentile distributions are reported for the individual death probability at 300 m from the release source for case C. The variation coefficient of the higher percentile is equal to 4%, while for the first MC implementation with 1000 trials this value was equal to 13%.


Table II

The MC simulation was implemented on an IBM mainframe which uses a powerful pseudo random number generator. When 10000 trials are used, a good stability of the estimates of risk is assured, and it becomes possible to evaluate the role of the different uncertainties introduced by the various computation procedures.

References

Marsili G., L. Lauria, M. E. Soggiu (1996): Uncertainty and Variability in Probabilistic Risk Assessment of Accidental Release of Toxic Chemical, this meeting.

Hanna S. R., Strimaitis D. G., Chang J. C. (1991): Evaluation of fourteen hazardous gas models with ammonia and hydrogen flouride fiel data, Journal of Hazardous Materials, 26, 127-158.

Burmaster D. E. and Anderson P. D. (1994): principles of good practice for the use of Monte Carlo technique in Human health and ecological Risk Assessment, Risk Analysis, 14, 477-481.

Ralston M. L. and Jennrich R. I. (1978): DUD, a derivative free algorithm for nonlinear least squares, Technometrics, 20, 7-14.


Acknowledgement: This research was partially supported by a financial contribution by the Gruppo Nazionale per la difesa dai rischi chimico industriali ecologici of the National research Council. Grant N.95.02008.PF37.