2. Health Risk Assessments Prepared per the Risk Assessment
Reforms under Consideration in the U.S. Congress


Cambridge Environmental Inc.
58 Charles Street
Cambridge, MA 02141


1. Summary

The Commission on Risk Assessment and Risk Management retained Cambridge Environmental Inc. to conduct case studies of health risk assessment that conform with proposed regulatory reform legislation1 and to comment, as risk assessors, on the required methods. The principal relevant mandate in these legislative proposals is that the conservative point estimates of risk currently generated and relied upon be augmented with estimates that are in some sense "best"--that are central tendency estimates, generated by taking better account of the uncertainties and variabilities in the underlying data and assumptions.

To illustrate the techniques required to satisfy such a mandate, we studied four cases. The objective of the first case study was to estimate incremental lifetime risk of cancer to an individual in a population whose water supply had been contaminated with part-per-billion levels of 1,1-dichloroethylene (1,1-DCE). The second case study differed from the first only in that 1,1-DCE was allowed, consistent with its dose-response data, to have either an anticarcinogenic or a carcinogenic potency, rather than being constrained to have only a carcinogenic potency, as is the current regulatory norm. The third case study differed from the first only in that it considered exposure similar levels of vinyl chloride, a potent and known human carcinogen, rather than exposure to the equivocally carcinogenic 1,1-DCE. The fourth case study estimated incremental lifetime risk of cancer associated with occupational exposures, rather than low-level environmental exposures, to 1,1-DCE.

For each case study, we first estimated the incremental lifetime risk of cancer to a "reasonably maximally exposed individual" using the methods currently recommended by U.S. EPA. We then prepared a distribution of risk estimates by choosing parameter values for each variable from the distribution defined for that variable and combining these choices in the risk equation. These latter tasks required (1) significant research in the scientific literature, and (2) not a small amount of statistical and computational expertise, Using computer software we created, we repeated the risk calculation about 20,000 times, gathering up each estimate of incremental lifetime risk of cancer to define its distribution. From the distribution, we could estimate the mean, median and 95th percentile (and other statistics) of the distribution for the incremental lifetime risk of cancer. Each of these might be considered a "best" estimate of risk.

The results of the four case studies are summarized in the following table.



Table 1. Statistics of the distributions of risk estimates from the case studies

Current EPA-style
point-estimate
Median (reasonably
Case (50th percentile) Mean 95th percentile maximum exposure)
1,1-DOE, standard 1.2 x 10-9 1.6 x 10-6 1.7 x 10-6 1.3 x 10-4
1,1-DOE, non-standard -2.0 x 10-9 -9.5 x 10-6 1.7 x 10-6 --
Vinyl chloride (standard) 1.4 x 10-6 8.8 x 10-5 2.0 x 10-4 4.1 x 10-4
1,1-DOE workers 1.4 x 10-6 3.6 x 10-3 8.4 x 10-3 2.7 x 10-2


Several comparisons are noteworthy. In the first case study, U.S. EPA methods (specifically, those used for risk assessment of Superfund sites) yielded a point-estimate of risk of 1.3 x 10-4. Although such an upper-bound point estimate is typically assumed by many to be at about the 95th percentile of the risk estimate distribution, it corresponded here to the 99.8th percentile of such a distribution. The probabilistic method employed here found that the 95th percentile of the distribution was about 80-fold lower -- 1.7 x 10-6. These two different estimates -- both upperbound -- would likely indicate dramatically different intervention strategies. Risks as high as the former often require extensive remediation, whereas risks as low as the latter usually do not.

The second case study, in which exposures to 1,1-DCE were allowed to confer either beneficial or detrimental effects on cancer risk, yielded two central tendency estimates of risk that were negative -- so suggested that low levels of 1,1-DCE might confer no excess risk of cancer, and might even confer a small benefit. Nonetheless, the 95th percentile of the distribution of risk estimates in the second case study was identical to that estimated in the first case study (1.7 x 10-6). Thus, allowing the relevant portions of the bioassay data themselves to define the slope and bounds of the dose-response curve -- as opposed to imposing standard, regulatory restrictions on that curve -- yielded both dramatically different central tendency estimates and identical upper-bound estimates.

The third case study, in which exposures to vinyl chloride were substituted for dose-equivalent exposures to 1,1-dichloroethylene, yielded a point estimate of risk (4.1 x 10-4) that was only three times larger than the point estimate generated in the first study for 1,1-DCE. Such a minor difference belies the substantial differences in the quality and quantity of data surrounding the carcinogenicity of these two chemicals. In contrast, the probabilistic methods yield a 95th percentile estimate for the risks from vinyl chloride that is some 120-times larger than the estimate from 1,1-DCE.

Finally, the fourth case study suggested that (1) occupational exposures to 1,1-DCE were as expected, substantially riskier than low-level environmental exposures, and (2) that the point estimate of risk is only some three-fold larger than the 95th percentile estimate. Under certain circumstances, such as relatively high exposures, the deterministic and probabilistic methods may thus yield reasonably similar upper-bound estimates of risk.

Working through these case studies, we have reached certain conclusions about the proposed risk assessment reforms. Among these opinions are:

  • Performing risk assessment holistically and probabilistically is not easy. Considerable research must be made into the ranges of plausible estimates for a vast number of inputs. Considerable quantitative expertise including computer-programming skills, are required to design and implement the method. The risk assessor must genuinely understand -- as opposed to merely use -- many sorts of models -- and perhaps be able to create some anew. He or she must combine distributions in valid manners.

  • Current point-estimates of risk may obscure underlying scientific complexities and other important information. Public health policy demands upper-bound estimates of risk; but if these are calculated too crudely, they prevent efficient, health-protective decision-making.

  • Under various circumstances, probabilistic risk assessment may indeed be informative and worthwhile. Techniques used to generate risk estimates should scale with the situation to be assessed. Some situations can be shown to be harmless under almost any method of risk analysis; running full Monte Carlo analyses on these would be inefficient. Other situations are much harder to call, have high stakes, or otherwise demand more sophisticated analysis. For such situations, probabilistic methods, carefully and honestly implemented, may offer the best current hope.

  • Health risk assessment is typically dominated by uncertainty, rather than by variability. Distributions of estimates of health risk are remarkably broad; and most of that breadth is due to our fundamental uncertainty about the health effects of low-level exposures to environmental chemicals, not to variations in people's exposures. The high ends of a risk distribution are driven primarily by "pessimistic" interpretations of, but consistent with, the dose-response data. These data typically derive from over-exposed rodents whose responses may or may not predict human responses in the situation under analysis.

  • Central tendency, mean or median estimates of risk are unlikely to provide a full, useful basis for public health decision-making. One really needs the full distribution. However, a properly derived 95th percentile estimate of risk, supplemented with mean and median estimates, may provide a set of three bottom lines that can indeed be a basis for sound public policy. There is no single estimator of risk appropriate to all situations, and the definition of the estimator matters greatly. Further, no matter what estimator of risk might be chosen, the estimate must be compared with some standard for decision-making, and that choice of standard is also crucial.

  • An entirely scientific risk assessment is a mirage. There is no single right way to do it. Sound policy should indeed rest on sound science. But risk assessment is not and cannot be a wholly scientific undertaking. Risk assessment often turns upon details that are inherently unknowable. In general, probabilistic and holistic risk assessments could lead to improved decision-making. Whether such assessments prove to be more defensible than the status quo is harder to say.



  • 1In particular, bills S 343 and HR 1022.





  • Table of Contents to Full Report

  • Next Abstract

  • Next Appendix