U.S. Department of Transportation
Federal Highway Administration
1200 New Jersey Avenue, SE
Washington, DC 20590
202-366-4000


Skip to content
Facebook iconYouTube iconTwitter iconFlickr iconLinkedInInstagram

Federal Highway Administration Research and Technology
Coordinating, Developing, and Delivering Highway Transportation Innovations

 
REPORT
This report is an archived publication and may contain dated technical, contact, and link information
Back to Publication List        
Publication Number:  FHWA-HRT-16-035    Date:  June 2016
Publication Number: FHWA-HRT-16-035
Date: June 2016

 

Safety Evaluation of Intersection Conflict Warning Systems

Chapter 3. Study Design

The study design involved a sample size analysis and prescription of needed data elements. The sample size analysis assessed the size of sample required to statistically detect an expected change in safety and also determined what changes in safety could be detected with available sample sizes.

Sample Size Estimation Overview

When planning a before–after safety evaluation study, it is vital to ensure that enough data are included such that the expected change in safety can be statistically detected. Even though in the planning stage, the expected change in safety is unknown, it is still possible to make a rough estimate of how many sites would be required based on the best available information about the expected change in safety. Alternatively, one could estimate, for the number of available sites, the change in safety that could be statistically detected. For a detailed explanation of sample size considerations, as well as estimation methods, see chapter 9 of Hauer.(13) The sample size analysis presented here is limited to two cases: (1) how large a sample would be required to statistically detect an expected change in safety, and (2) what changes in safety could be detected with available sample sizes.

For case 1, it was assumed that a conventional before–after study with comparison group design would be used because available sample size estimation methods were based on this assumption. The sample size estimates from this method would be conservative in that the EB methodology would likely require fewer sites. To facilitate the analysis, it was also assumed that the number of comparison sites was equal to the number of installation sites and the duration of the before and after periods were equal, which, again, was a conservative assumption.

Table 2 provides the crash rate assumptions. The locations of interest for the ICWS strategy were four-legged, stop-controlled intersections. Intersection crash rates differ substantially depending on a number of factors (e.g., traffic control, traffic volume, geometric configuration, and area type). Therefore, the intersection crash rates assumed for these computations represented the before data for installation sites in North Carolina, Missouri, and Minnesota. Rates A and B were calculated as the weighted average crash rate for two-lane and multilane major routes, respectively.

Table 2. Before period crash rate assumptions for four-legged, stop-controlled intersections.
Crash Type Crash Rate (crashes/intersection/yr)
North Carolina Missouri Minnesota Rate A Rate B
Two-Lane Multilane Two-Lane Multilane Two-Lane Multilane Two-Lane Multilane
Total 3.817 4.317 1.932 3.712 1.535 5.929 3.300 4.246
Fatal and injury 2.228 2.867 0.886 1.962 0.744 3.786 1.877 2.596
Right-angle 2.430 3.150 1.091 2.077 0.698 3.571 2.049 2.754
Rear-end 0.304 0.217 0.159 0.519 0.209 0.500 0.274 0.373
Nighttime 0.494 0.583 0.295 0.885 0.209 1.071 0.434 0.762

Table 3 provides estimates of the required number of before and after period intersection-years for statistical significance at both a 90- and 95-percent confidence level for crash rates A and B. The minimum sample indicates the level for which a study seemed worthwhile; that is, it was feasible to detect with the level of confidence the largest effect that could reasonably be expected based on what was currently known about the ICWS strategy. These sample size calculations were based on specific assumptions regarding the number of crashes per intersection and years of available data. Rate A (from table 2) was used for two-lane at two-lane intersections, and rate B (from table 2) was used for four-lane at two-lane intersections. Site-years are the number of sites where the strategy was implemented multiplied by the number of years of data before or after implementation. For example, if a strategy was implemented at nine sites and data were available for 3 years since implementation, then there would be a total of 27 site-years of after period data available for the study.

Table 3. Minimum required before period site-years for ICWS installation sites.
Expected Percent Reduction in Crashes Minimum Before Period Site-Years1
95-Percent Confidence 90-Percent Confidence
Rate A Rate B Rate A Rate B
Total 10 564 439 351 273
20 85 66 59 46
30 29 23 21 16
40 13 10 9 7
Fatal and injury 10 991 717 616 446
20 149 108 103 75
30 51 37 36 26
40 22 16 16 12
Right-angle 10 908 676 564 420
20 136 102 94 70
30 47 35 33 25
40 20 15 14 11
Rear-end 10 6,788 4,987 4,218 3,098
20 1,017 747 703 516
30 346 254 242 178
40 149 110 105 77
Nighttime 10 4,286 2,441 2,663 1,517
20 642 366 444 253
30 219 125 153 87
40 94 54 66 38

1Assumes equal number of site-years for ICWS installation and comparison sites
and equal length of before and after periods.
Boldface indicates the sample size values recommended in this study.

The sample size values recommended in this study are highlighted in bold in table 3. These were recommended based on the likeliness of obtaining the estimated sample size as well as the anticipated effects of the ICWS strategy. As noted, the sample size estimates provided were conservative in that the state-of-the-art EB methodology proposed for the evaluations would require fewer sites than the less robust conventional before–after study with a comparison group that had to be assumed for the calculations. Estimates could be predicted with greater confidence or a smaller reduction in crashes would be detectable if there were more site-years of data available in the after period. The same holds true if the actual data used for the analysis had a higher crash rate for the before period than was assumed.

Case 2 considers the data collected for both the before and after periods. The total site-years of data available for two-lane major roadways was 360 for the before period and 255 for the after period. The total site-years of data available for multilane major roadways was 126 for the before period and 100 for the after period. The statistical accuracy attainable for a given sample size is described by the standard deviations of the estimated percent change in safety. From this, P‑values were estimated for various sample sizes and expected changes in safety for a given crash history. A set of such calculations is shown in table 4 and table 5. The calculations are based on the methodology in Hauer.(13)

For the available data, the minimum percentage change in crash frequency that could be statistically detected at 90- and 95-percent significance levels were estimated using the same crash rates in table 2. The results indicate that the data should be able to detect the anticipated crash reduction effects highlighted in table 3 (i.e., 20-percent reductions for all crash types except for rear-end and nighttime crashes for both two-lane and multilane roadways), if such an effect were present. Using these results, a decision was made to proceed with the evaluation using the data available at the time.

Table 4. Sample analysis for crash effects (two-lane intersections).
Crash Type Intersection-Years in Before Period Intersection-Years in After Period Minimum Percent Reduction Detectable for Crash Rate Assumption1
P = 0.10 P = 0.05
Total 360 255 10 15
Fatal and injury 15 15
Right-angle 15 15
Rear-end 30 30
Nighttime 25 25

1Results are to nearest 5-percent interval, and the crash rate assumption is based on actual crash rate for the before period.

Table 5. Sample analysis for crash effects (multilane intersections).
Crash Type Intersection-Years in Before Period Intersection-Years in After Period Minimum Percent Reduction Detectable for Crash Rate Assumption1
P = 0.10 P = 0.05
Total 126 100 15 15
Fatal and injury 20 20
Right-angle 15 20
Rear-end 35 40
Nighttime 30 30

1Results are to nearest 5-percent interval, and the crash rate assumption is based on actual crash rate for the before period.

 

 

Federal Highway Administration | 1200 New Jersey Avenue, SE | Washington, DC 20590 | 202-366-4000
Turner-Fairbank Highway Research Center | 6300 Georgetown Pike | McLean, VA | 22101