U.S. Department of Transportation
Federal Highway Administration
1200 New Jersey Avenue, SE
Washington, DC 20590
202-366-4000


Skip to content
Facebook iconYouTube iconTwitter iconFlickr iconLinkedInInstagram

Federal Highway Administration Research and Technology
Coordinating, Developing, and Delivering Highway Transportation Innovations

 
REPORT
This report is an archived publication and may contain dated technical, contact, and link information
Back to Publication List        
Publication Number:  FHWA-HRT-17-086    Date:  January 2018
Publication Number: FHWA-HRT-17-086
Date: January 2018

 

Safety Evaluation of Multiple Strategies at Stop-Controlled Intersections

Chapter 4. Study Design

The study design involved a sample size analysis and prescription of needed data elements. The sample size analysis assessed the size of sample required to statistically detect an expected change in safety and determined what changes in safety could be detected with available sample sizes.

Sample Size Estimation Overview

When planning a before–after safety evaluation study, it is vital to ensure that enough data are included such that the expected change in safety can be statistically detected. Even though in the planning stage the expected change in safety is unknown, it is still possible to make a rough estimate of how many sites would be required based on the best available information about the expected change in safety. Alternatively, one could estimate, for the number of available sites, the change in safety that could be statistically detected. For a detailed explanation of sample size considerations, as well as estimation methods, see chapter 9 of Hauer.(15) The sample size analysis presented here is limited to two cases: (1) how large a sample would be required to statistically detect an expected change in safety; and (2) what changes in safety could be detected with available sample sizes.

For case 1, it was assumed that a conventional before–after study with comparison group design would be used because available sample size estimation methods were based on this assumption. The sample size estimates from this method would be conservative in that the empirical Bayesian (EB) methodology would likely require fewer sites. To facilitate the analysis, it was also assumed that the number of comparison sites was equal to the number of installation sites and the duration of the before and after periods were equal, which, again, was a conservative assumption.

Table 2 provides the crash rate assumptions. It shows the average number of crashes per year per intersection in the before period for each combination of crash type and intersection configuration. The locations of interest for this strategy were three- and four-legged, stop-controlled intersections. Intersection crash rates differ substantially depending on a number of factors (e.g., traffic control, traffic volume, geometric configuration, and area type). Therefore, the intersection crash rates assumed for these computations represented a general estimate based on the reference sites identified for this study. Rates A and B represent rural and urban, four-legged, stop-controlled intersections with two-lane major roads, respectively. Rates C and D represent rural and urban, stop-controlled intersections with four-lane major roads, respectively.

Table 2. Before-period crash rate assumptions for four-legged stop-controlled intersections.
Crash Type Rate A (SC)
Rural Stop-Controlled Intersections
with 2-Lane Major Roads
Rate B (SC)
Urban Stop-Controlled Intersections
with 2-Lane Major Roads
Rate C (SC)
Rural Stop-Controlled Intersections
with 4-Lane Major Roads
Rate D (SC)
Urban Stop-Controlled Intersections
with 4-Lane Major Roads
Total 1.400 1.966 1.752 2.232
Injury 0.542 0.625 0.669 0.692
Rear-end 0.253 0.633 0.309 0.718
Right-angle 0.460 0.761 0.706 0.927

Crash rate = crashes/intersection/year.

Table 3 to table 6 provide estimates of the required number of before- and after-period intersection-years for total, fatal and injury, rear-end, and right-angle crashes, respectively, at four-legged stop-controlled intersections assuming both 90- and 95-percent confidence levels. Columns labeled “A-95%” and “A-90%” indicate Rate A (rural four-legged, stop-controlled with two-lane major roads) with 95- and 90-percent confidence levels, respectively. Similarly, columns labeled “B-95%,” “C-95%,” and “D-95%” indicate rates B, C, and D at the 95-percent confidence level. Columns labeled “B-90%,” “C-90%,” and “D-90%” indicate rates B, C, and D at the 90-percent confidence level. The minimum sample indicates the amount of data necessary to detect the safety effects with a desirable level of statistical significance. Larger safety effects require less data to achieve the same confidence level. These sample size calculations were based on specific assumptions regarding the number of crashes per intersection and years of available data. Intersection-years were the number of intersections where the strategy was implemented multiplied by the number of years of data before or after implementation. For example, if a strategy was implemented at nine intersections and data were available for three years since implementation, then there would be a total of 27 intersection-years of after period data available for the study. The number of intersection-years was estimated by first estimating the required number of intersection-related crashes and then dividing by the appropriate intersection crash rate.

Table 3. Minimum required before period intersection-years for treated sites—total crashes.
Expected Percent Reduction
in Crashes
A-95% B-95% C-95% D-95% A-90% B-90% C-90% D-90%
10 1,325 944 1,059 831 824 586 658 517
15 420 299 336 263 284 202 227 178
20 199 142 159 125 138 98 110 86
25 111 79 89 70 78 55 62 49

Note: Assumes equal number of site-years for treatment and comparison sites and equal length of before and after periods.

Table 4. Minimum required before period intersection-years for treated sites—fatal and injury crashes.
Expected Percent Reduction
in Crashes
A-95% B-95% C-95% D-95% A-90% B-90% C-90% D-90%
10 3,423 2,968 2,773 2,681 2,127 1,845 1,723 1,666
15 1,085 941 879 850 734 637 595 575
20 515 446 417 403 356 309 288 279
25 288 250 233 225 201 174 163 158

Note: Assumes equal number of site-years for treatment and comparison sites and equal length of before and after periods.

Table 5. Minimum required before period intersection-years for treated sites—rear-end crashes.
Expected Percent Reduction
in Crashes
A-95% B-95% C-95% D-95% A-90% B-90% C-90% D-90%
10 7,332 2,930 6,003 2,584 4,557 1,821 3,731 1,606
15 2,324 929 1,903 819 1,573 629 1,288 554
20 1,103 441 903 389 763 305 625 269
25 617 246 505 217 431 172 353 152

Note: Assumes equal number of site-years for treatment and comparison sites and equal length of before and after periods.

Table 6. Minimum required before period intersection-years for treated sites—right-angle crashes.
Expected Percent Reduction
in Crashes
A-95% B-95% C-95% D-95% A-90% B-90% C-90% D-90%
10 4,033 2,438 2,627 2,001 2,507 1,515 1,633 1,244
15 1,278 773 833 634 865 523 564 429
20 607 367 395 301 420 254 273 208
25 339 205 221 168 237 143 154 118

Note: Assumes equal number of site-years for treatment and comparison sites and equal length of before and after periods.

Case 2 considers the data collected for both the before and after periods. The statistical accuracy attainable for a given sample size is described by the standard deviations of the estimated percent change in safety. From this, p-values are estimated for various sample sizes and expected changes in safety for a given crash history. A set of such calculations is shown in Table 7 through table 10. The calculations are based on the methodology in Hauer.(15) The tables indicate the total intersection-years of data available in the before and after period.

Table 7. Sample analysis for crash effects* (rural two-lane intersections).
Crash Type Intersection-Years
in Before Period
Intersection-Years
in After Period
(Assumes 2-Year After Period for Each Site)
Minimum Percent Reduction
p = 0.10**
Minimum Percent Reduction
p = 0.05**
Total 3,195 1,278 10 10
Fatal and injury 3,195 1,278 10 15
Rear-end 3,195 1,278 15 15
Right-angle 3,195 1,278 10 15

*Results are to nearest 5-percent interval.

**Minimum percent reduction detectable for crash rate assumption. Crash rate assumption is based on actual crash rate for the before period from table 2.

Table 8. Sample analysis for crash effects* (urban two-lane intersections).
Crash Type Intersection-Years
in Before Period
Intersection-Years
in After Period
(Assumes 2-Year After Period for Each Site)
Minimum Percent Reduction
p = 0.10**
Minimum Percent Reduction
p = 0.05**
Total 3,195 1,278 10 10
Fatal and injury 3,195 1,278 10 10
Rear-end 3,195 1,278 10 10
Right-angle 3,195 1,278 10 10

*Results are to nearest 5-percent interval.

**Minimum percent reduction detectable for crash rate assumption. Crash rate assumption is based on actual crash rate for the before period from table 2.

Table 9. Sample analysis for crash effects* (rural four-lane intersections).
Crash Type Intersection-Years
in Before Period
Intersection-Years
in After Period
(Assumes 2-Year After Period for Each Site)
Minimum Percent Reduction
p = 0.10**
Minimum Percent Reduction
p = 0.05**
Total 3,195 1,278 10 10
Fatal/injury 3,195 1,278 10 10
Rear-end 3,195 1,278 15 15
Right-angle 3,195 1,278 10 10

*Results are to nearest 5-percent interval.

**Minimum percent reduction detectable for crash rate assumption. Crash rate assumption is based on actual crash rate for the before period from table 2.

Table 10. Sample analysis for crash effects* (urban four-lane intersections).
Crash Type Intersection-Years
in Before Period
Intersection-Years
in After Period
(Assumes 2-Year After Period for Each Site)
Minimum Percent Reduction
p = 0.10**
Minimum Percent Reduction
p = 0.05**
Total 3,195 1,278 5 10
Fatal and injury 3,195 1,278 10 10
Rear-end 3,195 1,278 10 10
Right-angle 3,195 1,278 10 10

*Results are to nearest 5-percent interval.

**Minimum percent reduction detectable for crash rate assumption. Crash rate assumption is based on actual crash rate for the before period from table 2.

Another strategy is to estimate the level of significance (i.e., the p-value) for which a minimum desired effect can be detected. For instance, assume the minimum desired level of effect is ten percent for total and target crashes. Based on the current knowledge of available data, table 11 indicates the p-value associated with a 10-percent change in crashes based on the before period data. These calculations use the crash rates from table 2. Given the existing sample size, it is likely this study can detect moderate treatment effects (e.g., a 10-percent change in total crashes) at the 10-percent level of significance.

Table 11. p-value for 10-percent change in crashes.
Crash Type Rural 2-Lane Urban 2-Lane Rural 4-Lane Urban 4-Lane
Total 0.03 0.02 0.02 0.01
Fatal and injury 0.12 0.10 0.09 0.09
Rear-end 0.27 0.10 0.22 0.09
Right-angle 0.15 0.08 0.09 0.06

Reference Group Overview

A reference group is required for the various intersection groups, including rural and urban, three- and four-legged, stop-controlled intersections with two- and four-lane major roads. Each reference group should consist of untreated sites adjacent to or in the vicinity of the treated sites. The untreated sites in each reference group should have geometric, traffic, and crash data for the same years as treated sites. Each reference group should be similar to its corresponding treatment group—particularly in terms of area type (e.g., urban or rural), geometric configuration (e.g., number of legs and number of through lanes), and annual average daily traffic (AADT)except that these intersections were not treated during the study period. These sites are used in the calibration of safety performance functions (SPFs). Based on previous experience in similar analyses, the research team determined that at least 30 intersections for each intersection type in reference group would be desirable, as shown in table 12. Where it is impractical or infeasible to obtain the required sample size for one or more intersection groups, it is possible to combine groups and account for the differences through statistical modeling during the development of SPFs.

Table 12. Reference groups and desirable sample sizes.
Number of Legs Number of Through
Lanes on Major Road
Rural Urban Total
3 2-lane 30 30 60
3 4-lane 30 30 60
4 2-lane 30 30 60
4 4-lane 30 30 60
Total 120 120 240

—Not applicable.

Federal Highway Administration | 1200 New Jersey Avenue, SE | Washington, DC 20590 | 202-366-4000
Turner-Fairbank Highway Research Center | 6300 Georgetown Pike | McLean, VA | 22101