U.S. Department of Transportation
Federal Highway Administration
1200 New Jersey Avenue, SE
Washington, DC 20590
202-366-4000


Skip to content
Facebook iconYouTube iconTwitter iconFlickr iconLinkedInInstagram

Federal Highway Administration Research and Technology
Coordinating, Developing, and Delivering Highway Transportation Innovations

 
REPORT
This report is an archived publication and may contain dated technical, contact, and link information
Back to Publication List        
Publication Number:  FHWA-HRT-16-035    Date:  June 2016
Publication Number: FHWA-HRT-16-035
Date: June 2016

 

Safety Evaluation of Intersection Conflict Warning Systems

Chapter 7. Before–After Evaluation Results

Aggregate Analysis

Table 18 through table 21 provide the estimates of expected crashes in the after period without installation, the observed crashes in the after period, and the estimated CMF and its standard error for all crash types considered. Results are provided separately for each State as well as for all States combined. Results are provided separately for individual States because the application practices varied for all three. Minnesota used a variety of post-mounted signs, including static signs with flashers, blank-out signs with flashers, visual displays, and signs with LED arrows indicating the direction of conflicting vehicles. Missouri used post-mounted static signs with flashers exclusively. North Carolina used static signs that were a mix of post mounted and overhead where the overhead signs were installed at the intersection. The results were combined to further draw inferences on the overall effect of ICWSs.

The results for Minnesota in table 18 were inconsistent across crash types and by number of through lanes on the major route. Statistically significant reductions at the 95-percent confidence level were found for fatal and injury crashes for two-lane at two-lane intersections only. However, the sample sizes were quite small, so readers should use caution when attempting to draw meaningful conclusions from the results.

Table 18. Aggregate analysis results for Minnesota.
Statistic Total Fatal and Injury Right-Angle Rear-End Nighttime
Two-Lane at Two-Lane
EB estimate of crashes expected in the after period without strategy
23.00
11.13
6.49
7.62
2.89
Count of crashes observed in the after period
20
6
13
0
3
Estimate of CMF
0.856
0.525
1.945
0.000
1.003
Standard error of estimate of CMF
0.216
0.225
0.618
N/A
0.588
Four-Lane at Two-Lane
EB estimate of crashes expected in the after period without strategy
21.50
8.27
13.80
1.09
1.99
Count of crashes observed in the after period
16
9
9
1
2
Estimate of CMF
0.737
1.052
0.642
0.811
1.003
Standard error of estimate of CMF
0.196
0.388
0.225
0.764
0.710

Statistically significant results at the 95-percent confidence level are indicated in boldface.

The results for Missouri in table 19 indicate reductions for nearly all crash types for both two‑lane at two-lane intersections and four-lane at two-lane intersections. No statistically significant results were found for two-lane at two-lane intersections because of small sample sizes; however, significant reductions were found for four-lane at two-lane intersections. Reductions were found for total crashes, fatal and injury crashes, and nighttime crashes that were significant at the 95‑percent confidence level.

Table 19. Aggregate analysis results for Missouri.
Statistic Total Fatal and Injury Right-Angle Rear-End Nighttime
Two-Lane at Two-Lane
EB estimate of crashes expected in the after period without strategy
47.08
16.18
25.42
5.74
3.71
Count of crashes observed in the after period
37
18
20
4
3
Estimate of CMF
0.777
1.088
0.771
0.642
0.810
Standard error of estimate of CMF
0.151
0.298
0.200
0.343
0.467
Four-Lane at Two-Lane
EB estimate of crashes expected in the after period without strategy
164.26
84.06
75.42
19.51
46.00
Count of crashes observed in the after period
119
47
61
16
28
Estimate of CMF
0.719
0.554
0.799
0.778
0.594
Standard error of estimate of CMF
0.089
0.096
0.134
0.252
0.143

Statistically significant results at the 95 percent confidence level are indicated in boldface.

The results for North Carolina in table 20 indicate statistically significant reductions at the 95‑percent confidence level for all crash types except nighttime crashes for two-lane at two-lane intersections. A statistically significant reduction at the 95-percent confidence level was found for nighttime crashes for four-lane at two-lane intersections; however, insignificant decreases were found for total crashes, fatal and injury crashes, and right-angle crashes. These findings are explored further in the Disaggregate Analysis section of this chapter.

Table 20. Aggregate analysis results for North Carolina.
Statistic Total Fatal and Injury Right-Angle Rear-End Nighttime
Two-Lane at Two-Lane
EB estimate of crashes expected in the after period without strategy
842.71
488.25
490.26
87.10
122.25
Count of crashes observed in the after period
613
338
387
39
110
Estimate of CMF
0.727
0.691
0.788
0.444
0.897
Standard error of estimate of CMF
0.037
0.046
0.050
0.081
0.099
Four-Lane at Two-Lane
EB estimate of crashes expected in the after period without strategy
278.74
163.86
206.25
12.47
37.52
Count of crashes observed in the after period
250
156
182
16
23
Estimate of CMF
0.893
0.947
0.877
1.224
0.595
Standard error of estimate of CMF
0.081
0.104
0.094
0.388
0.157

Statistically significant results at the 95-percent confidence level are indicated in boldface.

The combined results in table 21 indicate reductions for all crash types analyzed for both two‑lane at two-lane and four-lane at two-lane intersections. The reductions were statistically significant at the 95-percent confidence level for all crash types except nighttime crashes for two-lane at two-lane intersections. The reductions were statistically significant at the 95-percent confidence level for all crash types except for rear-end crashes for four-lane at two‑lane intersections.

Table 21. Aggregate analysis results for combined States.
Statistic Total Fatal and Injury Right-Angle Rear-End Nighttime
Two-Lane at Two-Lane
EB estimate of crashes expected in the after period without strategy
912.79
515.56
522.17
100.46
128.84
Count of crashes observed in the after period
670
362
420
43
116
Estimate of CMF
0.733
0.701
0.803
0.425
0.898
Standard error of estimate of CMF
0.035
0.045
0.049
0.073
0.096
Four-Lane at Two-Lane
EB estimate of crashes expected in the after period without strategy
464.50
263.56
295.47
33.07
85.52
Count of crashes observed in the after period
385
212
252
33
53
Estimate of CMF
0.827
0.802
0.850
0.973
0.612
Standard error of estimate of CMF
0.059
0.072
0.075
0.224
0.108

Statistically significant results at the 95-percent confidence level are indicated in boldface.

For two-lane at two-lane intersections, the crash type with the smallest CMF (which translates to the greatest reduction) was rear-end with a CMF of 0.425, which was statistically significant at the 95-percent confidence level. Total, fatal and injury, and right-angle crashes had estimated CMFs of 0.733, 0.701, and 0.803, respectively, which were also statistically significant at the 95‑percent confidence level. Nighttime crashes had an estimated CMF of 0.898, which was not statistically significant at the 95-percent confidence level. It is important to consider the sample size used to develop each CMF when interpreting the results. For example, the sample sizes used to develop CMFs for rear-end and nighttime crashes were relatively low, resulting in larger standard errors and confidence intervals compared with the CMFs for total, fatal and injury, and right-angle crashes.

For four-lane at two-lane intersections, the crash type with the smallest CMF (which was statistically significant at the 95-percent confidence level) was nighttime crashes, with a CMF of 0.612. Total, fatal and injury, and right-angle crashes had estimated CMFs of 0.827, 0.802, and 0.850, respectively, which were also statistically significant at the 95-percent confidence level. Rear-end crashes had an estimated CMF of 0.973, which was not statistically significant at the 95-percent confidence level.

As discussed in the literature review, the most comprehensive study to date of ICWS applications was conducted by Simpson and Troy using data from North Carolina.(1) This reportincludes recommended CMFs for two-lane at two-lane intersection but does not provide recommended CMFs for four-lane at two-lane intersections because the small sample size precluded a rigorous analysis. Simpson and Troy recommended a CMF of 0.897 for total crashes and 0.878 for injury crashes at two-lane at two-lane intersections.(1) Greater crash benefits were indicated in the present study, which were attributed to the following characteristics of the present study:

Disaggregate Analysis

The disaggregate analysis sought to identify those conditions under which the ICWS strategy was most effective. Because total, fatal and injury, and right-angle crashes were the focus of this strategy, these crash types were the focus of the disaggregate analysis. Several variables were identified as being of interest and available for all three States, including installation category, message, presence of turn lanes, presence of lighting, presence of additional countermeasures, major and minor route AADT, major and minor route posted speed limit, and expected crash frequency in the before period.

For installation category, the categories developed by NCDOT were expanded for use in this study. Categories for further analysis were as follows:

For two-lane at two-lane intersections, all categories were considered in the disaggregate analysis. For four-lane at two-lane intersections, categories 3a and 3b were included in the disaggregate analysis. Category 1 and category 2 systems were found only in North Carolina, and these systems were installed at the intersection on both the major and minor road. Category3a signs were found only in Missouri and North Carolina and were installed in advance of the intersection. Category 3b systems were found only in Minnesota and Missouri and were installed at the intersection.

Table 22 provides the disaggregate results by category for two-lane at two-lane intersections and four-lane at two-lane intersections. The number of intersections is indicated for each installation category. For each crash type, the estimated CMF, standard error (in parentheses), and sample size in terms of observed crashes in the after period is provided. It is important to consider the sample size used to develop the CMFs when applying the CMFs.

For two-lane at two-lane intersections, results indicate statistically significant reductions at the 95-percent confidence level for all crash types for category 1, 3a, and 4 systems. Considering the standard errors of the CMFs, it was difficult to draw a conclusion about the relative effectiveness of categories 1, 3a, and 4; with the exception of the CMFs for right-angle crashes, the results were not statistically different at the 95-percent confidence level. The majority of the category 4 sites consisted of a combination of categories 1 and 2 or a combination of categories 3a and 3b.

For four-lane at two-lane intersections, the results indicate statistically significant reductions at the 95-percent confidence level for all crash types for category 3a and for total crashes only for category 3b systems. The CMFs for categories 3a and 3b were not significantly different for any crash type.

Table 22. CMFs by installation category.
Crash Type Installation Category
1 2 3a 3b 4
Two-Lane at Two-Lane
No. of sites (N)
16
15
14
8
16
Total
0.740 (0.070)
173
0.892 (0.075)
241
0.519 (0.056)
120
0.886 (0.162)
42
0.704 (0.087)
94
Fatal and injury
0.600 (0.075)
91
0.944 (0.101)
144
0.450 (0.069)
58
1.064 (0.287)
18
0.742 (0.122)
51
Right-angle
0.807 (0.096)
111
1.084 (0.110)
169
0.454 (0.067)
61
1.247 (0.299)
25
0.697 (0.113)
54
Four-Lane at Two-Lane
No. of sites (N)
N/A
N/A
12
7
N/A
Total
N/A
N/A
0.745 (0.068)
243
0.690 (0.127)
35
N/A
Fatal and injury
N/A
N/A
0.734 (0.083)
138
0.896 (0.210)
22
N/A
Right-angle
N/A
N/A
0.769 (0.082)
174
0.763 (0.173)
23
N/A

Statistically significant results at the 95-percent confidence level are indicated in boldface.
In each cell containing results is the estimated CMF, standard error (in parentheses), and the sample size in terms of observed crashes in the after period.
N/A = Not applicable.

It was not appropriate to compare the effectiveness of overhead versus post-mounted applications on the major route from the study results because the placement of treatment differed for the two groups. Post-mounted ICWSs were installed in advance of the intersection, whereas all overhead signs were installed at the intersection. Ideally, to address the difference between post-mounted and overhead signs, the placement should be taken into consideration. The MUTCD states that warning signs should be placed to provide an adequate PRT. This suggests that the findings in table 22 may have been influenced by system placement, which could not be addressed in this research.(2)

Table 23 presents the disaggregate results for intersections by sign message. For two-lane at two‑lane intersections, the ICWS strategy appeared to be slightly more effective when the message specifically stated “WHEN FLASHING,” compared with signs that did not have the message. Considering the standard errors of the CMFs, there was no statistical difference between the two conditions. All systems in Minnesota located at two-lane at two-lane intersections had a “WHEN FLASHING” message and were therefore considered in this category. There was no apparent difference by message for four-lane at two-lane intersections.

Table 23. CMFs by message (“WHEN FLASHING” versus not present).
Lanes Crash Type Message Expected Observed CMF Standard Error
2
Total crashes
Present
656.20
458
0.697
0.040
Not present
256.59
212
0.824
0.070
Fatal and injury crashes
Present
373.70
242
0.646
0.050
Not present
141.85
120
0.842
0.095
Right-angle crashes
Present
364.80
275
0.752
0.056
Not present
157.38
145
0.918
0.095

Statistically significant results at the 95-percent confidence level are indicated in boldface.

Table 24 presents the disaggregate results by the presence of intersection lighting. There was no apparent difference by lighting presence for two-lane at two-lane intersections. For four-lane at two-lane intersections, the strategy appeared to be more effective at sites with intersection lighting. The difference was statistically significant at the 95-percent confidence level for fatal and injury crashes.

Table 24. CMFs by lighting presence.
Lanes Crash Type Lighting Expected Observed CMF Standard Error
4
Total crashes
Present
169.49
119
0.697
0.085
None
295.01
266
0.898
0.079
Fatal and injury crashes
Present
87.27
48
0.545
0.093
None
176.29
164
0.925
0.099
Right-angle crashes
Present
78.89
62
0.777
0.127
None
216.57
190
0.872
0.090

Statistically significant results at the 95-percent confidence level are indicated in boldface.

Table 25 presents the disaggregate results by expected crash frequency in the before period. There was no apparent difference by expected crash frequency for two-lane at two-lane intersections. For four-lane at two-lane intersections, the ICWS strategy was more effective when the expected crash frequency was higher in the before period. This is logical because the strategy was often used at intersections with unusually high crashes or issues related to limited sight distance. For total crashes, there did not appear to be a benefit if the expected crash frequency was less than or equal to three crashes per year before installation; however, there was a significant reduction for sites with more than three expected crashes per year in the before period. The results for right-angle crashes were significantly different from each other for sites with less than or equal to 2.5 expected crashes per year versus sites with more than 2.5 expected crashes per year before installation. There did not appear to be a benefit if the expected fatal and injury crash frequency was less than or equal to two crashes per year before installation; however, there was a significant reduction for sites with more than two expected fatal and injury crashes per year in the before period.

Table 25. CMFs by before period expected crash frequency.
Lanes Crash Type Crashes
Per Year
Expected Observed CMF Standard Error
4
Total crashes
≤ 3
114.23
121
1.047
0.147
> 3
350.27
264
0.751
0.062
Fatal and injury crashes
≤ 2
66.28
74
1.101
0.179
> 2
197.28
138
0.696
0.075
Right-angle crashes
≤ 2.5
93.32
116
1.228
0.176
> 2.5
202.15
136
0.669
0.075

Statistically significant results at the 95-percent confidence level are indicated in boldface.

 

 

Federal Highway Administration | 1200 New Jersey Avenue, SE | Washington, DC 20590 | 202-366-4000
Turner-Fairbank Highway Research Center | 6300 Georgetown Pike | McLean, VA | 22101