In this first set of modeling, specific pavement types were used but ground types not updated. The uncalibrated and calibrated results for this modeling are presented in Section 3.1. In the second set of modeling, the specific pavement types were used and the ground types were also updated for Sites 01MA, 02MA, 05CA, 09CA, 13CA, 15CA, 16MA, and 17 CT. The uncalibrated and calibrated results for this modeling are presented in Section 3.2. Analysis and discussion of the results are given in Section 3.3.
3.1 Specific Pavement Type
The uncalibrated results for the specific pavement modeling are shown in Figure 2. In this figure, the abscissa indicates the level of the measured 15-minute LAeq while the ordinate indicates the level of the predicted 15-minute LAeq. Each 15-minute datum is indicated by an orange x. A dashed blue line indicates the linear fit and solid green lines show the 95% confidence band for the linear fit. The solid black diagonal line indicates perfect (1 to 1) agreement between TNM predicted levels and measured data. Data above the black line indicate over-predictions while data below the black line indicate under-predictions.
Figure 2: Specific Pavement Study – Uncalibrated Results
The specific pavement modeling data were calibrated by using reference microphones as described in Section 2.3. The range of calibration values for each 15-minute datum and the average calibration value are given for each site in Table 6. A positive calibration value indicates an over-prediction and a negative calibration value indicates an under-prediction.
Site ID | Specific Pavement | |
---|---|---|
average calibration (dB) |
calibration range (dB) |
|
01MA (DGAC) | 2.3 | 1.3 to 2.9 |
02MA (DGAC) | 2.8 | 2.5 to 3.1 |
03MA (DGAC) | 0 | -0.2 to 0.4 |
05CA (PCC) | 1.7 | 1.6 to 1.9 |
06CA (DGAC) | -1.2 | -1.6 to -0.8 |
08CA PCC (HOV DGAC) | 0.8 | -1.0 to 1.2 |
09CA (PCC) | -0.3 | -0.7 to -0.1 |
10CA-berm (PCC) | 7.4 | 7.0 to 7.8 |
10CA-open (PCC) | 7.3 | 7.0 to 7.8 |
11CA (DGAC) | -2.4 | -2.9 to -1.7 |
12CA (PCC) | 1.3 | 1.0 to 1.8 |
13CA (OGAC) | -3.1 | -3.3 to -2.9 |
14CA (DGAC) | -1.7 | -2.2 to -1.5 |
15CA (DGAC) | 2 | 1.8 to 2.1 |
16MA (DGAC) | 1.7 | 1.6 to 1.7 |
17CT (DGAC) | -0.2 | -0.7 to 0.2 |
Average | 1.15 |
The calibrated results for the specific pavement modeling are shown in Figure 3. In this figure, the abscissa indicates the level of the measured 15-minute LAeq while the ordinate indicates the level of the predicted 15-minute LAeq adjusted by the calibration level. For further details about the graph parameter see description for uncalibrated results. Analysis and discussion of these results will be presented in Section 3.3, where results from modeling both specific pavements and updated ground types will also be discussed.
Figure 3: Specific Pavement Study – Calibrated Results
3.2 Combined Specific Pavement and Ground Type
In the second set of modeling, in addition to using specific pavement types for the models, select models had ground types updated as well. These are indicated in Table 5. The uncalibrated results for the specific pavement modeling are shown in Figure 4. The specific pavement and ground type modeling data were calibrated by using reference microphones as described in Section 2.3. The range of calibration values for each 15-minute datum and the average calibration value are given for each site in Table 7. The calibrated results for the specific pavement and ground type modeling are shown in Figure 5. For further details about the graph parameters see Section 3.1. Analysis and discussion of these results will be presented in Section 3.3, where results from modeling specific pavements (without updated ground types) will also be discussed.
Figure 4: Specific Pavement and Ground Type Study – Uncalibrated Results
Site ID | Specific Pavement and Updated Ground Type |
|
---|---|---|
average calibration (dB) |
calibration range (dB) |
|
01MA (DGAC) | 2.4 | 1.4 to 3.0 |
02MA (DGAC) | 3.4 | 3.0 to 3.7 |
03MA (DGAC) | 0.0 | -0.2 to 0.4 |
05CA (PCC) | 1.8 | 1.6 to 1.9 |
06CA (DGAC) | -1.2 | -1.6 to -0.8 |
08CA PCC (HOV DGAC) | 0.8 | -1.0 to 1.2 |
09CA (PCC) | -0.3 | -0.7 to 0.0 |
10CA-berm (PCC) | 7.4 | 7.0 to 7.8 |
10CA-open (PCC) | 7.3 | 7.0 to 7.8 |
11CA (DGAC) | -2.4 | -2.9 to -1.7 |
12CA (PCC) | 1.3 | 1.0 to 1.8 |
13CA (OGAC) | -3.2 | -3.5 to -3.0 |
14CA (DGAC) | -1.7 | -2.2 to -1.5 |
15CA (DGAC) | 1.8 | 1.6 to 1.9 |
16MA (DGAC) | 1.8 | 1.6 to 1.9 |
17CT (DGAC) | -0.4 | -0.8 to 0.0 |
average | 1.17 |
Figure 5: Specific Pavement and Ground Type Study – Calibrated Results
3.3 Analysis and Discussion
Sections 3.1 and 3.2 presented the uncalibrated and calibrated results for two sets of modeling in TNM v2.5, 1) models with specific pavements and 2) models with specific pavements and updated ground types. This section compares the performance of these two sets of modeling with the 2004 addendum, which used Average pavement and had the original ground types.
3.3.1 Comparison of Calibration Factors
Emission levels for TNM were developed by averaging measurements for each of five vehicle types from several sites for each pavement type. The averaging process minimized the effects of site specific biases, such as site-to-site variation in vehicles, pavement, and meteorological effects (e.g. temperature inversions, wind, etc.). The use of these standardized emission levels, therefore represent an average level, but each modeled site may have site specific biases which cause the measured levels to deviate from the average, thus calibration can be useful for improving performance.
Table 8 shows the average calibration and calibration range for each site for three modeling sets with 1) Average pavement, 2) specific pavement, and 3) specific pavement with updated ground types. In general, calibration levels are about the same for each modeling set. For Sites 01MA, 02MA, 03MA, 08CA, 09CA, 15CA, 16MA, and 17CT, the use of specific pavements reduces the magnitude of the calibration. In such cases the use of specific pavements could be useful. For Sites 05CA, 06CA, 10CA (berm and open), 11CA, 12CA, 13CA, and 14CA, the use of specific pavements increased the magnitude of the calibration. Both results are reasonable, since the change due to the use of the specific pavements is on the order of 1 to 2 dB, while the bias due to pavements within the same class can be about 10 dB (see Appendix E of [Fleming 1995]). For example, if a PCC site is already over-predicting with Average pavement due to the site either being a “quiet” PCC, temperature inversions, quiet vehicles, etc, then modeling with PCC pavement will increase the calibration level. For the ground type updates implemented, no calibration improvements were observed from site to site as is expected since the reference microphones are close to the road and see little effect from a change in the ground type.
Site ID | Average Pavement | Specific Pavement | Specific Pavement and Updated Ground Type |
|||
---|---|---|---|---|---|---|
average calibration (dB) | calibration range (dB) | average calibration (dB) | calibration range (dB) | average calibration (dB) | calibration range (dB) | |
01MA (DGAC) | 3.2 | 2.3 to 4.1 | 2.3 | 1.3 to 2.9 | 2.4 | 1.4 to 3.0 |
02MA (DGAC) | 3.8 | 3.4 to 4.1 | 2.8 | 2.5 to 3.1 | 3.4 | 3.0 to 3.7 |
03MA (DGAC) | 0.9 | 0.7 to 1.3 | 0 | -0.2 to 0.4 | 0.0 | -0.2 to 0.4 |
05CA (PCC) | 0.1 | 0.0 to 0.1 | 1.7 | 1.6 to 1.9 | 1.8 | 1.6 to 1.9 |
06CA (DGAC) | 0 | -0.4 to 0.3 | -1.2 | -1.6 to -0.8 | -1.2 | -1.6 to -0.8 |
08CA PCC (HOV DGAC) | -1.1 | -2.7 to -0.5 | 0.8 | -1.0 to 1.2 | 0.8 | -1.0 to 1.2 |
09CA (PCC) | -1.8 | -2.4 to -1.5 | -0.3 | -0.7 to -0.1 | -0.3 | -0.7 to 0.0 |
10CA-berm (PCC) | 5.6 | 5.2 to 6.0 | 7.4 | 7.0 to 7.8 | 7.4 | 7.0 to 7.8 |
10CA-open (PCC) | 5.6 | 5.2 to 6.0 | 7.3 | 7.0 to 7.8 | 7.3 | 7.0 to 7.8 |
11CA (DGAC) | -1.3 | -1.8 to -0.6 | -2.4 | -2.9 to -1.7 | -2.4 | -2.9 to -1.7 |
12CA (PCC) | -0.6 | -0.8 to -0.1 | 1.3 | 1.0 to 1.8 | 1.3 | 1.0 to 1.8 |
13CA (OGAC) | -1.8 | -2.0 to -1.5 | -3.1 | -3.3 to -2.9 | -3.2 | -3.5 to -3.0 |
14CA (DGAC) | -0.7 | -1.3 to -0.4 | -1.7 | -2.2 to -1.5 | -1.7 | -2.2 to -1.5 |
15CA (DGAC) | 2.8 | 2.6 to 3.0 | 2 | 1.8 to 2.1 | 1.8 | 1.6 to 1.9 |
16MA (DGAC) | 2.8 | 2.7 to 2.8 | 1.7 | 1.6 to 1.7 | 1.8 | 1.6 to 1.9 |
17CT (DGAC) | 0.6 | 0.2 to 1.0 | -0.2 | -0.7 to 0.2 | -0.4 | -0.8 to 0.0 |
Average | 1.13 | 1.15 | 1.17 |
The calibration values are also categorized by site type in Table 9 for Average pavement, specific pavement, and specific pavement with updated ground types. In general, calibrations are about the same for each set of models. These results indicate that, even with the use of specific pavements and the best available ground type classifications, it is still advisable to calibrate data by using a reference microphone.
Site Type | Avg Pavement average calibration (dB) | Specific Pavement average calibration (dB) | Spec Pave & Ground Type average calibration (dB) |
---|---|---|---|
all | 1.1 | 1.2 | 1.2 |
open area, soft ground | 3.4 | 3.1 | 3.3 |
open area, hard ground | 1.1 | 0.1 | 0.0 |
barrier, soft ground | 0.0 | 0.7 | 0.7 |
ref mic in open | 2.6 | 2.2 | 2.3 |
ref mic above barrier | -0.8 | -0.3 | -0.2 |
3.3.2 Linear Fit for Calibrated Data
The purpose of calibration is to account for specific characteristics of a modeled site which do not conform to standard values in TNM, for example calibration can be used to account for traffic which has higher or lower sound levels than typical traffic. Both the linearity of the fit between the measured and predicted data and the distribution of the differences between the measured and predicted data are useful characteristics to quantify how close the model is to measured data.
The relation of the linear fit to the line of perfect agreement is examined in Table 10 along with the width of the 95 percent confidence band in Table 11 for three model sets, 1) Average pavement, 2) specific pavement, and 3) specific pavement with updated ground types. (Graphs of these fits are given in Appendix A for the specific pavement models and in Appendix B for the specific pavement with updated ground types models.) Both the average difference and the average of the absolute value of differences are given in Table 10. The average difference represents the difference between the linear fit line and the perfect agreement line. The absolute value of differences indicates how well TNM is performing as a function of the amplitude of the over- and under-predictions. In general, TNM v2.5 performs well for all three modeling sets. The use of specific pavements improves the performance for open areas with soft ground, and the updated ground types further improve the results for both open areas with soft and hard ground types.
Sites | Differences of Linear Fit from | ||||||
---|---|---|---|---|---|---|---|
Perfect Agreement (dB) – TNM v2.5 | |||||||
average difference | average of absolute value of differences | ||||||
Avg. Pave. | Spec. Pave. | Spec. Pave. & Updated Ground | Avg. Pave. | Spec. Pave | Spec. Pave. & Updated Ground | ||
all | 0.2 | 0.0 | 0.0 | 0.8 | 1.0 | 1.0 | |
open area, soft ground | -1.5 | -1.3 | -0.9 | 1.6 | 1.5 | 0.9 | |
near distances | -0.9 | -0.7 | -0.4 | 0.9 | 0.7 | 0.6 | |
far distances | -4.3 | -4.0 | -2.5 | 4.3 | 4.0 | 2.5 | |
open area, hard ground | 1.1 | 1.3 | 1.1 | 1.6 | 1.7 | 1.5 | |
near distances | -0.4 | -0.3 | -0.4 | 0.9 | 0.9 | 0.9 | |
far distances | 2.2 | 2.5 | 2.1 | 2.2 | 2.5 | 2.1 | |
barrier, soft ground | 0.6 | 0.4 | 0.4 | 0.6 | 0.8 | 0.8 |
The average, maximum, and minimum values of the 95% confidence band, respectively are shown in Table 11. If all three values are small, and the maximum and minimum values are similar, this indicates that the data shows little variation in amplitude over a broad range of sound levels; as such, a similar data set (sound levels measured and predicted under the same conditions) would provide similar results. The difference between predicted and measured results can change over distance when inappropriate ground types are assigned. When the appropriate ground type is used, differences remain more consistent and thus it can be expected that the confidence band will be smaller than if inappropriate ground types are used. It can be seen in Table 11 that the updated ground types decrease the size of the confidence band, indicating less variation in the difference between the predicted and measured results.
Sites | 95% Confidence Band Width around Linear Fit (dB) |
|||||||||
---|---|---|---|---|---|---|---|---|---|---|
average | maximum | minimum | ||||||||
Avg. Pave. | Spec. Pave. | Spec. Pave. & Updated Ground | Avg. Pave. | Spec. Pave | Spec. Pave. & Updated Ground | Avg. Pave. | Spec. Pave. | Spec. Pave. & Updated Ground | ||
all | 0.7 | 0.7 | 0.7 | 1.3 | 1.4 | 1.3 | 0.4 | 0.4 | 0.4 | |
open area, soft ground | 1.4 | 1.3 | 1.1 | 2.3 | 2.2 | 1.9 | 0.8 | 0.8 | 0.7 | |
near distances | 1.4 | 1.3 | 1.2 | 2.4 | 2.3 | 2.1 | 0.8 | 0.7 | 0.7 | |
far distances | 1.9 | 2.0 | 1.5 | 3.3 | 3.3 | 2.5 | 1.3 | 1.3 | 1.0 | |
open area, hard ground | 0.8 | 0.8 | 0.7 | 1.3 | 1.2 | 1.2 | 0.6 | 0.6 | 0.5 | |
near distances | 1.6 | 1.6 | 1.5 | 2.6 | 2.6 | 2.5 | 1.1 | 1.1 | 1.0 | |
far distances | 0.9 | 0.9 | 0.7 | 1.6 | 1.6 | 1.2 | 0.5 | 0.5 | 0.4 | |
barrier, soft ground | 0.7 | 0.8 | 0.8 | 1.1 | 1.3 | 1.3 | 0.4 | 0.5 | 0.5 |
3.3.3 Level Differences between Measurements and Model for Calibrated Data
In addition to the linearity of the fit between the predicted and measured data, the difference between the measured and predicted data is also useful in understanding TNM’s performance. Table 12 presents the average differences between measured data and calibrated TNM v2.5-predicted data modeled with Average pavement. The results are given as a function of microphone height, distance, ground type, and shielding (with or without a barrier). Table 13 presents the same information, except that specific pavements were used in the models. Table 14 presents the same information as well, except that specific pavements and updated ground types were used in the models.
Site Type | Mic Height (ft) |
Average Differences in Sound Levels for Ranges of Distance from the Roadway | ||||||
---|---|---|---|---|---|---|---|---|
1-100 ft | 101-200 ft |
201-300 ft |
301-500 ft |
501-1000 ft |
> 1000 ft |
all distances |
||
open area, soft ground |
5 | 0.8 | 0.1 | no data | -2.7 | -5.7 | no data | -1.5 |
15 | -1.1 | -1.5 | no data | -1.7 | -3.4 | no data | -1.7 | |
open area, hard ground |
5 | 0.6 | 1 | no data | no data | 0.7 | 3.9 | 1.3 |
15 | -1.5 | -1.4 | no data | no data | 1.3 | 2.4 | -0.5 | |
barrier, soft ground |
5 | 0.8 | 0 | 2 | no data | no data | no data | 0.7 |
15 | 1.4 | 0.7 | 2.8 | no data | no data | no data | 1.2 |
It can be seen that each modeling set performed better at some locations / conditions than the other two. This indicates that specific pavements and updated ground types alone are not sufficient to quantify all of the variation that was observed in the 2004 validation addendum, however, it can be seen that for certain locations / conditions these updates did provide improvement. Specifically, specific pavements did offer improvements over Average pavement for open areas with acoustically soft ground at far distances, some improvement for open areas with acoustically hard ground at far distances, and some improvement for sites with barriers at near distances. Similarly, also updating ground types to use a more appropriate EFR value improved results for most open area sites (both acoustically hard and soft ground as well as near and far distances). By the appropriate use of calibration, specific pavements, and the correct selection of ground types it is possible to achieve small average differences between predicted and measured sound pressure levels.
Site Type | Mic Height (ft) |
Average Differences in Sound Levels for Ranges of Distance from the Roadway | ||||||
---|---|---|---|---|---|---|---|---|
1-100 ft | 101-200 ft |
201-300 ft |
301-500 ft |
501-1000 ft |
> 1000 ft |
all distances |
||
open area, soft ground | 5 | 0.9 | 0.2 | no data | -1.7 | -3.8 | no data | -1.0 |
15 | -1.6 | -0.8 | no data | -1.2 | -2.3 | no data | -1.4 | |
open area, hard ground | 5 | 0.6 | 1.2 | no data | no data | 1.3 | 3.8 | 2.6 |
15 | -1.4 | -1.5 | no data | no data | 1.9 | 2.5 | 1.1 | |
barrier, soft ground | 5 | 0.5 | -0.4 | 0.7 | no data | no data | no data | 0.2 |
15 | 1.1 | 0.3 | 3.5 | no data | no data | no data | 0.9 |
Site Type | Mic Height (ft) |
Average Differences in Sound Levels for Ranges of Distance from the Roadway | ||||||
---|---|---|---|---|---|---|---|---|
1-100 ft | 101-200 ft |
201-300 ft |
301-500 ft |
501-1000 ft |
> 1000 ft |
all distances |
||
open area, soft ground | 5 | 0.9 | 0.6 | no data | -1.0 | -2.5 | no data | -0.4 |
15 | -1.6 | -0.8 | no data | -1.0 | -2.0 | no data | -1.3 | |
open area, hard ground | 5 | 0.5 | 1.1 | no data | no data | 0.7 | 3.4 | 2.2 |
15 | -1.4 | -1.5 | no data | no data | 1.3 | 2.3 | 0.9 | |
barrier, soft ground | 5 | 0.5 | -0.4 | 0.7 | no data | no data | no data | 0.2 |
15 | 1.1 | 0.3 | 3.5 | no data | no data | no data | 0.9 |