U.S. Department of Transportation
Federal Highway Administration
1200 New Jersey Avenue, SE
Washington, DC 20590
2023664000
Federal Highway Administration Research and Technology
Coordinating, Developing, and Delivering Highway Transportation Innovations
REPORT 
This report is an archived publication and may contain dated technical, contact, and link information 

Publication Number: FHWAHRT10035 Date: September 2011 
Publication Number:
FHWAHRT10035
Date: September 2011 
The developed ANN models were ranked based on the performance of each model for an independent dataset that contains all of the required input parameters to be used in the different models. The decision tree in figure 60 is the result of this prioritization and was used to populate the LTPP database. As suspected at the outset of this project, the M_{R} ANN model yields the best prediction possible and is the preferred model. This finding is not surprising given that the M_{R} ANN model takes actual mixture measured quantities as input. The intuition is also supported in the fitting statistics shown in the figures presented in section 5.0. If M_{R} data are not available, the next preferred model is the VV ANN model. Although the VV ANN shows poorer fitting statistics than the GV ANN model in terms of logarithmic space, it shows better statistics in terms of arithmetic space. The arithmetic statistics were used to rank these models because the moduli values are expressed and utilized in terms of their arithmetic value. Of the three ANN models, GV ANN received the lowest ranking. However, GVPAR outranked the VVgrade because the model GVPAR uses measurements taken directly from the material of interest. The VVgrade model uses viscosity values representative of the binder grade.
Figure 60. Illustration. Decision tree applied to population of LTPP database based on ranking of ANN models.
The input sets available for each section are different. Consequently, the models that can be utilized for a given section may differ. All the models that can be used for a specific section have been identified. If any of the inputs are outside the range of the calibration data, then the model for that section is considered to be a violated model, and predictions with it may or may not be reasonable. Any available model that does not violate the input range criteria is used as the predictive model for that section. In cases where only two violated models are available, the model for that section must be decided manually by the user.
Two sets of internal QC checks were applied to the E* data produced for submission to the LTPP database. The first QC check was used on the input values. All the other QCs were used to check the output E* predictions. In the following sections, each of these QC criteria is described. The work criterion is implied but not explicitly stated for each of these checks. The quality grading system referenced is different than the standard record status definition used in the LTPP database. For example, data assigned an “A” by the research team represent the highest quality data, whereas the LTPP convention assigns an “E” to the highest quality data. The research team established strict QC checks for these data to ensure that only the highest quality data were assigned an “A” grade. The data that did not achieve an “A” grade should be used with caution, and users should be fully aware that the data did not pass the QC check. All predictions are included in the database so users can determine whether or not the data are suitable for their needs. In addition, FHWA can revise the criteria used in the QC checks as deemed appropriate based on the opinions of their experts.
QC #1 checks for a violation of the input range used in each model based on the input ranges of the calibration dataset, as seen in (see table 24). Figure 61 through figure 65 show example predictions of E* in two sections where violations of the input criteria have been detected. This check is performed on a linebyline basis, meaning that each time a modulus is predicted, the input parameters are checked. Lines that pass the QC check receive a grade of “A,” whereas those that do not pass the QC check receive a grade of “F.”
For the layers where E* predictions are estimated using the M_{R} ANN model but QC #1 is violated, the mastercurve created appears visually continuous (see figure 61 and figure 62). The reason for this appearance is that the output of this model is the mastercurve itself. However, the output of the other two ANN models is the estimation of E* under a specific condition. In this case, a violation of QC #1 may create a clear error in the mastercurve, as demonstrated in figure 63 through figure 65. The acceptable range of input parameters is shown for the three ANN models in table 24. These models do not estimate the information needed to create the mastercurve.
Figure 61. Graph. Example of the effect of a violation of QC #1 for M_{R} ANN model in
semilog scale.
Figure 62. Graph. Example of the effect of a violation of QC #1 for M_{R} ANN model in loglog scale.
Figure 63. Graph. Example of the effect of a violation of QC #1 for VV ANN model in semilog scale.
Figure 64. Graph. Example of the effect of a violation of QC #1 for VV ANN model in loglog scale.
Figure 65. Graph. Example of the effect of a violation of QC #1 for VV ANN model unshifted data.
QC #2 checks the trends of E* as a function of temperature and frequency. It is expected that E* decreases as the temperature increases and the loading frequency decreases. Figure 66 through figure 68 show sample cases of a QC #2 violation. In these examples, the predicted E* value at 40 °F (4.4 °C) and 25 Hz is smaller than the predicted value at 40 °F (4.4 °C) and 10 Hz. Similar to QC #1, this QC check is performed linebyline; the lines that pass receive a grade of “A,” and those that fail receive a grade of “F.”
Figure 66. Graph. Example of the effect of a violation of QC #2 in semilog scale.
Figure 67. Graph. Example of the effect of a violation of QC #2 in loglog scale.
Figure 68. Graph. Example of the effect of a violation of QC #2 unshifted data.
The typical percentage of difference between 0.1 Hz at one temperature and 25 Hz at the next warmest temperature is checked using QC #3. Equation 51 states the percentage of difference and a typical value of this term based on the available data in this study. Figure 69 through figure 71 show the violation of QC #3 in one of the sections. For this particular section, a violation occurred between 40 and 70 °F (4.4 and 21.1 °C). For this sample case, at 0.1 Hz and 40 °F (4.4 °C), the modulus is equal to 1.29 x 10^{6} psi (8.85 x 10^{6 }kPa). At 25 Hz and 70 °F (21.1 °C), the modulus is equal to 8.28 x 10^{5} psi (56.8 x 10^{5} kPa), which is a percentage difference of 55.4 percent.
(51) 
Unlike the previous QC checks, QC #3 is performed on the basis of temperature. For example, if the percentage of difference between 14 and 40 °F (10 and 4.4 °C) exceeds 25 percent, then all of the predictions at 14 °F (10 °C) would receive a grade of “F.”
Figure 69. Graph. Example of the effect of a violation of QC #3 in semilog scale.
Figure 70. Graph. Example of the effect of a violation of QC #3 in loglog scale.
Figure 71. Graph. Example of the effect of a violation of QC #3 unshifted data.
in QC #4, the difference in E* values predicted between 0.1 Hz at one temperature and 0.1 Hz at the next warmest temperature is checked to see if appropriate trends with regard to temperature and modulus hold. Sample cases of QC #4 violation are shown in figure 72 through figure 74. For the data in these figures, E* at 0.1 Hz and 40 °F (4.4 °C) is smaller than E* at 0.1 Hz and 70 °F (21.1 °C). In the case shown in these figures, this situation has led to a discontinuous mastercurve because the optimization algorithm becomes confused when the modulus does not decrease as the temperature increases. Similar to QC #3, QC #4 is applied on a temperature basis.
Figure 72. Graph. Example of the effect of a violation of QC #4 in semilog scale.
Figure 73. Graph. Example of the effect of a violation of QC #4 in loglog scale.
Figure 74. Graph. Example of the effect of a violation of QC #4 unshifted data.
QC #5 checks the range of shift factor values in the output predictions against typical values. This check is used to indicate potential problems with the mastercurve generation process. The limits identified and subsequently used are as follows:
The output parameters of interest from the ANNACAP software are SHIFT_FACTOR COEFFICIENT 1 (α_{1}), SHIFT_FACTOR_COEFFICIENT 2 (α_{2}), and SHIFT_FACTOR_COEFFICIENT 3 (α_{3}). The shift factor is computed using equation 52 as follows:
(52) 
Because the goal of this QC criterion is to judge the mastercurve generation process, only shift factor values at extreme temperatures need to be examined. Note that because the M_{R} ANN model predicts the mastercurve directly, any predictions made with this model will automatically pass QC #5 without the need for calculation. When this QC is not passed, the entire section (at all temperatures) receives a grade of “F.”
Figure 75 through figure 77 show violations of QC #5. In these cases, the shift factor at 14 °F (10 °C) is equal to 7.03. This effect results in a visual discontinuity in the mastercurve between the 14 and 40°F (10 and 4.4°C) datasets.
Figure 75. Graph. Example of the effect of a violation of QC #5 in semilog scale.
Figure 76. Graph. Example of the effect of a violation of QC #5 in loglog scale.
Figure 77. Graph. Example of the effect of a violation of QC #5 unshifted data.
In an earlier version of the ANN models developed for this study, some cases had inputs within the calibration input range, but the E* predictions obtained values of the limits of the calibration data. In some other cases, E* did not change with varying temperature and frequency. QC #6 was expected to be the last QC check, but after improving the ANN models, the problem no longer exists. Nevertheless, the check is performed on the data. The limiting E* values used to judge whether a given prediction passes this QC check are given in table 25. Like QC #1 and QC #2, this QC check is applied linebyline.
Model  Upper Limit (psi)  Lower Limit (psi) 

M_{R} ANN  N/A  N/A 
VV ANN  5,888,437  3,311.311 
GV ANN  6,456,542  3,311.311 
1 psi = 6.86 kPa 
Similar to QC #5, QC #7 is designed to judge the mastercurve generation process. Each time a mastercurve is generated, fitting statistics are computed. These statistics include the Se/Sy (of combined predictions), and R^{2}. According to the draft standard for mastercurve generation using AASHTO TP62 data, the explained variance should be greater than 0.99, and the ratio of Se/Sy should be less than 0.05.^{(42)} When these limits are exceeded, QC #7 is triggered, and the layer fails. Because the M_{R} ANN model predicts the mastercurve directly, any predictions made with this model will automatically pass QC #7 without the need for calculation. Equations 53–55 are used to compute the necessary statistical parameters. Whenever this QC is violated, the entire section receives a grade of “F.”
(53) 
Where:
23  =  Number of temperature/frequency combinations used minus the number of fitting parameters minus 1. 

(logE*_{ANN})_{i}  =  Logarithm of the modulus determined from the ANN models at a particular temperature frequency combination. 
(logE*_{fit})_{i}  =  Logarithm of the modulus determined from the optimized sigmoidal fit. 
(54) 
Where:
29  =  Number of temperature/frequency combinations used minus 1. 

(logE*_{avg})_{i}  =  Logarithm of the average modulus determined from the ANN models for a given layer. 
(55) 
The NCSU researchers used a combination of the above QC factors to judge the quality of the modulus prediction for an individual modulus prediction. If QCs #1, #3, #4, and #6 all pass, then the section receives a grade of “A.” If QC #1 fails but QCs #3, #4, and #6 all pass, then the modulus receives a grade of “C,” which means the predicted moduli are questionable. Otherwise, the modulus receives a grade of “F.”
QCs #5 and #7 are used to judge the quality of the calibrated mastercurve and shift factor function. When both QCs pass, the section receives a grade of “A,” but when both fail, the section receives a grade of “F.” If one passes and one fails, then the mastercurve and shift factor function values are questionable, and the section receives a grade of “C.”
The LTPP database contains information for a total of 1,806 layers that meet the criteria described in section 3.4 of this report. These layers have binder data available at a combination of different aging conditions including unaged or original, RTFO, PAV, or fieldaged. In the fieldaged data, 2,223 records are available because some layers' properties may have been measured at different dates. The total resulting number of records is 7,641. Using the combined ANN models and requisite QC checks, modulus values were predicted for 363 records/layers in the originalaged level, 469 records/layers in the RTFOaged level, 1 record/layer in the PAV level, and 503 records in the fieldaged level. These numbers translate to predictions for 17.5 percent of the total number of records available. However, these records are distributed in such a way that a higher percentage of the layers have some sort of valid prediction. Of the 1,806 layers in the database, 1,010, or 56 percent, have a modulus prediction at some aging condition. Of these 1,010 layers, 615, or 34 percent of the total 1,806 layers, have completely reasonable predictions (i.e., an “A” grade), and 89, or 4.9 percent of the total 1,806 layers, have unreasonable predictions (i.e., an “F” grade). The remaining 306 layers (17 percent of the 1,806 layers) have questionable predictions (i.e., a “C” grade). Thus, the total percentage of layers with a completely valid or questionable prediction is 51 percent. Table 26 shows the summarized statistics of the population effort. Although it cannot be interpreted directly from this table, the majority of the valid records were populated using the M_{R} ANN model followed next by the VVgrade ANN model and the VV ANN model.
Populated LTPP data  Aging Condition  Total  

Original  RTFO  PAV  Field  
Number of records  1,806  1,806  1,806  2,223  7,641  
Number of populated records  363  469  1  503  1,336  
Number of records by contractor individual judgment grade  Grade A  147  252  0  465  864 
Grade C  0  1  1  38  40  
Grade F  216  216  0  0  432  
Number of records by contractor mastercurve judgment grade  Grade A  44  142  0  0  186 
Grade C  211  237  0  503  951  
Grade F  108  90  1  0  199  
Populated records using M_{R}  5  0  0  503  508  
Populated records using VV  358  59  0  0  417  
Populated records using GV  0  0  1  0  1  
Populated records using GVPAR  0  2  0  0  2  
Populated records using VVgrade  0  408  0  0  408  
Number of populated layers  1,010  
Number of layers with valid and questionable predictions  921  
Number of layers with fully valid predictions  615  
Number of layers with failed predictions  89 
As a result of this project, nine tables were included in the LTPP database to document the inputs used in the dynamic modulus models as well as resultant predictions.^{(20)} The tables were added to the materials testing module (i.e., TST) of the LTPP database. Each table is described below. It should be noted that inputs from the LTPP database as well as outputs from the models are in units that are consistent with popular convention, but both SI and English units are used in the tables.
Field Name  Field Description 

ESTAR_LINK  Generic key for linking ESTAR data 
STATE_CODE  Numerical code for State or province. U.S. codes are consistent with Federal Information Processing Standards 
SHRP_ID  Test section identification number assigned by LTPP program. Must be combined with STATE_CODE to be unique 
LAYER_NO  Unique sequential number assigned to pavement layers starting with layer 1 as the deepest layer (subgrade) 
PROJECT_ID  The fourcharacter identifier for the SPS project used to identify elements of information which are common to all sections in that project 
PROJECT_LAYER_CODE  Sequential alphabetic code assigned to identify group projectwide layers 
PREDICTIVE_MODEL  Code indicating the predictive model used to generate ESTAR estimates 
CONSTRUCTION_DATE  Construction date of the layer 
SAMPLE_TYPE_ESTAR  Code indicating the aging condition of the samples used for inputs into the ESTAR predictive models 
SAMPLE_DATE  Sampling date if fieldaged 
SAMPLE_AGE  Sample age if fieldaged 
RECORD_STATUS  Code indicating the general quality of the data as outlined, based on the level of QC checks described in the Database User Reference Guide^{(10)} 
Field Name  Field Description 

ESTAR_LINK  Generic key for linking ESTAR data 
TEMPERATURE  Temperature of modulus prediction 
FREQUENCY  Frequency of modulus prediction 
ESTAR  Predicted dynamic modulus 
RECORD_STATUS  Code indicating the general quality of the data as outlined, based on the level of QC checks described in the Database User Reference Guide^{(10)} 
Field Name  Field Description 

ESTAR_LINK  Generic key for linking ESTAR data 
SIGMOIDAL_COEFF_1  Sigmoidal fitting function coefficient delta 
SIGMOIDAL_COEFF_2  Sigmoidal fitting function coefficient alpha 
SIGMOIDAL_COEFF_3  Sigmoidal fitting function coefficient beta 
SIGMOIDAL_COEFF_4  Sigmoidal fitting function coefficient gamma 
SHIFT_FACTOR_COEFF_1  Shift factor fitting function coefficient alpha 1 
SHIFT_FACTOR_COEFF_2  Shift factor fitting function coefficient alpha 2 
SHIFT_FACTOR_COEFF_3  Shift factor fitting function coefficient alpha 3 
MASTERCURVE_QUALITY  Code indicating the general quality of the mastercurve generation process. Pass if explained variance is greater than 0.99 and ratio of standard error to standard deviation is less than 0.05 
RECORD_STATUS  Code indicating the general quality of the data as outlined based on the level of QC checks described in the Database User Reference Guide^{(10)} 
Field Name  Field Description 

ESTAR_LINK  Generic key for linking ESTAR data 
TEMPERATURE  Temperature of modulus prediction 
FREQUENCY  Frequency of modulus prediction 
GSTAR  Binder shear modulus used for G* ANN model 
RECORD_STATUS  Code indicating the general quality of the data as outlined based on the level of QC checks described in the Database User Reference Guide^{(10)} 
Field Name  Field Description 

ESTAR_LINK  Generic key for linking ESTAR data. 
CAM_COEFF_1  CAM fitting function coefficient G_{g} 
CAM_COEFF_2  CAM fitting function coefficient wc 
CAM_COEFF_3  CAM fitting function coefficient k 
CAM_COEFF_4  CAM fitting function coefficient me 
RECORD_STATUS  Code indicating the general quality of the data as outlined based on the level of QC checks described in the Database User Reference Guide^{(10)} 
Field Name  Field Description 

ESTAR_LINK  Generic key for linking ESTAR data 
VMA  Voids in mineral aggregate as a percent of total volume 
VFA  Voids filled with asphalt as a percent of VMA 
RECORD_STATUS  Code indicating the general quality of the data as outlined, based on the level of QC checks described in the Database User Reference Guide^{(10)} 
Field Name  Field Description 

ESTAR_LINK  Generic key for linking ESTAR data 
TEMPERATURE  Temperature of modulus prediction 
VISCOSITY  Voids filled with asphalt as a percent of VMA 
RECORD_STATUS  Code indicating the general quality of the data as outlined, based on the level of QC checks described in the Database User Reference Guide^{(10)} 
Field Name  Field Description 

ESTAR_LINK  Generic key for linking ESTAR data 
VISC_A  Viscosity model intercept 
VISC_VTS  Viscosity model slope 
RECORD_STATUS  Code indicating the general quality of the data as outlined, based on the level of QC checks described in the Database User Reference Guide^{(10)} 
Field Name  Field Description 

ESTAR_LINK  Generic key for linking ESTAR data 
MR_5C  Resilient modulus at 5 °C 
MR_25C  Resilient modulus at 25 °C 
MR_40C  Resilient modulus at 40 °C 
RECORD_STATUS  Code indicating the general quality of the data asoutlined, based on the level of QC checks described in the Database UserReference Guide^{(10)} 
°C = (°F−32)/1.8 
QC checks were developed to be applied to the LTPP database. These checks include many of the internal checks developed as part of this study as well as additional checks deemed appropriate. As such, the data available in the LTPP database have been subjected to both the research team's internal QC checks and the LTPP database QC checks. Figure 78 shows the ANN models and their appropriate input and output tables.
Figure 78. Illustration. ANN models and their appropriate input and output tables.