U.S. Department of Transportation
Federal Highway Administration
1200 New Jersey Avenue, SE
Washington, DC 20590
202-366-4000


Skip to content
Facebook iconYouTube iconTwitter iconFlickr iconLinkedInInstagram

Federal Highway Administration Research and Technology
Coordinating, Developing, and Delivering Highway Transportation Innovations

 
REPORT
This report is an archived publication and may contain dated technical, contact, and link information
Back to Publication List        
Publication Number:  FHWA-HRT-14-034    Date:  August 2014
Publication Number: FHWA-HRT-14-034
Date: August 2014

 

CHAPTER 3 —OVERVIEW OF INDUSTRY OUTREACH EFFORT

Four outreach efforts were conducted to obtain feedback from the major parties that are involved in the use of construction contract performance bonds. Representative State transportation departments, their contractors, and sureties all participated in this outreach effort. The representative State transportation departments completed surveys on their use of performance bonds, contractor evaluation methods, and views on performance-based prequalification. Contractors also completed surveys to provide input on the use of performance bonds and performance-based prequalification methods. The SFAA provided overall surety industry data, summarized industry practices, and participated in interviews. The final step of the outreach effort was the completion of case studies for five State transportation departments. This chapter presents each of these efforts and the corresponding results.

STATE TRANSPORTATION DEPARTMENT, CONSTRUCTION CONTRACTOR AND SURETY SURVEY/INTERVIEW RESPONSES

Survey/Interview Participants

Six State transportation departments participated in the transportation agency survey: the Alabama Department of Transportation (ALDOT), FDOT, Georgia Department of Transportation (limited responses were provided), MoDOT, SCDOT, VTrans, and the California Department of Transportation (Caltrans). These participants represented small, medium, and large transportation agencies and reflected a reasonable geographical cross-section for data collection.

At each State transportation department, one person took primary responsibility for completion of the survey, although he or she may have consulted other members of the agency. The individuals who participated held a range of positions within their organization, including director of construction, State construction engineer, State engineer, assistant State construction engineer, and principal transportation engineer.

Eleven construction contractors responded to a separate contractor survey. Their responses reflected a wide range of organization sizes, types, and degrees of focus on State transportation department-specific work. At the time of the survey, national firms employed six of the participants, while regional firms employed two of them. Of the remaining participants, one was employed by a firm that does international work, one was employed by a single State, and one was employed by a single locality.

Five contractors described their typical role on a State transportation department project as that of a general contractor and one identified its role as solely that of a subcontractor. The remaining five reported that their organization takes on the role of either a general contractor or a subcontractor, depending on the project. Nine of the organizations focus primarily on roadway work, while two focus on bridge work.

The majority of the construction contractors stated that their average annual volume of State transportation department work exceeds $100 million. Two participants noted a lower annual volume-between $6 million and $10 million-while one participant noted an annual volume of $1 million to $5 million.

Before the surety survey was distributed to a sample of surety companies, the SFAA reviewed it and concluded that better industry-wide data and opinions could be obtained from the SFAA than from individual companies. The SFAA collects all of the data that State insurance regulators in the industry require and is the designated statistical reporting agent for the surety and fidelity industries in all U.S. States, except Texas. The information provided by the SFAA and data collected by these regulators was used in this research effort. The SFAA summarized industry practices and provided quantitative data, where possible, in response to specific written questions. SFAA officials and representatives from five surety companies also participated in the interviews.

Survey/Interview Results

The input from representative State transportation departments, contractors, the SFAA, and surety company representatives was assessed as part of an effort to evaluate the benefits and costs of performance bonds and performance-based prequalification methods. In order to understand all perspective on these tools, a better understanding of State transportation department and contractor attitudes was needed. Contractors noted their misgivings about the value of performance bonds, given their cost. However, State transportation departments expressed hesitation at the idea of abandoning the use of performance bonds. The surety industry outlined the benefits of performance bonds during prequalification and construction and presented data on the costs of performance bonds.

A significant number of State transportation departments believed that a performance-based prequalification process would improve the quality and timeliness of project delivery and enhance State transportation department-contractor relationships. Contractors appeared uniformly open to an equitable performance-based prequalification process as a means to improve project delivery. Survey responses suggest that performance-based prequalification methods can be implemented and/or refined to better emphasize the performance and financial factors that are most relevant to effective project delivery.

The data was collected using two different methods. A small number of State transportation departments and contractors were surveyed in detail, the SFAA provided surety information from the aggregated data of filings made to State regulators, and several surety companies provided additional anecdotal input. This resulted in two very different data sets: a set of microeconomic data from a sample of State transportation departments and contractors, which may or may not be representative of their populations, as well as a set of macroeconomic data from the entire population of sureties. The premiums sureties charge contractors for performance bonds are found where the two data sets intersect (i.e., both data sets report upon the same statistics). These results are found consistent and do not differ significantly from each other. Sureties report premium rates with a mean of 0.64 percent and a standard deviation of 0.26 percent, while contractors report an average premium rate of 0.70 percent (as shown in table 9) with a standard deviation of 0.80 percent. Given that the difference between the two means is only 0.06 percent, the hypothesis that both are estimates of the same true mean of the population cannot be rejected (all of the sources of the premium rates).

Table 9. Respondent contractor-reported bond rates.

Project Size

Low (Percent)

Average (Percent)

High (Percent)

Cost for project bond when bond < $100,000

0.22

1.06

2.5

Cost for project bond when bond $100,000 -
$1 million

0.22

0.99

2.5

Cost for project bond when bond > $1 million -
$10 million

0.22

0.93

2.5

Cost for project bond when bond > $10 million -
$50 million

0.0976

0.70

0.85

Cost for project bond when bond > $50 million -
$100 million

0.475

0.52

0.85

Cost for project bond when bond > $100 million

0.475

0.52

0.85

Overall Average

0.79

The data also indicates the following:

  • The State transportation department-reported average default rate is 0.69 percent. Applied to the combined 2010 reported-letting budget of $6.2 billion for the surveyed State transportation departments, this reported default rate would result in $42.8 million worth of defaulted contracts across the surveyed State transportation departments.

  • Under the current administrative system (illustrated in table 10), State transportation departments reject a much higher rate of new applicants (7.6 percent) than renewal applicants (0.4 percent).

Table 10. Respondent State transportation department prequalification rejection rates.

Prequalification Workload

Low

Average

High

Annual number of new prequalification applicants

10

27.5

50

New applicants rejected (percent of total)

0

7.6

20

Annual number of renewal prequalification applicants

75

330

570

Renewal applicants rejected (percent of total)

0

0.4

0

Also, numerous conclusions about the potential benefits and structure of performance-based contractor prequalification can be made. In summary, the conclusions are as follows:

  • Table 11 shows that both contractors and State transportation departments feel that a performance-based contractor prequalification process has the potential to improve overall project performance.

Table 11. Impact of performance-based contractor prequalification.

Impacted Project Performance Factor

Believe Would Improve (Percent)

Contractor

State Transportation Department

Workmanship quality

100

60

Safety

100

60

Timely project completion

100

60

Timely punch-list completion

100

60

Personnel experience

100

60

Warranty responsiveness

100

60

Personnel competence

88

40

Contractor cooperation with property owners

88

60

Timely construction submittal

86

60

Maintenance of traffic

75

60

Number of claims/disputes

75

80

Environmental compliance

75

40

Contractor cooperation with stakeholders

75

60

Contractor cooperation with public concerns

75

60

Management of subs

75

NR

Agency inspection

63

40

Contractor cooperation with agency

63

80

Liens

63

NR

Number of bidders

50

20

Material quality

50

40

Number of contractor-requested change orders

50

60

Achieving DBE goals

25

40

NR = No Response.
  • Table 12 indicates that both contractors and State transportation departments rate the evaluation of “corporate qualifications” (i.e., qualifications that relate to the experiences and qualifications of the contractor organizations) more highly than they rate the evaluation of contractors’ programs.

Table 12. Respondent State transportation department and
contractor performance factor rankings.

Corporate Qualifications

Ranking of Effectiveness

Transportation Department Rank

Contractor Rank

Past projects performance evaluations of contractor

1

2

Past relevant experience of the contractor

1

1

Past illegal behavior

1

4

Qualifications of key personnel

1

3

Claims history

5

4

Professional licensing of key personnel

9

9

Level of subcontracting (amount of work subcontracted)

12

12

Evaluated Programs

Transportation Department Rank

Contractor Rank

Safety plans

6

4

Environmental plans

7

9

Traffic control plans

8

9

Equipment and plant

9

7

Quality assurance plans

11

7

Use of DBEs

13

14

Public communications/public relations

14

12

  • Table 12 also indicates that both contractors and State transportation departments believe past performance, relevant experience, illegal behavior, personnel qualifications, and claims history are likely the most critical factors for determining a contractor’s effectiveness.

  • Table 12 also indicates that the State transportation departments rate past projects’ performance evaluations of contractor, past relevant experience of the contractor, past illegal behavior, and qualifications of key personnel as the most critical factors, equally.

  • Table 13 shows that contractors believe that a marginal contractor has an unfair advantage over a well-qualified contractor under the current system, which is reinforced by their belief that implementing performance-based contractor prequalification would disqualify the marginal contractors from bidding.

Table 13. Respondent contractor views on methods of determining project qualification.

Please Indicate Your Level of Agreement with the Following Statement:

Strongly Agree

Agree

Neutral

Disagree

Strongly Disagree

“Performance bonds guarantee the State transportation department will award its work to a qualified contractor.”

2

0

2

2

2

“A well-qualified contractor cannot compete on a level playing field with a marginally qualified contractor with the same bonding capacity.”

5

1

2

0

0

“If eligibility to bid was based on satisfactory past project performance, some of my competitors would not be eligible to bid.”

3

5

0

0

0

“I believe a performance-based prequalification system can be established that is reasonably objective and fair.”

2

6

1

0

0

“I would support a performance-based system if there are appropriate appeal mechanisms.”

2

5

1

0

0

Very Satisfied

Satisfied

Neither

Dissatisfied

Very Dissatisfied

Please Indicate Your Level of Satisfaction with the Bonding Companies’ Valuation Process.

0

5

4

0

1

Numerous State transportation department respondents and all contractor respondents expressed the belief that project performance can be quite valuable as an indicator of a contractor’s ability to deliver projects in an effective and timely manner. This suggests that improvements in the area of performance-based prequalification could benefit the project delivery process.

While all respondents considered financial factors important to ensuring effective project delivery, contractor respondents did not appear as confident as State transportation departments in the role that surety companies play. These differing opinions may be due, in part, to misconceptions about the nature of performance bonds and the roles that sureties play in the evaluation of contractors and the completion of a contract. These possible misconceptions are described below.

First, performance bonds are not insurance. They do not guarantee against non-completion of a contract under all conditions, as insurance would (if insurance companies made such a product available). Instead, performance bonds come into play only when the contractor has defaulted on completion of the contract and is in financial default (i.e., is unable to provide the funds to remedy the situation). Performance bonds are more a form of credit than insurance, in that they are priced like credit. Sureties go through the same steps to evaluate contractors as banks go through to evaluate corporate borrowers, and sureties have the same rights to monitor and intervene in the affairs of their contractors as do other creditors.

Second, sureties’ role as creditors gives sureties a superior ability to assess the financial and managerial capacities of contractors over long periods of time and to intervene in the affairs of contractors to prevent and avoid defaults. However, the advanced evaluation and intervention capabilities are limited by the nature of performance bonds themselves; these bonds do not guarantee the quality of work, nor do they guarantee that the full costs to complete a project in default will be covered by the performance bond.

Finally, and most relevant to the objective of improving the quality of contracted construction work through the prequalification of contractors, performance bonds give no protection against mediocre work. Sureties do not evaluate contractors in terms of the completion of timely, high-quality work that satisfies State transportation departments’ expectations. Sureties are unable to obtain data from State transportation departments about contractor performance, and even if the sureties could and did obtain such data, the low rates of default and the sureties’ limited obligations give the sureties little incentive to raise the costs of performance bonds in order to incorporate the contractor performance data.

The surety industry’s responses portray the significant benefits surety companies provide to State transportation departments throughout the construction process, which their unique status as the contractors’ creditors enables the sureties to provide. State transportation departments seem more attuned to the specific advantages of this service than contractors are and consequently appear unwilling to abandon the perceived security that performance bonds provide. Contractors have greater reservations about this conclusion and feel more strongly that performance-based prequalification methods can lead to improved project delivery, possibly even in place of performance bonds.

Analysis of the responses obtained from State transportation departments, contractors, the SFAA, and select surety companies suggests that opportunities to standardize and integrate performance-based prequalification methods as part of a more comprehensive prequalification process should be addressed to improve project delivery. The results provide an initial indication of State transportation departments’ and contractors’ appetites for improvements to the prequalification process, as well as an indication of potential areas for improvement, supplementation, and consolidation of the contractor evaluation process. Additionally, they reinforce the conclusion of NCHRP Synthesis 390 that barriers to performance-based prequalification implementation are low among members of the construction industry and that, while State transportation departments show little willingness to completely abandon performance bonds, they acknowledge the potential benefits of evaluating contractor project performance and using the information in the prequalification process.(17)

The bond benefit-cost analysis, in part based on the quantitative data detailed above, will be presented below. That analysis will integrate the data with indirect costs and additional economic factors, where applicable. The benefit-cost analysis and the information provided in this report, along with information collected in the literature review, will drive the elements of the prequalification model, also provided below.

OVERVIEW OF THE CASE STUDIES

Case studies were conducted with five State transportation departments: Iowa, Oklahoma, Utah, Virginia, and Washington State to evaluate the performance-based prequalification model in relation to the current prequalification practices of the State transportation departments; to get the State transportation department perspective on performance bonds; and gather project data for the benefit-cost analysis of both performance bonds and performance-based contractor prequalification.

All of the participants have some form of a performance-based prequalification system in place. The level of sophistication varies from reference checks to contractor project performance evaluations, and the level of integration of performance-based prequalification into the prequalification process also varies. All of the State transportation departments thought that the performance-based prequalification model was a good model. However, most indicated that they would not drop their current system for the new model because of the costs to replace their existing systems. Also, the States with more sophisticated systems already included most aspects of the performance-based prequalification model. The case studies indicated that a reduction in the value of a performance bond is not an advantage for good performers because the resulting change in performance bond premium price is minimal.

None of the participants could remember a time when a surety got involved in a project before the State transportation department requested the surety’s involvement. The studies also showed that the State transportation department would not necessarily know if the surety was involved with the contractor before the State transportation department’s request. Only two States reported any defaults between 2007 and 2011, and each of those States reported one default. Respondents from several States mentioned that the benefit of having performance bonds, even though the default rate is so low, is the State transportation department’s ability to threaten to contact the surety if a contractor is not performing well. This is an effective threat because if the surety is informed that a contractor is not performing well, it can impact the contractor’s premium rate on the next contract and make the contractor less competitive. None of the participants was comfortable eliminating performance bonds.

During the case studies, several different types of data were collected for the benefit-cost analysis. Each State was asked to identify how many full time employees were required to administer the performance bond system and the performance-based prequalification system. Also, each State was asked to provide contract values for each of the projects that occurred between 2007 and 2011, as well as the number of defaults that occurred over the investigated time period. A summary of this data is shown in table 14, and appendix B includes a summary of each case study.

Table 14. Summary of case study data.

State

Average annual value of awarded contracts
( 2007 - 2011)

Average number of contracts awarded annually (2007 - 2011)

Total number of defaults (2007 - 2011)

Number of FTE’s for performance bond

Number of FTEs for performance based prequalification

Percent of project value that is bonded

Average estimated annual cost of performance bonds
(2007 - 2011)
1

Iowa

$636,196,168

776

0

0.50

0.5

100

$4,453,373

Oklahoma

$757,314,976

1476

0

N/A

0.675

100

$5,301,205

Utah

$637,271,320

168

0

1

1

100

$4,460,899

Virginia

$527,702,787

362

0

0.50

2

100

$3,693,920

Washington

$217,543,476

95

1

0.75

2

100

$1,522,804

1Based on a 0.8 percent performance bond premium rate.
N/A = Not Applicable.
FTE = Full Time Equivalent.

 

Federal Highway Administration | 1200 New Jersey Avenue, SE | Washington, DC 20590 | 202-366-4000
Turner-Fairbank Highway Research Center | 6300 Georgetown Pike | McLean, VA | 22101