Skip to content

Concept Design for an Online Information Source for Major Surface Transportation Projects: A Discussion Paper

June 2017
Table of Contents

« Previous

Appendices

Appendix A: FHWA Major Projects

This appendix contains a list of the major projects included in FHWA's Active Project Status Report as of February 21, 2017. These projects use federal funding and have a capital cost of $500 million or higher. These are the projects that would be included in the Online Information Source for Major Transportation Projects.

FHWA ACTIVE PROJECT STATUS REPORT PROJECTS
AL Birmingham Northern Beltline
CBD I-59 / I-20 Bridge Replacement
AK Knik Arm Crossing
AZ SR 202L South Mountain Freeway
State Route 303: I-10 to US-60
CA BART Seismic Retrofit System Wide
Centennial Corridor Project
Doyle Drive / Presidio Parkway Project
Gerald Desmond Bridge Replacement
I-405 Sepulveda Pass Widening and High Occupancy Vehicle Improvement
I-405: SR-73 to I-605
I-5 HOV North (SR-134 to SR-118)
I-5 North Coast Corridor Project, San Diego County
I-5 South Los Angeles County Widening Project
I-80 / I-680 /SR-12 Interchange
I-80/ San Francisco-Oakland Bay Bridge (East Span)
I-805 Managed Lanes North Project
Marin-Sonoma Narrows
New Route CETAP Mid-County Parkway (MPC) Corridor
SR-11 and Otay Mesa "East" Port of Entry
SR-4 (East) Widening Project
SR-46 Corridor Improvement Project
SR-905 from I-805 to Otay Mesa Port of Entry
SR-91 Corridor Improvement Project /HJOT Lanes Initial Project)
CO I-70 East
North I-25 ROD1, ROD2 and ROD3
CT I-95 / New Haven Harbor Crossing
DE US 301 Project, DE/MD Line to SR1
DC South Capitol Street Corridor Project
FL I-395 Reconstruction
I-4 Ultimate W/ Managed (Tolled) Lanes (Moving-4-Ward)
I-75/SR826 Managed Lanes
I-95 Express (Phase 3)
Miami Intermodal Center
Pinellas County Gateway Expressway Project
SR 249 - Wekiva Parkway
Three Mile Pensacola Bay Bridge
GA I-285/GA 400 Interchange Project
Northwest Corridor Project (I-75-I-575)
IL Circle Interchange
Elgin-O'Hare Western Access
O'Hare Con-RAC
IN US 31 Hamilton County
IA Council Bluffs Interstate System Improvements, Segments 1, 2 and 3
I-74 Quad Cities Corridor Study
KY Louisville Southern Indiana Ohio River Bridges Project
US 68/KY80, Lane Between the Lakes, West of Cadiz, KY
MD I-81 Improvement Project
MI I-75
I-94/Edsel Ford Freeway
MN St. Croix River Crossing
MS I-269 Corridor
NV I-15 South
I-15/Project NEON
NH I-93 Reconstruction
NJ Rt. I-295 & 42/I-76 Direct Connection
NY Brooklyn Bridge Contract 6
Goethals Bridge Replacement
Kosciuszko Bridge Replacement, I-278 over Newtown Creek
Route 347
Tappan Zee Hudson River Crossing / New NY Bridge Project
Willis Avenue Bridge
NC I-77 Express Lanes from Exit 11 (I-277 Brookshire Freeway) to Exit 36 (NC 150)
Monroe Expressway
OH Brent Spence Bridge Corridor Project
Cleveland Innerbelt
I-70/71 Columbus Crossroads -- Phases 1-6
I-75 (HAM-75-2.30), City of Cincinnati (Mill Creek Expressway)
Portsmouth Bypass
OK I-40 Crosstown
PA Central Susquehanna Valley Transportation (CSVT)
Commonwealth of PA Rapid Bridge Replacement Project
I-95 Betsy Ross Interchange and Bridge Street Ramps Reconstruction
TX Bergstrom Expressway - US 183 from US 290 to SH 71
DFW Connector
IH 35 (From IH37 to Schertz Parkway)
IH 35E Managed Lanes (Dallas and Denton)
Loop 12 / Interstate Highway 35E Corridor
Midtown Express (SH 183 Managed Lanes Project)
North Tarrant Express 3A & 3B (NTE 3A & 3B)
Project Horseshoe IH-30/IH-35E
SH 288
SH 99 Grand Parkway, Segment H and I-1
SH 99, The Grand Parkway (Segments F-1, F-2 and G)
Southern Gateway Managed Lanes Project
Trinity Parkway (from IH 35E/SH 83 to US 175/SH 310)
U.S. 181 Harbor Bride Project
US 281 HOV expansion project
US 290
VA I-95 HOV/HOT Lanes, Northern Segment
Midtown tunnel/Downtown Tunnel/Martin Luther King Extension Project
Thimble Shoal Parallel Tunnel Project
Transform 66, Outside the Beltway
WA SR 520 - Pontoon Construction Project
SR 520, I-5 to Medina: Bridge Replacement and HOV Project - Floating Bridge and Landings Stage
SR 520, Medina to SR 202: Eastside Transit and HOV Project
SR 99: Alaskan Way Viaduct Replacement Project
WV WV Corridor H - Section 2, Kerens to Parsons Project
WI I-39/90
I-41 Reconstruction
I-43 North-South (Silver Spring Drive - Wis 60)
I-94 North-South
Tri-County Freeway, USH 10/441
Zoo Interchange (I-94/I-894/US-45)
FHWA COMPLETED ACTIVE PROJECT STATUS REPORT PROJECTS
CA Alameda Corridor
I-15 Managed Lanes, SR-163 to SR-78
I-215 San Bernardino North Corridor Project (from I-10 to I-210)
SR-52 Extension
CO I-25/I-225 Southeast Corridor (T-REX)
FL (iROX) I-75 from GG Parkway to SR-80, D/B/Finance
Connector - I-4 to Lee Roy Selmon Expressway
I-595 Corridor Improvements
Port of Miami Tunnel & Access Improvements (POMT)
SR826/SR836 Interchange Reconstruction (Palmetto 5)
Tampa Interstate System (TIS)
IN I-465 Est Leg Reconstruction (Accelerate 456)
I-69 SIU 3 Section 4
LA I-10 Twin Span Structures
MD Intercounty Connector
MA Central Artery/ Ted Williams Tunnel
MN I-35W St. Anthony Falls Bridge
MO I-64 from Spoede Rd. to Sarah Street
New Mississippi River Bridge
NC Triangle Expressway, Western Wake Freeway
TX Central Texas Turnpike
Eastern Extension of the President George Bush Turnpike (SH 190)
Katy Freeway Reconstruction
IH 695 Managed Lanes
North Tarrant Express 3A & 3B (NTE 3A & 3B)
SH 130 Segments 5 & 6
SH 161 - President George Bush Turnpike Western Extension
Southwest Parkway (SH 121) - Chisolm Trail
UT I-15 Corridor, Salt Lake County
VA Capital Beltway High Occupancy Toll (HOT) Lanes
I-95/I-395/I-495 Springfield Interchange
I-95/Woodrow Wilson Bridge
WI I-43/I-94/I794 Marquette Interchange

Appendix B: Purpose, Data Requirements and Potential Data Sources

There is increasing interest across the United States in bringing greater efficiency to the construction and operation of public transportation infrastructure. One set of strategies that has been advanced is to use public-private partnership (P3) concessions to implement and operate large and complex surface transportation improvements. Under the P3 concession approach, a private sector developer/investor raises the necessary financing to fund up-front capital construction costs by leveraging project revenues. These revenues are typically either in the form of user charges or periodic availability payments made by the public sector project sponsor, or some combination of the two. The private partner is responsible for designing and constructing the project, and then operating and/or maintaining it for a designated concession period in exchange for the right to receive the revenue during that time, either in user fees or payments from the project sponsor.

The potential benefits and limitations of using the P3 concession approach are widely cited; however, few data are available to corroborate these claims. The wide variety of specific conditions under which the P3 procurements are negotiated and operated have made comparisons between various types of P3 projects and conventional project delivery difficult to generalize. Study of the features of various P3 procurements could shed light on both their strengths and weaknesses. This information could form the basis for substantiated conclusions about the comparative advantage of different procurement strategies in installing and operating transportation infrastructure under different conditions.

Tier 2 of the Information Source is intended to fill that information void. Such a repository could provide source material that could improve the understanding by interested stakeholders in the collective experience with these approaches.

This Appendix provides further details to supplement Chapter 3, and in particular includes data elements proposed to be included in a Tier 2 database providing information on the financial and performance characteristics of P3 and non-P3 projects. The secondary audience for the information source (and the main audience for Tier 2 information) is expected to include researchers and transportation policy analysts who study alternative delivery methods and project performance. Private sector P3 developers and design-builders may also benefit from being able to evaluate other projects and gain contextual understanding of the issues that public agencies are interested in tracking. The Tier 2 information could also be useful to other transportation stakeholders with an interest in P3 and alternative project delivery methods. The information source is expected to provide quantifiable information on project outcomes for select projects for which more detailed data is available, allowing policy analysts and researchers to assess whether P3 projects delivered benefits and efficiencies compared to non-P3 projects for those specific projects and, if so, under what conditions.

B.1 Project Information
B.1.1 Purpose

The recommended data elements under this category are primarily identifiers and descriptors that serve to define individual projects within the database. The proposed data elements describe the project name, project type, geographic location and functional class, project length, cost and delivery method. However, some data elements have direct influence on the project outcomes, and thus, serve a purpose beyond providing descriptions. For instance, attributes such as the project type (e.g., greenfield vs brownfield) or toll status (e.g., fixed vs variable), are likely to have different cost outcomes and risk profiles.

B.1.2 Information Requirements

The proposed data elements to describe the project information are listed in Chapter 3.

These data elements would be available at the same level of detail for both the Tier 1 and Tier 2 of the information source.

It should be noted that a project might be procured under multiple contracts using different procurement types. If this is the case, the online information source should have the flexibility to assess each contract or procurement type individually, as well as the capability to aggregate information on individual contracts to provide information on the entire project. There are challenges associated with accomplishing this.

B.1.3 Potential Data Sources

The primary sources of data include the FHWA Center for Innovative Finance Support website and project websites maintained by project sponsors. These websites include key project information, location and project limits, purpose and need of the project, procurement information, and schematics of the project concept. The FHWA Center for Innovative Finance Support website maintains project profiles that include key information, such as project description, cost, funding structure, and project delivery method, for each P3 project. The Center's Reports on P3 projects also supplement the information available on individual project profile websites. If additional information is necessary to allow quantification of project footprints and components, it could be obtained from project sponsors or design documents.

Another notable source of project-specific information is the FHWA's Highway Performance Monitoring System (HPMS) database. HPMS provides inventory information in greater detail for all public roads that are eligible for Federal-aid highway funds, albeit at different degrees for roadways categorized under National Highway System (NHS) vs. non-National Highway System facilities. The HPMS provides project-specific information that includes, but is not limited to, the route number, functional class, speed limit, number of lanes, traffic volume, percent trucks, toll status, etc. No potential challenges are expected in gathering the proposed data elements. Information from such databases would need to be reviewed to determine if the information is structured in such a way that it could be quantified within a project's limits.

For projects financed with tax-exempt debt, the Municipal Securities Rulemaking Board's Electronic Municipal Market Access (EMMA) website is an additional information source. The EMMA website contains continuing disclosure reports and regular updates from bond issuers providing a wealth of information.

B.2 Legislative Information
B.2.1 Purpose

The recommended set of data elements captures the key provisions of the State's P3 legislation to supplement the project description information. As of January 1, 2016, thirty-three states as well as the District of Columbia and Puerto Rico have enacted P3 legislation with full or limited authority. Forty-eight states - all but Iowa and Oklahoma - have passed enabling legislation allowing design-build procurements. Many key provisions of the P3 or design-build legislation, including the authorization, time limits, governance, financing and proposal administration, vary from state to state, as the legislation of each state is tailored to reflect the specific objectives of the state. P3 authorization legislation may provide blanket authority to implement P3s, authority for a limited group of pilot projects, or project specific approval.

Given that P3 legislation varies from state by state, the data structure should be flexible, and to the extent possible avoid personal judgement, focusing instead on observable data. In addition, since legislative developments are often fluid, all information will need to be date stamped in order for information source users to determine what authorities were in place at the time different project development decision were made. Key provisions in P3 authorization legislation reflect the political and regulatory environment and the fiscal policies under which the P3 projects are conceived, procured and executed. Capturing the key legislative provisions at the time that projects were procured is essential in order for information source users to be able to make meaningful comparison of P3 and non-P3 project outcomes across states.

B.2.2 Information Requirements

The proposed data elements that capture the key legislative provisions are included in Chapter 3.

These data elements would be available at the same level of detail for both Tier 1 and Tier 2. Note that the information should reflect the status of legislation at the time the decision was made with regard to project delivery method.

B.2.3 Potential Data Sources

The primary source of data includes the project delivery/procurement websites of individual public agencies. However, the National Conference of State Legislatures (NCSL) reports serve as a single source to access this information with relative ease. The key NCSL reports include the following:

  • NCSL's Private Partnerships for Transportation: A Toolkit for Legislatures - Also referred to as the NCSL's P3 Toolkit, the report provides a comprehensive categorization and analysis of the transportation P3 enabling statutes of State agencies.
  • NCSL's Transportation Funding and Finance Legislation Database - This database tracks legislation from all 50 states and provides information on P3 related legislative bills considered since 2009.
  • FHWA's Alternative Contracting Methods Library, an online source maintained by the Office of Program Administration, provides online information on DB enabling statutes.
B.3 Agency Capacity & Policy
B.3.1 Purpose

The proposed set of data elements captures the sponsoring agency's organizational capacity, past experience, advisory and analytical capabilities, as well as the key policies relating to project procurement. The primary intent of capturing this information is to supplement the legislative information to evaluate the maturity of the agency's procurement experience and practices. In addition, some of the proposed attributes may profoundly shape the bidders' perceptions of procurement risks, which are in turn reflected in their bid prices. This data table could also capture project objectives such as economic development or congestion relief. Information on policy goals and objectives could be programmatic applying to groups of projects developed by an individual project sponsor, or they may vary from project to project. The information source should make that distinction. The point is to capture data regarding policy goals and objectives. For example, was the intent of the owner to minimize toll rates, have maximum flexibility for future toll rates facility improvements, minimize upfront public subsidy/maximize project scope, minimize expected project costs, or involve local proposers, etc.

B.3.2 Information Requirements

The proposed data elements, that could be at the same level of detail for both the Tier 1 and Tier 2 levels of the information source, are included in Chapter 3.

These metrics should be date-stamped so that users can track changes over time. Note that the initial information should reflect the status of agency policy and capacity at the time the decision was made with regard to project delivery method.

B.3.3 Potential Data Sources

The FHWA Center for Innovative Finance Support tracks policy initiatives influencing highway development in all states and identifies them in its project profiles and other technical reports. This information could be supplemented from project sponsor websites, which could also serve as important information sources. These websites include key information on P3 statutes and rules, P3 manuals of instruction, a summary of past, current and future P3 projects, and the organizational structure. Furthermore, if needed, any missing information might be addressed through selective questionnaire interviews/information requests with the project sponsor, or possibly fieldwork.

B.4 Project Development
B.4.1 Purpose

The primary objective of the project development phase is to develop a preferable project concept with an appropriate level of design that is ready for procurement. The project concept establishes a baseline for proposers to build on. The level of detail of the designs prepared by project sponsors depends on the project delivery method. It is typically five to 30 percent for P3 and design-build projects and 100 percent for design-bid-build projects. The project development data included in the online information source is needed to establish a baseline for performance, cost, schedule and risk outcomes that will be compared to those of the final design and actual performance. For instance, this could include comparisons of the net benefits of the base concept with net benefits of the final design, for P3 and non-P3 projects. This would provide an indication of the level of value the private sector has introduced for P3 projects relative to non-P3 projects.

The project sponsor's preferred concept is typically selected from a set of reasonable alternatives using an alternatives analysis. Considering that P3 projects typically involve an environmental impact statement (EIS) or environmental assessment (EA), all reasonable alternatives, including the no-build option, are evaluated during the environmental review process. Much of this information is typically contained in EIS or EA reports. Technical reports, which are ancillary to EIS/ EA reports, also summarize the findings of special studies undertaken to assess existing operational and environmental conditions and potential future changes expected during and after project implementation. In addition, some states have additional environmental requirements that must be addressed.

The review of alternatives begins with the identification of the purpose and need for the project and a set of reasonable project alternatives. These are then assessed for cost, future traffic demand, existing and future operational conditions, engineering factors (primarily mobility and safety), and the analysis of environmental impacts. This process culminates in the selection of a preferred design concept that reflects the economic worth and the trade-offs between the different project benefits, costs and impacts. Project sponsors also often undertake financial feasibility analysis to assess available funding options and public investment needs.

Some of the most important issues arising during the project development stage include the quality of traffic forecasts at a given point in project development, project-specific environmental impacts, and agency-specific environmental requirements. Collectively, these factors have a profound influence on the project risk profile, innovation potential, and cost outcomes. These issues also shape the selection of the preferred alternative.

The identification of potential risks and risk mitigation strategies is another critical activity that typically occurs during the project development phase of major projects. The risk analysis records contain detailed information about the project risks, risk mitigation plans, and risk allocation strategies. This information is usually summarized in a risk register. While it would be ideal to capture all pertinent information from risk assessments in the online information source, key metrics would include risk-adjusted estimates of project costs and schedule. These provide an indication of the completeness of the agency's risk analysis exercise and the private sector's ability to reduce project cost and schedule risks further. This information would be helpful in validating the assumptions made in the Value for Money (VfM) analysis. Two key considerations when trying to obtain this information would include: Is this information documented and compiled such that it can be accessed, and would the owners of the information be willing to share it for inclusion in the information source?

B.4.2 Information Requirements

Tier 1 data is discussed in Chapter 3. Data on the project development phase for the Tier 2 level of information would focus on the following considerations:

  • A summary of the findings of the environmental review process, such as the level of review, impacts and commitments, which would provide an indication of the complexity and constraints of the project. The environmental review and alternative analysis reports could be archived for future reference, in lieu of resource-intensive data mining efforts.
  • Pre-construction and forecasted traffic demand summaries would provide a baseline for developing designs and assessing whole life asset and operational performance. Any inaccuracies in traffic forecasting, as measured by the differences between forecasted and actual data, may result in substantial downstream financial and performance risks. Given the private sector's opportunities for recalibration of the agency-provided forecasted data, this information will help to explain the differences in whole life performance management between P3 and non-P3 projects. Recognizing the challenges in extracting pre-construction and post-construction forecasted traffic demand summaries, these reports can also be archived for future reference.
  • Risk analysis summaries provide insights on the agency's understanding of the planned project. The summaries typically include a register of all identified risks, risk-adjusted cost and schedule estimates, and the top twenty percent risks by severity of cost and schedule impacts. The risk-adjusted cost and schedule estimates, including the contingencies, form the basis for the sponsor's engineering cost estimate. In conjunction with the final contract cost and time, this information will provide insights on how well the project was implemented. It should be noted that it could be time consuming to develop an understanding of the different risks that actually arise on individual projects. This would likely require a careful review of project construction reports. However, it may be possible to standardize collection of this information over time. In addition, various versions of risk analysis summaries can be archived for future reference.
  • Cost, revenue and user-benefit estimates from the Benefit-Cost and Value for Money analyses provide information to evaluate the assumptions made by the project sponsor. The benefits may include monetized forms of travel time savings, crash rate reduction, change in emissions, fuel and non-fuel vehicle operating costs. Note that the FHWA P3-VALUE 2.0 tool allows users to estimate user benefits and calculate benefit-cost ratios.

The project development data included in the online information source will include core metrics that will be necessary to establish a baseline against which later project outcomes could be compared. There is also additional information that it may be helpful to have in order to develop a more comprehensive understanding of project outcomes. If it is practicable to do so, this information should also be collected. However, if the level of effort to collect it is onerous, or if the data is unavailable or unreliable, a decision may be made not to pursue this information, or only include it when it can be easily obtained. When appropriate, the project development metrics should also be date stamped so that users can understand the sequence in which different analyses were made and how certain metrics may have changed and evolved over time.

A list of data elements to be included in Tier 1 are provided in Chapter 3. Tier 2 data are summarized below.

  • Tier 2 Level of Information:
    • Percent contingency included in the pre-bid cost estimate
    • Pre-bid final schedule included in the pre-bid schedule estimate
    • Schedule contingency incorporated in the pre-bid schedule estimate
    • Financial feasibility analysis data including: date of analysis, project revenue, debt capacity, lifecycle operating cost estimate and available public funding
    • Benefit cost ratios for P3, design-build and design-bid-build projects
    • Pre-construction traffic and operational data, including AADT, percent trucks, free-flow speed, peak hour volumes, transit ridership
    • Pre-construction crash rates (by fatalities, injuries and property damage) and possibly incident rate, incident management practices and performance.
    • Risk assessment - risk assessment date, number and type of risks in risk register, baseline cost before risk assessment, baseline schedule before risk assessment, total cost value of unmitigated risks, net schedule change due to unmitigated risks, total cost value of mitigated risks, net schedule change due to mitigated risks
    • Post-construction forecasted traffic and operational data, including AADT (average weekday and weekend volumes), percent trucks by truck class, free-flow speed, peak hour volumes, transit ridership
    • Post-construction forecasted crash rates (by fatalities, injuries and property damage) and possibly incident rate, incident management practices and performance
    • Pre-construction costs by cost type (e.g., utilities, right-of-way, scoping, surveying, environmental review, planning, public involvement, etc.)
    • Environmental impacts and commitments by impact type (e.g., right-of-way, ecological, flood plains, Section 4(f), Section 6(f), farmlands, coastal areas, hazardous materials, noise, air quality, archaeological and historical properties)
B.4.3 Potential Data Sources and Challenges

The primary sources of project-development information for Tier 2 include the following:

  • Project-specific environmental review (EIS and/or EA) reports and ancillary technical reports - These reports are typically available on project websites. It should be noted that these reports are often extensive and not easily perused for the kind of detailed information that would be of use in the online information source.
  • Project sponsor's internal project development documents, including risk register, VfM, benefit-cost and financial feasibility reports - The project sponsor's internal documents may include summaries of internal analytical exercises, such as risk assessment and financial analysis, undertaken to support the project development process. Internal documents may or may not be available for public scrutiny, depending on the arrangements and requirements for transparency. It may be difficult to obtain these types of internal records and some project sponsors may object to making the information openly available to users.

In addition, missing information could be supplemented through questionnaires, interviews, or specific information requests to project sponsors. While environmental review and technical reports contain a wealth of information relating to pre-bid project development, extracting this information with reasonable quality checks may be a laborious and resource-consuming exercise for project sponsors. Moreover, they may not prefer to reveal some sensitive information, such as those available in risk or financial analyses.

Standardizing the data on project development will likely be challenging, as different agencies may use a variety of reporting or analysis format. Standardizing the data would help to minimize the subjectivity of subsequent analyses performed by users.

B.5 Project Procurement
B.5.1 Purpose

Analysts could use project procurement data included in the online information source to evaluate and compare efficiency and effectiveness of the procurement of P3 and non-P3 projects. Process efficiency is a reflection of the maturity of a public agency's procurement practices, while the effectiveness is an indicator of the "value" that the agency locks in at the procurement stage. The efficiency of the procurement process is evaluated in terms of resource expenditure, including stipends paid to qualified proposers, and the duration of procurements.

The effectiveness of the procurement process may be assessed by comparing actual project costs and schedules with pre-bid estimates. Additional effectiveness parameters include market maturity, competitiveness and responsiveness, the level of pre-bid engagement between the project sponsor and proposers, private sector efficiency, value capture through alternative technical concepts, and the evolution of the project design concept over the procurement period.

B.5.2 Information Requirements

Information would likely focus on data elements that are captured, derived and aggregated at the conclusion of the procurement process. Data elements that could be readily captured for the Tier 1 level are included in Chapter 3.

More detailed information for the Tier 2 level may include the following data elements:

  • Procurement costs of the project sponsor, including total stipends paid to all qualified proposers, are a key component of the project's whole life costs. This information may be difficult to disaggregate from agency costs and would depend on the accounting approach used.
  • RFQ/ RFP evaluation criteria provide information on stated priorities of procurement as well as the established goals of the project.
  • The winning bidder's proposal provide subcontractor-related information, including the number of equity and non-equity partners, primary role of each subcontractor (i.e., engineering design, construction, operations, maintenance), company-related information of each subcontractor (e.g., company size in terms of number of employees, total revenue), and the presence of subcontractors (i.e., local/regional/national/global).
  • The project sponsor's RFQ/RFP and the winning bidder's proposal provides information on disadvantaged business enterprise (DBE) goals, the number of DBEs, status of DBEs (e.g. women owned, minority owned), the DBE goal proposed by the winner proposer, and the DBE performance of subcontractors.
  • Surety, bonding requirements and letters of credit (e.g., bond amount, duration of coverage, and costs, if available) for bid bonds, performance bonds, payment bonds, and O&M bonds.
  • Labor and wage related information, such as whether the project sponsor requires labor wages to be paid at prevailing minimum or union rates in accordance with the federal Davis-Bacon Act or equivalent State Acts; whether the project sponsor has signed a project labor agreement (PLA) with unionized labor organizations, and if positive, the applicability and scope of the PLA on the project; and whether the labor requirements are applicable for highway maintenance workers as well.
  • The ATCs offer insights on the efficiency potential of the private sector. In addition, gathering information on ATCs is important as a measure of innovation. However, it may be time consuming, as well as subjective, to quantify the value of these proposals and determine whether they actually achieved the desired benefit in the long term. The collective value of cost and schedule savings achieved through the implementation of ATCs, which is typically derived at the conclusion of the procurement process, would be deemed adequate for use in the Tier 1 level. It should also be noted that capturing the benefits of any design optimization undertaken by the private sector outside the purview of the ATC process would be challenging. The number of proposed, approved and implemented ATCs and their total value categorized by value type (i.e., cost, schedule, asset quality, work zone, operational quality) can be captured for the Tier 2 level.
  • The RFP addenda issued to provide additional clarifications, such as to address errors and omissions, can be used to evaluate the efficiency of the procurement process. The RFP addenda issued due to ATCs and scope changes reveal how the project concept evolved with interaction with the private sector during the procurement process.
  • The metrics based on the comparison of award outcomes with those of the agency's pre-bid estimates are an indicator of how the project costs and schedule evolved over the course of project development. These metrics also serve as aggregated indicators of value of money and private sector efficiencies locked in the contract.
  • The information on pre-RFQ meetings with the industry and stipends reflect the project sponsor's initiatives to boost competition.
  • The number of RFP meetings, including those for ATCs, indicates the level of communication between the project sponsor and proposers and may also indicate a lack of clarity in the RFP.

As with other project phases, certain data metrics would be essential in tracking procurement issues, and are listed as Tier 1 data in Chapter 3. Other desirable procurement information could also be included in Tier 2 of the information source if it could be obtained without excessive effort.

  • Tier 2 Level of Information:
    • Total stipends
    • Percent costs set aside for DBE by the winning proposer
    • Amount and duration of coverage for all sureties and bonds
    • Key contractual provisions, relating to change in law, non-compete, non-discriminatory specification change, latent defects, force majeure.
    • Number of subcontractors
    • RFQ and RFP evaluation criteria and scoring
    • Number of RFP addenda by purpose
    • FTE Hours to oversee procurement
    • Number and cost of advisory contracts to support the procurement process
    • Total number of proposed/approved/implemented ATCs by winning and non-winning proposers
    • Number of conditionally approved ATCs requiring design waivers, exceptions and changes in environmental review and permitting
    • Number of proposed/approved/implemented ATCs claiming value by value type (i.e. cost, schedule savings, asset quality, operational performance and work zone disruptions)
B.5.3 Potential Data Sources and Challenges

Potential data sources include:

  • Sponsor and project website
  • Agency's published and internal procurement documents
  • Proposers' procurement submittals
  • Sponsor interview/survey

Some of the data elements, such as RFQ/RFP dates, number of submittals, evaluation criteria and scoring and award value, are readily available in the public domain on agency or project websites. Other items, such as stipends, the reasons for issuing RFP addenda and ATCs are typically available from sponsoring agencies in the form of proposer submittals, decision notifications and contract administration documents. It should be noted that the ATC related information is often redacted or requires further quantification and validation of the claims relating to cost, schedule and operational benefits.

While most of this information should be gathered with relative ease, there are potential challenges:

  • Non-availability of information: Depending on the sophistication of the sponsoring agencies' documentation practices, some information, such as staffing hours, reasons for RFP addenda, or value propositions of various ATCs may not be available. Basin information on ATCs is generally available, but obtaining richer information requires effort and the willingness of the holder to share the information. Impacts may not be well quantified, and ensuring comparability across different jurisdictions will be challenging given different methods of quantification.
  • Inconsistencies: Reconciling differences in reporting and terminology among state and regional and local stakeholders can be challenging.
  • Higher level of effort: Though some data elements reside with sponsoring agencies in internal documents and submittals, the information may not be readily available. Sponsors may have to undertake a separate effort to extract information from internal documents.
  • Data confidentiality: Project sponsors may prefer not to reveal some sensitive information, such as those available in price proposals and those related to ATCs, for valid reasons; however, agencies may select to mask critical information for reporting purposes. For example, sponsors may use an aggregation of total cost savings from ATCs without revealing the specific source, or provide a high-level description of reasons without revealing the specific details.
  • Data quality: The value propositions made in ATC submittals are those claimed by the proposers, and are sometimes exaggerated. Without independent verification by the agency, the accuracy of any claims of ATC cost savings cannot be assured. Data quality also includes other several dimensions.
B.6 Project Implementation
B.6.1 Purpose

Analysts would use the project implementation data included in the online information source to evaluate how implementation is managed and to compare specific performance outcomes for P3 and non-P3 projects. The information gathering exercise could focus primarily on "quantifiable" performance outcomes of the design and construction tasks in terms of schedule, cost, quality, and work zone performance. In addition to these quantitative measures, qualitative factors that influence the outcomes of the implementation phase could be captured as well. These include the level of integration among project phases, the level of partnering between parties, and the influence of earlier project development stages. These issues, however, are not easily measured.

The different project delivery options forge different levels of integration among the design, construction, finance, operational and maintenance phases of projects. In a traditional design-bid-build environment, design and construction are completed independently and operating and maintenance costs may not be tracked separately. However, with P3 delivery the private sector partner is responsible for the integrated completion of project design, construction and ongoing maintenance and operations. This has the potential to generate opportunities for efficiency gains in terms of cost, schedule and lifecycle performance. This level of integration may result in a smoother implementation process with fewer change orders, claims and disputes. In addition, the certainty of the whole life cost of maintaining the facility is likely to change with the project delivery method.

Since project implementation represents the culmination of earlier development phases, any errors or omissions by the project sponsor in the pre-bid project development and procurement phases may trigger inefficiencies including change orders, claims and disputes during project implementation. As the level of integration increases, the likelihood of such inefficiencies is generally expected to decrease, resulting in better performance outcomes. The information source could enable researchers to explore the influences of earlier stages on outcomes as projects are implemented.

B.6.2 Information Requirements

The intent should be to capture meaningful milestones rather than simply assembling a library of project design and project control documents. The information source would focus on the aspects of the implementation phase identified below:

  • The timeline of design and construction phases will be used to establish schedule performance. Basic schedule information, including key milestones, start and end dates, and notice to proceed, can be obtained from the readily available sources, while additional details, such as schedule extension grants, liquidated damages, and schedule related incentives and disincentives would require more effort.
  • Primary construction methods: cut-and-cover, deep bore tunneling, etc.
  • All pertinent cost components, including design, construction, value engineering savings, additional costs due to change orders and delays, construction administration and quality assurance. This information can be used to establish final contract costs. The readily available sources could provide aggregated costs, while the disaggregated costs will typically require more research. However, the availability of reliable disaggregated costs for design and construction may be challenging for design-build and P3 projects. The cost data obtained from private sector sources may require validation by the project sponsor.
  • Information relating to project financing and revenue sources, including financing sources such as TIFIA loans, GARVEE bonds, private activity bonds, commercial debt, shareholder equity, tolls, availability, progress, milestone and completion payments, value capture techniques, and local revenue measures,
  • Quality assurance information, including frequency and value of non-conforming work, as well as the as-built asset quality, will be used to evaluate quality outcomes of the project. These data elements are typically available in the advanced sources.
  • Work zone configuration, closure schedule and performance measures may be used to evaluate work zone performance in terms of work zone road user costs. This data element involves a separate computation effort using the following inputs: number of lanes opened and closed, lane widths, work zone length, traffic volume passing through the work zone, traffic volume on detour, hourly traffic demand, traffic composition, travel speed, closure times, closure duration, and unit costs for travel time and vehicle operating costs. Many agencies also include the estimated cost of crashes that occurred due to work zone related reasons in the user cost computations. The data elements required to estimate work zone road user costs may require significant data mining efforts.
  • Total value, in terms of cost savings and net schedule savings, from all value engineering proposals may be used as a measure of private sector efficiencies gained during design and construction.
  • Information on sponsor-initiated change orders and private sector claims may be used to provide insight on how the processes and risks were managed prior to and during implementation. Change orders and claims also influence cost and schedule performance outcomes.
  • Details on the settlement of claims, which can be derived from research, may provide an indication of the nature of the relationship between the project sponsor and its private sector partners and the cost of managing the claims. Typically, claims settled at the project-level require less time and resources than those that go to arbitration and litigation. Similarly, the number and complexity of claims tend to correlate with the project type and project delivery method. More complex projects also introduce a greater likelihood for claims. However, the project delivery method and level of integration between the project development phases may mitigate this potential.
  • Construction partnering sessions may provide an indication of the level of communication between the project sponsor and private sector and may result in lower opportunities for claims.

A list of data elements to be included in Tier 1 is presented in Chapter 3 and Tier 2 data elements are summarized below.

  • Tier 2 Information:
    • Work zone performance attributes, including vehicle miles traveled through work zone, closure periods, cumulative delay, posted travel speeds, average travel speeds, crash rates by crash type, vehicle miles traveled through detours, and road user complaints.
    • Approved value engineering proposals, including number of proposals, total cost value and net schedule savings.
    • Non-conformance of work, including number of instances, value of work accepted as-is, value of work accepted after corrective work, and value of work that required rework.
    • Asset quality indicators after construction, including percent within limits for pavements, bridge rating factors.
    • Number and total duration of construction partnering workshops.
    • Quality assurance non-conformance instances
    • Payments withheld due to con-conformance
    • Value of non-conformance work corrections
    • Schedule change due to change orders
B.6.3 Potential Data Sources and Challenges

The best sources of information on project implementation are project-specific post-construction evaluation reports prepared by project sponsors using project construction and contract administration records. Most project sponsors maintain an electronic document management system where a variety of project documents reside, including quality management plans, change orders, acceptance records, non-conformance reports, project-closeout reports, time extension approvals, liquidated damages, and value engineering details. The sponsor's documentation may also include information on construction partnering sessions, summaries of claims and follow-up actions, decision summaries on settled claims, and implementation costs. It is possible the project sponsors may not wish to share certain information externally, so it will be important to demonstrate the benefits of doing so to these agencies.

Finance-related information is available in the project profiles and other reporting prepared by the FHWA Center for Innovative Finance Support and financial plans and the updates submitted to FHWA's Major Projects Team. For projects financed with bonds, an additional source of information is the Municipal Securities Rulemaking Board's Electronic Municipal Market Access (EMMA) website, which contains reports and regular updates from bond issuers. Discrepancies between these different data sources are common and would need to be resolved.

It is expected that most, if not all of the additional data elements identified for the Tier 2 level will not be included in project sponsor reporting. Accessing this data may require significant effort and may involve asking project sponsors to extract information from their internal records. In addition, some records, such as claims or quality assurance, may be subject to version-control issues. Robust quality control measures may be needed to ensure data accuracy. Such efforts could be challenging, time consuming and costly.

B.7 Operations and Maintenance
B.7.1 Purpose

As projects move into the operations and maintenance phase, the online information source would provide information on the quality with which service is being provided. Service quality might be assessed using asset conditions by type, implementation of maintenance, preservation and renewal (MP&R) actions, asset life-expectancy and life-cycle costs accrued over the analysis period. Beyond asset condition, additional attributes of service quality include the level of user charges and operating expenses. Researchers may be interested in comparing these types of efficiency measures between P3 and non-P3 projects. Note that the data collection period should be asset-specific but long enough to include at least one major rehabilitation event. Recognizing the need to keep the data collection period similar for all P3 and non-P3 projects, the average duration of the P3 projects included in the information source could also be used for non-P3 projects.

This information could be utilized to evaluate: i) whether projects are maintained in a state of good repair; ii) the effectiveness of managing various asset types in terms of optimizing the applications of MP&R actions to minimize life-cycle costs; iii) the efficiencies of intervention actions to repair deficiencies and restore to acceptable conditions within the contractually stipulated curing period (counter factual equivalents may not be available for non-P3 projects); iv) conditions and residual asset design life at the end of the concession or analysis period; and v) loss of revenue or monetized aggregation of work zone delay costs when the facility needed more frequent repairs due to inadequate maintenance and repair actions.

The online information source could use performance and level of service attributes relating to maintenance quality and operational performance to evaluate service quality. This could be reported in terms of timeliness of maintenance actions, maintenance adequacy, user satisfaction, mobility, safety and incident clearance. Various performance indicators of service quality can also be monetized and aggregated in terms of user costs.

Information on the financial performance of P3 and other revenue generating projects could also be included in the information source. This could also include information on any financial distress or events due to defaults, bankruptcies, and restructuring, as well as renegotiations of tariffs/tolls/availability payments. Such occurrences would also provide an indication of financial, market-related, forecasting and political risks.

Facility performance in the "use" phase is a direct outcome of decisions made during the project development phases. The decisions made during procurement, design and construction phases will have a substantial impact on the net financial, asset and operational performance of transportation projects. For example, the level of construction quality committed to during procurement or achieved during construction influences future asset performance. The appropriateness of design decisions, such as design deviations, or the impact of design flaws on operational performance also influence asset performance, as do the validity of future costs for maintenance and rehabilitation estimated at the time of procurement. The robustness of traffic forecasting during the pre-bid phase affects future financial performance. Researchers could use the online information source to highlight the connections between the project development decisions and service delivery outcomes.

B.7.2 Information Requirements

Information capture would focus on the attributes of the operations and maintenance phase discussed below:

  • Condition indicators would be required to describe the overall quality of the roadway assets. Reporting from readily available sources can include primary roadway assets, specifically pavements and bridges, for Tier 1, while the Tier 2 level can include ancillary assets, such as signs, ITS devices, pavement markings, lighting and culverts. The asset condition information may include composite condition rating or nationally reported asset condition measures at the Tier 1 level or detailed measurements of distresses and deficiencies of individual asset components at the Tier 2 level. The condition indicators of the primary roadway assets include:
    • For pavements, the nationally reported condition measures, which include international roughness index, faulting, cracking and rutting, can be gathered from readily available sources, while, agency-specific pavement condition indices as well as individual condition measurements, including friction and potholes, can be reported using the research.
    • National Bridge Inventory (NBI) Condition Ratings for: Decks (Item 58), Superstructure (Item 59) and Substructure (Item 60), which are reported nationally can be used at the Tier 1 level, while other ratings, Channel and Channel Protection (Item 61), Scour Criticality (Item 113) and deficiencies, such as in rails, bearings, painting, drainage systems, approach slabs, expansion joints, surfaces and sidewalks, and fender systems can be reported at the Tier 2 level.

The ancillary assets may use a simple index or detailed measurements, such as condition rating for culverts, replacement age or retro-reflectivity for signs and pavement markings, illuminance for roadway lighting, and mean time between failures for Intelligent Transportation Systems (ITS) devices.

  • When condition indicators fail to satisfy performance thresholds, the responsible party is required to undertake follow-up actions to address the deficiencies. Follow-up actions may include scheduled applications of MP&R actions to prevent further deterioration or corrective actions to repair deficiencies. Data elements would include performance thresholds, curing periods, type of repair actions undertaken, non-availability of lanes, repair costs, and non-compliance points. Researchers could use this information to compare the efficiency of the asset maintenance process between P3 and non-P3 projects.
  • Performance thresholds can be readily captured at the Tier 1 level from the procurement documents of P3 projects. The performance thresholds for non-P3 projects, which could differ from those for P3 projects, can be captured from the agency's MP&R decision matrices.
  • Curing periods are more appropriate for the Tier 2 level of information. While this information can be captured using readily available sources from the procurement documents of P3 projects, the curing periods do not generally apply for non-P3 projects. An equivalent metric for non-P3 projects would involve a resource-intensive exercise of identifying time lapses between the reporting of deficiencies and the date of follow-up actions.
  • Asset conditions measured at the end of the analysis period could serve as a proxy for handback conditions for non-P3 projects. The nationally reported asset conditions can be gathered from readily available sources, while detailed measurements can be obtained based on research. The ability to capture this information would depend on whether project sponsors keep data of this sort on a mile-post to mile-post basis, since this information would be needed to align with project boundaries for non-P3 projects.
  • The effectiveness of roadway maintenance activities could be evaluated for the Tier 2 level using maintenance level of service (LOS), or maintenance performance ratings. Specifically for P3 projects, indicators, such as non-compliance points, number of instances when maintenance fails to achieve contractually stipulated thresholds, etc., could also be captured to assess the timeliness and quality of maintenance activities. Capturing similar information may be challenging for non-P3 projects, as most agencies may not track the timeliness performance of maintenance activities. More than half of State DOTs utilize maintenance management systems that capture needs identification, scheduling and tracking of maintenance activities. This is especially true in large, high-growth states that have sponsored the majority of P3 projects undertaken to date in the U.S. The metrics derived from these systems, in conjunction with maintenance LOS and percent backlog, can give some indication of the timeliness of maintenance activities for non-P3 projects. Other measures, such as user satisfaction ratings and safety performance, could serve as surrogate metrics to evaluate the quality of maintenance activities. A similar approach could be used to determine the quality of incident clearance as well.
  • Mobility and safety performance indicators are more appropriate for the Tier 2 level of information. Such indicators may include the number of crashes by crash severity type, transit ridership on the highway improvement corridor, free-flow speeds, travel times, and vehicle miles travelled to provide insight on operational performance of the facilities.
  • The role of the private sector is not restricted to P3 projects alone. Some project sponsors may use performance-based maintenance contracts. Participation of the private sector in maintenance of non-P3 projects could also be included in the information source.
  • All pertinent cost components, including those for roadway maintenance, asset preservation, and data collection costs, would be used to establish life-cycle costs. The historic per-mile cost estimates could be included in the Tier 1 level of information, while detailed estimates of unit costs or real expenditures could be included in Tier 2.

A list of data elements to be included for Tier 1 is presented in Chapter 3. Tier 2 data elements are summarized below.

  • Tier 2 Information:
    • Life expectancy of newly constructed or rehabilitated assets (by asset type). This data element involves computation of life expectancy using performance forecasting of asset condition ratings.
    • Lifecycle costs (by asset type)
    • MP&R action history (by asset type and year)
    • Budget required and allocated (if available)
    • Curing period (by asset type) - for P3 projects only
    • Whether restored within curing period (by asset type and year)
    • Lane closure or non-availability (by asset type and year)
    • Non-compliance points (by asset type and year) - for P3 projects only
    • User costs if condition exceeds thresholds (by asset type and year). This data element involves the computation of work zone user costs as well as non-work zone travel costs due to travel time, crashes, emissions, and fuel costs. Note that FHWA's Highway Cost Allocation Study provides guidance on computing external non-work zone costs to road users.
    • Maintenance level of service (by year)
    • Crash rates by crash severity type (by year)
    • Handback condition (by asset type) or the condition at the end of analysis period
    • Mobility metrics by vehicle type (auto, single unit trucks, combination trucks and buses)
    • Number of incidents by cause (e.g., weather, crash, medical, law-enforcement), statistical summary of incident clearance and response times, and occurrence of secondary crashes
    • Number of snowy/icy/flooding conditions, traffic volume during weather event, time for traffic volume to return to normal conditions
    • Maintenance performance rating and deficiency threshold (by maintenance type)
    • Mobility performance, including free-flow speed, percent congested conditions, travel time reliability, volume-to-capacity ratio, percent lane-mile-hour non availability (by year)
    • Transit ridership, to the extent that it is easily measured or tracked within project boundaries
    • Number of incidents, average incident response and clearance times (by year), performance threshold for incident response and clearance
    • Incident clearance costs
    • Number of customer complaints
    • FTE hours to monitor performance
B.7.3 Potential Data Sources and Challenges

Regardless of the delivery method, many project sponsors monitor the performance of transportation facilities through condition surveys, field surveys and output from intelligent transportation systems. With P3 projects, private partners may be responsible for monitoring facility performance. These performance monitoring efforts would provide the most online source of information on the performance of the P3 and non-P3 projects included in the online information source.

The Tier 1 level of information can be readily generated from the FHWA's national HPMS and NBI databases as well as project procurement documents. Owner agencies are likely to possess cost per mile estimates of various MP&R activities for pavements and bridges. Additional sources of operating costs and financial information include the EMMA continuing disclosure reports, FHWA Major Projects financial plan updates, and possibly borrowers' annual TIFIA financial plan reports.

For the Tier 2 level, the asset-related information may be generated from the automated systems used to monitor the condition of pavements, bridges and ancillary assets. Other potential data sources for asset-related attributes include:

  • The concessionaire's lane closure requests, submitted to the public agency for approval, containing information on the type and timing of MP&R activities
  • Procurement documents containing information on performance thresholds, curing periods, handback requirements, calculation of non-compliance points, and associated payment adjustments.
  • The public agency's unit costs for various asset and non-asset maintenance activities.
  • The concessionaire's description of the asset maintenance plan in its technical proposal.

Potential data sources for compiling information on mobility, incident clearance and safety include internal sponsor records, reports submitted by private partners, and mobility metrics derived from ITS data. Third-party sources may also have mobility data and public agencies often analyze such information for planning purposes.

There will likely be significant challenges in assembling the recommended performance information, as the range of performance data suggested may not be readily available from project sponsors. Project sponsors may have to dedicate substantial resources to collect, check, analyze, summarize and report the recommended data elements. This may also involve collecting information from a variety of existing internal sources and private partners. There may be difficulties in obtaining information from private partners particularly for those data elements not identified in the P3 agreement for reporting. There may also be a need for a significant amount of post-processing to derive usable metrics from the raw data, if this information is not already available as a part of the project sponsor's standard performance reporting practices or within the contractual obligations of their private partners.

« Previous

back to top