Table 5. Project information by evaluation
| Project |
Objectives |
Methods |
Key Metrics |
Key Findings |
| Adaptive Signal Controls Retrospective | - Objective 1: Managing congestion by improving reliability and operating the system at peak performance.
|
- Comprehensive review of program documents, data gathering, and analysis.
- Qualitative interviews.
- Quantitative survey of arterial management agencies.
|
- ASCT products developed that can be qualitatively tied to results of actions of the R&T ASCT program.
|
- FHWA had both a direct and indirect effect on ASC technology development.
|
| Eco-Logical Retrospective/SHRP2 |
- Objective 1: Promote more informed transportation planning, programming, operations, and coordination.
- Objective 2: Promote integrated planning that improves transportation safety and addresses environmental, social, and economic needs.
- Objective 3: Streamline the project delivery process.
- Objective 4: Minimize environmental impacts of transportation investments.
|
- Review of program documents, data gathering, and analysis.
- Qualitative interviews of recipients and nonrecipients of FHWA assistance.
|
- State DOTs and MPOs indicate increases in partnering, sharing data, analyzing effects, identifying key sites and actions, documenting, implementing and evaluating ecological information.
- Anecdotes of: potential reductions in project delivery time, improved environmental outcomes, more effective collaboration, better relationships, improved transparency.
|
- (Evaluation not yet complete)
|
| eNEPA Tool Prospective |
- Objective 1: Promote more informed transportation planning, programming, operations, and coordination.
- Objective 3: Streamline the project delivery process.
- Objective 4: Minimize environmental impacts of transportation investments.
|
- Qualitative interviews, including interviews with transportation and resource agency staff using eNEPA.
- Collect quantitative data regarding specific project milestones (some data available through eNEPA statistics, other data will be requested from FHWA or State DOTs).
|
- Number of agencies actively using eNEPA.
- Number of projects by class of action in eNEPA.
- Length of time between specific project milestones (e.g., Notice of Intent (NOI), draft environmental impact statement (DEIS), final environmental impact statement (FEIS), record of decision (ROD), etc.).
- Qualitative measure on transparency of process.
|
- (Evaluation not yet complete)
|
| Exploratory Advanced Research (EAR) Agent-Based Modeling Retrospective and Prospective |
- Objective 3: Demonstrate and communicate the value and impact of exploratory advanced research and promote opportunities to move from advanced to applied research.
|
- A single evaluation plan with similar logic model, goals, and measures to cover three agent-based projects.
- Evaluate driver behavior in traffic retrospectively and the two others prospectively.
- Interviews (project researchers, academic community, FHWA (EAR, Safety R&D, Planning), relevant TRB committee members.
- Document and literature reviews, including citations and references to FHWA work in other publications, conference activities, ongoing research, etc.
|
- State DOTs and MPOs indicate increases in partnering, sharing data, analyzing effects, identifying key sites/actions, documenting, implementing, and evaluating ecological information.
- Anecdotes of: reductions in project delivery time, improved environmental outcomes, etc.
|
- (Evaluation not yet complete)
|
| Geosynthetic Reinforced Soil (GRS) abutments Retrospective |
- Objective: 5: Improve highway condition and performance through increased use of design, materials, construction, and maintenance innovations.
|
- Interviews with State and local engineers, FHWA staff, researchers, and consultants.
- Analysis of available data on bridge deployments.
|
- User friendliness/challenges of guidance documents.
- Extent of State DOT adoption of GRS-IBS.
- Reasons for and against adoption.
ï‚· Senior-level support for GRS-IBS.
- Cultural/organizational roadblocks to adoption.
- Preliminary cost comparison (GRS versus alternative).
|
- FHWA activities raised awareness and understanding of GRS-IBS technology and construction guidelines among the majority of stakeholders interviewed.
- FHWA activities have supported local stakeholders and the pace of GRS-IBS bridge construction has increased, but the degree to which the former contributed to the latter remains unclear.
- Preliminary analysis shows GRS-IBS technologies can reduce bridge construction costs and construction time, but conflicting evidence exists and additional research. Research is underway to explain discrepancies.
- Stakeholders reported hesitancy to embrace GRS-IBS technology both within FHWA and local agencies.
- Initial support for GRS-IBS may be stronger at the county and municipal levels than at the State level.
|
| Gusset Plate Retrospective |
- Objective 1: Improve the security of highway infrastructure and reduce the number of fatalities attributable to infrastructure design characteristics and work zones.
- Objective 2: Improve the management of infrastructure assets and advance the implementation of a performance-based program for the National Highway System.
- Objective: 5: Improve highway condition and performance through increased use of design, materials, construction, and maintenance innovations.
|
- Document searches and reviews.
- Interview State DOT bridge staff and members of AASHTO's Subcommittee on Bridges and Structures (SCOBS).
- Review of download/request statistics on FHWA gusset plate resources.
|
- Number of agencies that have adopted updated LRFD bridge design specifications.
- Number of agencies that have adopted revisions to the Manual for Bridge Evaluation.
- Number of downloads/requests for load rating guidance and examples for bolted and riveted gusset plates in truss bridges.
- Number of downloads/requests for technical advisory.
- Number of downloads/requests for NCHRP Web-Only Document.
- Number of downloads/requests for TechBrief: Guidelines for Design and Rating of Gusset-Plate Connections for Steel Truss Bridges.
|
- FHWA’s technical expertise in bridge infrastructure and its prior history of working with NTSB was critical during the bridge investigation.
- FHWA's coordination with key stakeholders contributed to an accelerated timeline to closing NTSB recommendations.
- FHWA's commitment to bridge research and the decision to jointly fund the NCHRP effort accelerated the research timeline, resulting in expedient development of revised specifications for load rating and designing gusset plates.
- FHWA's active and ongoing engagement of transportation stakeholders expedited the delivery of new information regarding the design and load rating of gusset plates.
|
| High Friction Surface Treatments Prospective |
- Objective 1: Support the systematic planning, management, and evaluation of roadway safety.
- Objective 2: Accelerate the reduction in injury and fatal crashes at intersections.
|
- Quantitative analysis of project-level safety data.
- Quantitative analysis of safety portfolio level data.
- Qualitative and quantitative analysis of transportation safety literature, national and State technical documentation, and State transportation planning documentation.
- Qualitative analysis of communications among State DOTs and MPOs.
- Interviews with transportation safety professionals.
|
- Changes in the rate of appearance of HFST in strategic highway safety plans.
- Changes in the rate of appearance of approved and completed HFST projects.
- Estimated and projected safety impacts associated with changes in the prevalence of HFST.
- Changes in the prevalence of HFST within discussions among State DOTs and MPOs
- Changes in the prevalence of crash modification factors for HFST projects in key data bases and publications.
- Progress toward documentation of HFST in key publications.
|
- (Evaluation not yet complete)
|
| Managing Risk on Rapid Renewal Projects Prospective/ SHRP2 |
|
- Qualitative interviews.
- Review of State DOT documents, policies, and procedures.
- Quantitative analysis of project data.
|
- Adoption of R09 processes by State DOTs.
- Qualitative assessment of impact of R09 processes on project risk management.
- Changes in accuracy of project cost estimates for IAP recipients.
- Changes in accuracy of project schedule estimates for IAP recipients.
- Changes in project schedule compared with similar projects for IAP recipients.
- Changes in project cost compared with similar projects for IAP recipients.
|
- (Evaluation not yet complete)
|
| National Household Travel Survey (NHTS) Retrospective |
- Objective 2: Promote the efficient, systematic, and comprehensive collection and utilization of national transportation data to improve highway management and investment decisions.
|
- Qualitative interviews.
- Document searches and reviews.
- Analysis of website usage statistics.
|
- Number of NHTS citations by field and transportation topic.
- Number of website visitors, visits, and page views per month.
- Number of datasets (2001, 2009) downloaded per month.
- Qualitative measure of the role NHTS has played in informing policy, program, or project decisionmaking.
- Lessons learned regarding NHTS planning, survey administration, and outreach.
- Qualitative assessment of the effort to collect, process, and act on user feedback.
|
- Nearly half of the publications using the 2014 NHTS are in the transportation field with the share of nontransportation publications growing and website data access increasing.
- While it is difficult to trace the precise decision outputs of NHTS, the interviews suggest that NHTS informs policy and legislative decisions within transportation and other fields.
- NHTS reaches out to its user community through its website, direct contact, and formal events.
|
| P3 Capacity Building Program Prospective |
- Objective 3: Develop innovative procurement and revenue generation tools and technical resources.
|
- Document searches and reviews.
- Qualitative interviews.
- Quantitative survey research (to be determined).
- Analysis of quantitative data (e.g., website usage statistics, training registration, etc.).
|
- Webinar/training attendance.
- Number of times documents cited in legislation, policy, etc.
- Use of planning, evaluation, and procurement resources.
- Number (%) of projects considered, evaluations undertaken, and project awards/rejections.
|
- (Evaluation not yet complete)
|
| Precast Concrete Pavement Prospective/SHRP2 |
- Objective3: Improve the ability of transportation agencies to deliver projects that meet expectations for timeliness, quality, and cost.
- Objective 4: Reduce user delay attributable to infrastructure system performance, maintenance, rehabilitation, and construction.
- Objective: 5: Improve highway condition and performance through increased use of design, materials, construction, and maintenance innovations.
|
- Case study analysis of relevant precast concrete pavement (PCP) projects.
- Analysis of project documentation (e.g., meeting notes and other relevant documents).
- Interview FHWA staff and stakeholders to determine impacts.
|
- Quantitative and qualitative assessment of the benefits and costs of utilizing PCP compared to a baseline construction technique.
|
- (Evaluation not yet complete)
|
| Roadside Revegetation Retrospective |
- Objective 1: Understand whether and how end users of the guide have changed their previous revegetation practices to adopt those put forth in the guide.
- Objective 2: Understand whether and how the establishment of native plants have been improved and resulted in other positive outcomes.
|
- Survey to Federal agencies, offices, and units asking about Roadside Revegetation awareness and implementation.
- Telephone interviews with subset of Federal, State, and local agencies to ask about the type of native roadside revegetation techniques the agency uses, the outcomes of using native roadside revegetation, and whether each organization is supportive of using native plants in the future.
|
- Percentage of projects (and types of projects) for which Roadside Revegetation techniques are used.
- Correlative data on accidents with and without use of the recommended practices; otherwise, qualitative views on the topic.
- Reduction of vegetation obscuring sight lines, contributing to icing conditions, covering guardrails, etc.
- Reduced sedimentation, incidence of landslide, use of herbicides, erosion; improved water quality or drainage.
- Cost comparison of revegetation practice with and without use of the recommended practices.
- Qualitative views on the topic; any available data on sustainability indicators (e.g., scores from FHWA's Web-based tool, INVEST), driver satisfaction, agency perception of benefits.
|
- End users have adopted the Roadside Revegetation practices, using the guide as a reference tool to reinforce existing measures mandated by agency policies.
- End users are aware of Roadside Revegetation and its associated materials and have found the guide to be very informative and useful.
- Overall outcomes on projects that apply Roadside Revegetation's recommended practices guide have been improved. Respondents and interviewees believed Roadside Revegetation has generally improved erosion, sustainability and environmental stewardship, and visitor experience outcomes.
- There is less indication that the guide has helped to improve safety
|
| Roundabouts Retrospective |
- Objective 2: Accelerate the reduction in injury and fatal crashes at intersections.
|
- Qualitative interviews.
- State document review (SHSPs, Highway Design Manuals) and qualitative interviews.
- Trend analysis of national roundabouts inventory database.
- Citation analysis of FHWA research products.
- Literature review.
|
- Number and growth in citations and references of FHWA work in non-Federally funded roundabouts research.
- Adoption of FHWA work into the AASHTO Green Book, Highway Capacity Manual, Highway Safety Manual, or other relevant standards documents.
- Number of States with roundabouts guidance in State Highway Design Manuals and number of States referencing FHWA in this guidance.
- Change in FHWA roundabouts-related policy or guidance practices.
- Number of States with roundabouts included in their in their Strategic Highway Safety Plans (SHSPs).
- Growth in the total number and number of States building roundabouts in the United States.
- Existing research demonstrates a reduction in number of crashes at roundabouts versus traditional intersections.
|
- There is strong evidence of FHWA’s influence on the acceptance, consideration of, and adoption of roundabouts, beyond what might have occurred in the absence of FHWA research and activities.
- Early and continued FHWA research increased the quality and availability of domestic roundabouts-related safety and performance data and accelerated the development of design standards for roundabouts.
- FHWA laid the foundation for nationwide adoption of roundabouts by providing empirical evidence of the safety and operational benefits of roundabouts, increasing awareness of and confidence in them among stakeholders, and contributing to the development of the nationwide design standards for their implementation.
- FHWA played an active role in accelerating the early adoption of roundabouts through leadership
|
| Traffic Incident Management (TIM) Training Prospective/ SHRP2 |
- Objective 1: Manage congestion by improving reliability and operating the system at peak performance.
|
- Quantitative analysis of incident (crash) data, TIM training records, and jurisdictional info. May use pre/post test, multiyear regression, or other method.
- Interviews with TIM trainees and local agency officials to assess plausibility of causality and identify mechanisms.
|
- Change in roadway clearance time.
- Change in incident clearance time.
- Change in rate of secondary collisions.
- Percent of responders who have received TIM training.
- Relevance of training to observed outcomes.
|
- (Evaluation not yet complete)
|
| Vehicle Operating Costs Study Prospective |
- Objective 1: Evaluate impacts of a broad range of policy options and analyze current and emerging issues that will affect surface transportation programs.
|
- Analyze literature and interview FHWA staff and stakeholders to determine impacts of updated vehicle operating costs and equations, specifically on policy/project decisions.
- In conjunction with FHWA contractor:
- Determine the users of the updated vehicle operating costs and equations.
- Survey users of the updated vehicle operating costs and equations to determine the impacts of the updates.
|
- Count (and description) of applicable users of the vehicle operating costs and equations.
- Count (and description) of uses of the updated vehicle operating costs and equations.
- Attitudinal responses to interview or survey questions.
|
- (Evaluation not yet complete)
|
| (High Recycle) Warm-Mix Asphalt Prospective |
- Objective: 5: Improve highway condition and performance through increased use of design, materials, construction, and maintenance innovations.
|
- Qualitative interviews.
- Analysis of project documentation (e.g., meeting notes and other relevant documents).
- Survey of FHWA Division Offices.
|
- Qualitative assessment of the impacts of collaboration on FHWA research outputs and on the adoption of High Recycle WMA.
- Qualitative assessment of the benefits of State and industry experience in utilizing FHWA guidance on High Recycle WMA.
- Qualitative assessment of the challenges or barriers in utilizing FHWA guidance.
|
- (Evaluation not yet complete)
|
Note: Objectives are taken from the TFHRC Research Agenda.(12)
