Federal Highway Administration Research and Technology Evaluation Final Report: Eco-Logical

Appendix C. Annual Report Interview Guides

This appendix lists questions asked verbatim from 2008 to 2015 by the Eco-Logical Program to recipients of Eco-Logical funding. The recipient type, year asked, and year reported are provided.

C.1. 2007 Grant Recipients

2007 Grant Recipients: 2008 Interview Guide (for 2008 Eco-Logical Annual Report)

Project:

• Please briefly describe your project if there have been any modifications to your grant application.
• How does your project meet the goals of Eco-Logical? In what way?
• What milestones have you achieved?
• What milestones would you like to achieve in the next six months?
• Are you facing any obstacles/challenges in implementing the grant?
• Are you facing any obstacles/achieving your milestones?
• What sort of feedback, if any, have you received from your stakeholders about your Eco-Logical Project?
• In what ways could you or FHWA market the lessons you have learned from your work on this project?

Contracting Process:

• One a scale of 1 to 5, please rate how easy the FHWA contracting process was, where 1 represents easy and 5 represents difficult.
• What could improve the contracting process? Are there any materials or knowledge that could have improved your experience?

Kick-off Call:

• One a scale of 1 to 5, please rate how useful the kick off call was, where 1 represents not useful and 5 represents very useful?
• What was most useful?
• What was least useful?

AOTR:

• Describe your working relationship with your AOTR?
• Since the start of your project, how many times have communicated with your AOTR? 0, 1–3, 4–7, more than 7.
• How could the working relationship with your AOTR be improved?
• In what areas would you appreciate more support, materials, and information?

Other Comments:

• Do you have any additional thoughts as to how the Eco-Logical grant program could be improved?
• Would you be interested in networking with other grantees? If yes, through what method?

2007 Grant Recipients: 2009 Interview Guide (for 2009 Eco-Logical Annual Report)

Project:

• Please briefly describe the status of your project.
• What milestones have you achieved?
• What milestones are planned in the next 6 months?
• What have been some of the initial outcomes of your grant project?
• Have any of the outcomes been unexpected?
• Has this grant helped you cultivate relationships with agencies or groups that you did not have any or positive relationships with before the grant? Who? How do you know?

Challenges:

• Please describe any challenges you have faced or are currently facing in implementing the Eco-Logical approach.
• If you have overcome any of these challenges, please describe how.
• Based on your experience, do you see broader challenges in implementing the Eco-Logical approach?

Future Work:

• After you complete your grant, will you continue work related to your project?
• Will you continue to use this work in the next steps in the transportation development process, including mitigation and environmental permitting?
• How do you see the work you have done during your grant project playing a role in the future works of your organization?

Eco-Logical Program:

• Thinking back to your initial decision to apply for an Eco-Logical grant, would you still have applied for this Eco-Logical grant?
• Would you recommend the Eco-Logical grant program to other potential grant applicants?
• Without the FHWA Eco-Logical grant funding, would you have pursued the type of work you are currently doing?
• Did the Eco-Logical grant solicitation inspire you to attempt the Eco-Logical approach, or was this something your organization was considering or involved with prior to the grant?

Other Comments:

• Have you presented your grant project at meetings, conferences, peer exchanges, etc.? If so, please list.
• In what ways could FHWA facilitate the success of your grant project?

2007 Grant Recipients: 2010 Interview Guide (for 2010 Eco-Logical Annual Report)

Project:

• Please briefly describe the current status of your project, and how it has changed since the last time we spoke.
• What have been the outcomes of your grant project since the last time we spoke?
• Have any of the outcomes been unexpected?

Future Work:

• Has your agency continued to use the results of your Eco-Logical project after the grant period has concluded? If not, why? What is its staying power within your agency/organization? Does Eco-Logical have staying power within the region?
• How are you/will you continue to use the outcomes of this work in the transportation project development process, including mitigation and environmental permitting?

Eco-Logical in Grant Recipient Organization:

• How would you characterize the general level of awareness/education about the outcomes of the Eco-Logical project within your agency? How did it get to that point (if high awareness)? Any ideas why it’s not more known (if low awareness)?
• How many staff from your agency were/are involved in the Eco-Logical project?
• What, if any, funding or personnel resources are available at your agency to support ongoing Eco-Logical implementation efforts?
• If the results of your Eco-Logical project has been or will be adopted by your agency or organization, how will the project information, responsibility and information be passed from outgoing staff to incoming staff when staffing changes are made at your agency/organization?

Relationships:

• Has this grant helped you cultivate new or more positive relationships with other agencies or groups? Who? How do you know?
• Can you describe if or how new or improved relationships have changed the way your agency or organization does business?

Challenges:

• Please describe any challenges you have faced or are currently facing in implementing the Eco-Logical approach.
• If you have overcome any of these challenges, please describe how.

Eco-Logical Program/Evaluation:

• What were your expectations of the purpose and planned outcomes of your Eco-Logical grant when you entered the grant program? Did they change, and if so, how?
• What metrics are you using or would you use to evaluate your application of the Eco-Logical approach to your project?
• In your view, could the Eco-Logical approach be applied successfully elsewhere? Why or why not? What circumstances would make the Eco-Logical approach successful elsewhere?
• Would you associate any risk with attempting the Eco-Logical approach?
• Do you think that the Eco-Logical process can lead to the development of an effective mitigation program prior to project development and implementation (prior to the completion of NEPA and/or construction)? What would that look like? Who would/should be responsible for funding this program?
• Did your agency view the Eco-Logical process as “transportation-centric” or do you believe that other agencies can benefit from the Eco-Logical approach? What actions/changes would make Eco-Logical less “transportation-centric,” and help other agencies to benefit from Eco-Logical?
• Whose interests are best served by the Eco-Logical process as it exists now?

Other Comments:

• Have you presented your grant project at meetings, conferences, peer exchanges, etc.? If so, please list.
• In what ways could or could have FHWA facilitate(d) the success of your grant project?
• What tools, products, or services from FHWA or others (i.e., resource agencies) would help you continue the implementation of your project? What would have been helpful while you were working on your project?

2007 Grant Recipients: 2011 Interview Guide (for 2011 Eco-Logical Annual Report)

Project:

• Please briefly describe the current status of your project and how it has changed since the last time we spoke.
• What have been the outcomes of your grant project in the past year? Have any of the outcomes been unexpected?
• What tools or resources have been critical to the progress and implementation of your project?

Future Work:

• How have you integrated Eco-Logical into your organization? Has the way in which your organization does business changed?
• How are you/will you continue to use the outcomes of this work in the transportation project development process, including mitigation and environmental permitting?
• In what other ways will your organization continue to use the products of your Eco-Logical project after the grant period has concluded?

Relationships:

• How have your relationships with partner organizations changed in the past year? Have you developed any new or strengthened relationships? Have you signed any formal agreements?
• Can you describe if or how new or improved relationships have changed the way your agency or organization does business?

Measuring Success:

• Based on your responses in the online questionnaire, you noted several measures of Eco-Logical implementation that your organization has accomplished (list questionnaire responses). Can you describe how these measures have or have not helped advance your project?
• What are the other ways that your organization has evaluated the performance of your project, either in the past year or planned for the future?

Applicability of Grant Projects:

• What elements of your grant project would be most valuable for streamlining environmental review and permitting of transportation project? How might other organizations adopt these elements to achieve better environmental outcomes?
• Have other organizations or regions used products or tools from your project? Would it be feasible to scale up your project to apply to other parts of the State or U.S.? If so, what suggestions would you have for applying your project at a national level?

Other Comments:

• Have you presented your grant project at meetings, conferences, peer exchanges, etc.? If so, please list.
• Please elaborate on your response from the online questionnaire about ways that FHWA could (have) better facilitate(d) the success of your grant project. Include explanation of any tools, products, or services that would be useful.

2007 Grant Recipients: 2012 Interview Guide (for 2012 Eco-Logical Annual Report)

Status and Activities in 2012:

• Please briefly describe the current status of your project and any significant activities related to the project over the past year.
• Which project partners remain active in your project or are currently using grant products (reports, data, tools, etc.)?
• What have been the most successful elements of your Eco-Logical project to date?
• What tools or resources have been critical to the progress and implementation of your project?
• Do you plan to continue working on your Eco-Logical project in the future? What are your planned next steps either directly or indirectly related to your Eco-Logical project? If you do not have continued work planned, why not?
• What events are taking place within your region that may take advantage of your Eco-Logical work or benefit from similar research?

Integration into Agency Practices:

• To what degree are products from your Eco-Logical project integrated into your organization’s decisionmaking processes (such as for long-range transportation planning, project selection, mitigation, funding, etc.)?
• What is Eco-Logical’s staying power within your organization? Within other organizations in the region?
• How would you characterize the general level of awareness about the outcomes of the Eco-Logical project among staff in your agency? How is knowledge about Eco-Logical shared among staff (including passing knowledge to new staff)? How is this product shared among your partners/neighbors?
• What, if any, funding or personnel resources are available at your agency to support ongoing Eco-Logical implementation efforts?

Eco-Logical Grant Project/Evaluation:

• What elements of your Eco-Logical project have you found to be the most effective in encouraging the Eco-Logical approach?
• What have been the greatest overall benefits/costs of the Eco-Logical project for your organization, your staff, or your region?
• What events have adversely affected the performance of your Eco-Logical project over the past four years?
• What have been the key takeaways for your agency or organization in implementing your Eco-Logical project?

Eco-Logical Program/Evaluation:

• How have your expectations or perspectives of the Eco-Logical Program changed since the start of your period of performance?
• Are there challenges or risks associated with the Eco-Logical Program? If so, what are these challenges or risks? What could FHWA or others do to mitigate these risks?
• What steps or resources would be needed to transform the Eco-Logical approach into a “business as usual” activity for your agency? Would these be the same for other organizations in your region?
• Whose interests are best served by the Eco-Logical approach (as promoted by FHWA in the grant program)?

Other Comments:

• Have you recently presented your grant project or shared information about it in a public forum? If so, please describe.
• How can FHWA continue to support past and future Eco-Logical grant projects?

C.2. 2013 IAP Recipients

2013 IAP Recipients: 2014 Interview Guide (for 2013-2014 Annual Report)

Project Status and Activities:

• Please briefly describe the current status of your Implementing Eco-Logical project and any significant activities related to the project over the past year.
• What have been the most successful elements of your Implementing Eco-Logical project to date?
• What challenges, if any, have delayed or adversely affected the development of your Implementing Eco-Logical project over the past year?
• What tools or resources have been critical to the progress and implementation of your project? Would you suggest that any of these should be shared with other DOTs or MPOs that are also implementing Eco-Logical?
• When do you expect to complete your Implementing Eco-Logical project? What are your planned next steps and upcoming milestones for the project? Do you consider your next steps to have any specific challenges?

Performance Measures and Deliverables

• What is the status of the performance measure(s) developed during your initial kick-off call, as listed above?
• What next steps do you plan to take toward the completion of each performance measure?
• Have the intended outcomes of each performance measure changed in any way since your initial kick-off call?

REF in Decisionmaking:

• Have you seen a shift in how decisions are made within your agency based upon your REF or Implementing Eco-Logical project? Among partner agencies? Within the region?
• What practices or next steps have you found, or do you think would be, useful in integrating the REF or Eco-Logical approach into your agency’s decisionmaking processes?

Project Partners and External Communications:

• How have you worked with partners since the start of your Implementing Eco-Logical project? Have new partnerships or unanticipated challenges emerged?
• What outreach forums, materials, or strategies (e.g., meetings, brochures, presentations, etc.) have you found helpful in promoting your Implementing Eco-Logical project?

Incorporating the Eco-Logical Approach into Agency Culture and Management:

• Has the level of awareness about your Implementing Eco-Logical project changed in your agency since last summer, particularly with staff not directly involved in the project?
• What steps are you taking or do you anticipate taking to further integrate the Eco-Logical approach into “business-as-usual” practices within your agency?

Perspectives on Participation in Implementing Eco-Logical and Eco-Logical Grant Program:

• How does your Implementing Eco-Logical project relate to your prior Eco-Logical grant project? What differences, if any, have you observed between the projects or processes used for each project?
• What lessons have applied to your Implementing Eco-Logical project from your experiences as an Eco-Logical grant recipient?
• What advice or recommendations would you offer agencies interested in using the Eco-Logical approach and potentially facing challenges related to partnerships, data-sharing, agency resources, etc.? Would you be interested in sharing these with other MPOs or DOTs as part of a peer exchange?

Evaluating the Implementing Eco-Logical Assistance Funding Program:

• What type of support from FHWA would be helpful to you as you continue your Implementing Eco-Logical project (e.g., webinars, guidance materials, targeted expertise, coordination, workshops, etc.)? May something be useful pertaining to any challenges in your “next steps,” as outlined in Question E?
• Do you have any other suggestions or feedback for FHWA regarding Implementing Eco-Logical?

2013 IAP Recipients: 2015 Interview Guide (for 2014-2015 Annual Report)

Project Status and Activities:

• Please briefly describe the current status of your Implementing Eco-Logical project and any significant activities related to the project over the past year.
• What have been the most successful elements of your Implementing Eco-Logical project to date?
• What tools or resources have been critical to the progress and implementation of your project? Would you suggest that any of these should be shared with other DOTs or MPOs that are also implementing Eco-Logical?
• What challenges affected your project over the past year? Did these challenges cause delays or changes in scope/trajectory? If the timeline for your project changed, what were the reasons behind this?
• When do you expect to complete your Implementing Eco-Logical project? What are your planned next steps and upcoming milestones?

Performance Measures and Deliverables

• What is the status of the performance measure(s) developed during your initial kick-off call, as listed above?
• Has the use of performance measures for your Implementing Eco-Logical project been helpful in tracking its progress? Are you happy with the measures that you chose and how you are tracking them? Are any changes to the measures needed?

Reflecting back on when you chose your performance measures two years ago, do you have any recommendations for how we could improve the process?

The table above lists the deliverables included in your Statement of Work.

1. Is the status of each deliverable accurate?
2. Can you provide Volpe with copies of any missing deliverables?
3. Can we feature or link to any of these deliverables from the FHWA Eco-Logical website?

REF in Decisionmaking:

• Have you seen a shift in how decisions are made within your agency based upon your REF or Implementing Eco-Logical project? Among partner agencies? Within the region?
• What practices or next steps have you found, or do you think would be, useful in integrating the REF or Eco-Logical approach into your agency’s decisionmaking processes?

Incorporating the Eco-Logical Approach into Agency Culture and Management:

• In the past year, has your agency or partner agencies initiated or implemented new organizational structures or policy support (e.g., training, peer guidance, and technical support; MOUs; policy and engineering directives; and standard operating procedures)?
• To what degree are products from your Eco-Logical project integrated into your organization’s decisionmaking processes (such as for long-range transportation planning, project selection, mitigation, funding, etc.)? Has the level of awareness among staff changed?
• What steps are you taking or do you anticipate taking to further integrate the Eco-Logical approach into “business-as-usual” practices within your agency?

Project Partners and External Communications:

• How have you worked with partners throughout your Implementing Eco-Logical project? What types of partnerships or unanticipated challenges have emerged?
• How have you promoted your Implementing Eco-Logical project (e.g., meetings, webinars, brochures, and websites)?

Perspectives as an Implementing Eco-Logical Recipient:

• What have been the greatest overall benefits/costs of the Eco-Logical project for your organization, your staff, or your region to date? Have you seen any quantitative benefits relating to expedited project delivery, reduced project costs, limited environmental impacts, etc.?
• What elements of your Eco-Logical project have you found to be the most effective in encouraging the Eco-Logical approach?

Perspectives on the FHWA Eco-Logical Program/Implementing Eco-Logical Initiative:

• How have your expectations or perspectives of the FHWA Eco-Logical Program and/or Implementing Eco-Logical IAP changed since the start of your IAP project?
• Are there challenges or risks associated with participating in Eco-Logical? If so, what are these challenges or risks? What could FHWA or others do to mitigate these risks?
• What type of support from FHWA would be helpful to you as you continue your implementing Eco-Logical project (e.g., webinars, guidance materials, targeted expertise, technical assistance, etc.)?
• Do you have any other suggestions or feedback for FHWA regarding Implementing Eco-Logical?