Federal Highway Administration Research and Technology Evaluation: National Household Travel Survey Program Final Report

Appendix B. Interview Guides

B.1 NHTS Program Manager Interview Guide

[NOTE: This interview guide will be attached to an email that more fully describes the Evaluation effort. We will send the questions in advance so interviewees have some time to think about their responses. We will try to conduct all of these interviews in-person.]

Thank you for taking the time to meet with me today. We’ll be touching on a range of topics related to the NHTS Program. First, we’d like your insights on the ways in which NHTS data are used, and how NHTS data have played a role in decision-making. We will also explore the ways in which the NHTS Program solicits and responds to feedback from its user community. Finally, we want to hear your thoughts on any challenges or hurdles the NHTS Program faces in the planning, oversight and outreach of its survey.

1. To start, can you tell us a little bit about your history with the NHTS Program?

PROBE:

• How long have you been [were you] involved with the NHTS survey?
• How many years have [did] you serve as Program Manager?
  
  
2. Can you describe the major ways in which the NHTS Program has evolved during the time you have been involved with it (or during the time you were its manager)?
   
   
3. First, I’d like to talk about some of the reporting outputs developed by the NHTS.
   
   

   1. How did the Travel Trends document become a standard NHTS deliverable?

   PROBE:

   • Do you know who uses Travel Trend reports?
   • Do you know how the information in the reports is being used? Have the Reports had any impact on decision-making?
     
     

   2. How do you determine what NHTS Briefs are developed in each survey cycle?

   PROBE:

   • Do you know who uses the Briefs?
   • Do you know how the Briefs are used? Have they had any impact on decision-making?
     
     
4. Next, can you describe some other examples where the NHTS staff has contributed to important research efforts or reports using the NHTS data? For the purpose of this interview, we can discuss 2 or 3 of these examples in detail, and I will follow up with you after the interview to obtain a more complete list of your efforts.

[FOR EACH EXAMPLE, ASK:]

1. First, what was the purpose or the main question being addressed?
   
   
2. How did you use the NHTS data to address that question (e.g., incorporate NHTS data into a model, conduct trend analysis, etc.)?
   
   
3. Did you produce a report or some other deliverable that included the NHTS data analysis?

PROBE: Is it on the NHTS website? Would it be included in the Compendium?

4. We are trying to trace how NHTS data and the outputs produced by that data impact decision-making. Do you know whether and how the example you just described has informed any phase of policy-making or rulemaking OR any phase of a program or project (e.g., planning, implementation, modifications)? IF YES – Please explain.

PROBE:

• What [policy, rulemaking, program or project] has your NHTS work informed?
• Do you know how your NHTS work informed the [policy, rulemaking, program or project]?
• Are there other decision- making decision-making* contexts in which your NHTS work has had an impact?

FOR ANY IMPACTS CITED ABOVE:

5. How much impact would you say the NHTS data had on this [policy/rulemaking/program/project]? Would you say it played a major, supporting or minor role?

*Revised 4/18/2018

EXAMPLE INTERVIEWER NOTES:

*Revised 4/18/2018

5. Thinking about the wider community of NHTS users (beyond the NHTS program itself and the Office of Policy), are you familiar with any examples in which NHTS data (or the outputs of that data, such as models, reports, etc.) have had an impact on policies, programs, projects, or other decision making decision-making* contexts?

*Revised 4/18/2018

IF YES:

1. Please describe the NHTS data that was used and the nature of the impact.

PROBE:

• What was the policy, program or project that was impacted?
• How did NHTS data inform the policy, program or project?

2. How much impact would you say the NHTS data had on this [policy/rulemaking/program/project]? Would you say it played a major, supporting or minor role?
   
   
3. In addition to transportation, are you familiar with impacts of NHTS data in other fields, such as health, energy, or the environment?

6. [SUSAN, HEATHER] We would like to identify other people who may be familiar with the impacts of NHTS data on decision making. Can you suggest any names? Or agencies? May I have their contact information?
   
   

EXAMPLE INTERVIEWER NOTES:

Now we’d like to ask you about how NHTS solicits and responds to feedback from its user community.

7. First, what type of NHTS user support is available on a regular, ongoing basis?

PROBE: What types of channels are used most often by stakeholders (email, phone, user forum)?

1. How does the NHTS respond to data requests or questions from users, the media, others?
   
   
2. Are user questions/feedback saved, compiled and/or analyzed?

8. Next, can you describe some of the other efforts the NHTS has undertaken to support NHTS users and/or to obtain their input?

PROBE:

• Conferences and workshops
  
  
  • – What type of feedback does the NHTS typically receive at these events?
    
    
• User Forum
  
  
  • – What type of support do NHTS users receive in the Use Forum?
  • – What type of feedback does the NHTS receive from this source?
    
    
• [ADELLA ONLY] Task Force
  
  
  • – What prompted the creation of the NHTS Task Force?
  • – Please describe how NHTS works with the Task Force; what is the nature of this relationship?
    
    
• Are there any other efforts NHTS has undertaken to support its users or to obtain their input?
  
  
9. How has the NHTS made changes to it surveys based on user feedback?

1. How have the findings from the NHTS Task Force (TRB Circular - Exploring New Directions for the National Household Travel Survey) been incorporated into the decision making decision-making* process for the 2015 NHTS?

*Revised 4/18/2018

PROBE:

• What changes are being made to the 2015 NHTS as a result of the Task Force Recommendations?

2. How are decisions made to act on (or not act on) suggestions provide by NHTS Task Force?
   
   
3. In addition to the Task Force, have other feedback mechanisms informed changes to the to the 2015 survey?

10. Has NHTS made changes to its website or the outputs it produces based on feedback from the user community? If yes, please describe.

PROBE:

• Online tools available on NHTS website
• Academy Modules (arose from NHTS Task Force)
• User Guidance documents
• Reports or briefs on current topics of interest
• Other

1. How are decisions made to act on (or not act on) feedback provided by NHTS users?

11. How does NHTS reach out or respond to the needs of its State and MPO partners?
    
    
12. Is there any other information you would like to share about the ways in which -- and the extent to which -- NHTS responds to its user community?

In this last part of the interview, we have a few questions on the challenges or hurdles faced by the NHTS Program.

INTERVIEWER NOTE: SUSAN AND HEATHER ONLY. ADELLA TO BE COVERED AT A SEPARATE TIME.

13. First, are you familiar with any challenges NHTS has faced during the process of planning for the NHTS surveys? For example, these may be organizational or institutional challenges.

PROBE:

• Survey method design and content
  
  
  • – Tailoring sample size to available budget
  • – Designing sample
  • – Selecting administration method, etc.
    
    
• Outreach efforts to potential add-on partners
• Contracting process
• OMB approval process

1. Was NHTS able to overcome these challenges? If yes, How?

14. What challenges has the NHTS faced in administering and overseeing the NHTS surveys?

PROBE:

• Monitoring progress during data collection
• Data cleaning, weighting and preparation

1. Was NHTS able to overcome these challenges? If yes, How?

15. Next we want to turn to the challenges NHTS faces in conducting outreach efforts. First, we'd like to understand what the NHTS objectives or goals are with respect to outreach. Can you please describe NHTS goals and objectives in conducting outreach?
    
    
16. What challenges has NHTS faced in conducting outreach and effectively communicating with NHTS users? (Federal, Add-on, other State/MPO, Private sector, etc.).

1. Was NHTS able to overcome these challenges? If yes, How?

Those are all my questions.

17. Do you have any additional comments or feedback you would like to share regarding the topics we have discussed today?

PROBE: Do you have any final comments on the value of the NHTS Program to decision makers?

Thank you very much! We sincerely appreciate you taking the time to speak with us.

B.2 FHWA Staff Interview Guide

[NOTE: This interview guide will be attached to an email that more fully describes the Evaluation effort. We will send the questions in advance so interviewees have some time to think about their responses. Most of these interviews will be conducted in-person and a couple are likely to be by phone.]

Thank you for taking the time to meet with me today. We’ll be touching on a range of topics related to the NHTS Program. First, we’d like your insights on the ways in which NHTS data are used, and how NHTS data have played a role in different types of decision-making. We will also explore the ways in which the NHTS Program solicits and responds to feedback from its user community. Finally, we want to hear your thoughts on any challenges or hurdles the NHTS Program faces in the planning, oversight and outreach of its survey.

1. To start, how long have you been at FHWA [Office of Policy] and can you tell us a little bit about your role with respect to the NHTS Program?
   
   
2. Can you describe the major ways in which the NHTS Program has evolved during the time you have been involved with the NHTS Program?
   
   
3. Next, can you briefly describe two or three key examples where Office of Policy has used the NHTS data? For the purpose of this interview, we can discuss these examples in detail, and I will follow up with you after the interview to obtain a more complete list of your efforts involving the NHTS.
   
   

[FOR EACH EXAMPLE, ASK:]

1. First, what was the purpose or the main question being addressed?
   
   
2. How did you use the NHTS data to address that question (e.g., incorporate NHTS data into a model, conduct trend analysis, etc.)?
   
   
3. Did you produce a report or some other deliverable that included the NHTS data analysis?

PROBE: Can we get the citation?

4. We are trying to trace how NHTS data and the outputs produced by that data impact decision-making. Do you know whether and how the example you just described has informed any phase of policy-making or rulemaking OR any phase of a program or project (e.g., planning, implementation, modifications)? IF YES – Please explain.

PROBE:

• What [policy, rulemaking, program or project] has your NHTS work informed?
• Do you know how your NHTS work informed the [policy, rulemaking, program or project]?
• Are there other decision- making decision-making* contexts in which your NHTS work has had an impact?

FOR ANY IMPACTS CITED ABOVE:

*Revised 4/18/2018

5. How much impact would you say the NHTS data had on this [policy/rulemaking/program/project]? Would you say it played a major, supporting or minor role?

EXAMPLE INTERVIEWER NOTES:

*Revised 4/18/2018

4. Thinking about the wider community of NHTS users (beyond the Office of Policy), are you familiar with any examples in which NHTS data have had an impact on policies, programs, projects, or other decision making decision-making* contexts?

*Revised 4/18/2018

IF YES:

1. Please describe the NHTS data that was used and the nature of the impact.

PROBE:

• What was the policy, program or project that was impacted?
• How did NHTS data inform the policy, program or project?

2. How much impact would you say the NHTS data had on this [policy/rulemaking/program/project]? Would you say it played a major, supporting or minor role?
   
   
3. In addition to transportation, are you familiar with impacts of NHTS data in other fields, such as health, energy, or the environment?

5. We would like to identify other people who may be familiar with the impacts of NHTS data on decision making. Can you suggest any names? Or agencies? May I have their contact information?

EXAMPLE INTERVIEWER NOTES:

Now we’d like to ask you about how NHTS solicits and responds to feedback from its user community.

6. What efforts has NHTS undertaken to support NHTS users and to obtain feedback from its users?

PROBE:

• Conferences and workshops
• Task Force
• User Forum
  
  
7. Has NHTS made changes to its website or the outputs it produces based on feedback from the user community? If yes, please describe.

PROBE:

• Online tools available on NHTS website
• Academy Modules (arose from NHTS Task Force)
• User Guidance documents
• Reports or briefs on current topics of interest?
• Other?
  
  
8. How does NHTS reach out or respond to the needs of its State and MPO partners?
   
   
9. Is there any other information you would like to share about the ways in which -- and the extent to which -- NHTS solicits and responds to feedback from its user community?

We have a few more questions on challenges or hurdles that NHTS has faced in the planning, administration and outreach for the survey.

10. First, are you familiar with any challenges NHTS has faced during the process of planning for the NHTS surveys? For example, these may be organizational or institutional challenges.

PROBE:

• Survey method design and content
• Outreach efforts to potential add-on partners
• Contracting process
• OMB approval process

1. Was NHTS able to overcome these challenges? If yes, How?

11. What challenges has the NHTS faced in administering and overseeing the NHTS surveys?

PROBE:

• Monitoring progress during data collection
• Data cleaning, weighting and preparation

1. Was NHTS able to overcome these challenges? If yes, How?

12. Next we want to turn to the challenges NHTS faces in conducting outreach efforts. First, we'd like to understand what the NHTS objectives or goals are with respect to outreach. Can you please describe NHTS goals and objectives in conducting outreach?
    
    
13. What challenges has NHTS faced in conducting outreach and effectively communicating with NHTS users? (Federal, Add-on, other State/MPO, Private sector, etc.)

1. Was NHTS able to overcome these challenges? If yes, How?

Those are all my questions.

• 2. Do you have any additional comments or feedback you would like to share regarding the issues we have discussed today?

  PROBE: Do you have any final comments on the value of the NHTS Program to decision makers?

Thank you very much! We sincerely appreciate you taking the time to speak with us.

B.3 Non- DOT Non-DOT* Interview Guide: Non-DOT Agencies (CDC, EIA, HUD, AAA, EPA contacts), Academics and Researchers

*Revised 4/18/2018

[NOTE: This interview guide will be attached to an email that more fully describes the Evaluation effort. We will send the questions in advance so interviewees have some time to think about their responses. Note that most of these interviews will take place over the phone; a couple may be scheduled in person, if possible.]

Thank you for taking the time to meet with me today. We’ll be focusing primarily on the ways in which you have used the NHTS data, and how NHTS data (including outputs of the data, such as models, reports) have played a role in different types of decision making.

1. To start, can you tell us a little bit about the work you do at {INSERT AGENCY} and your research interests?
   
   
2. How long have you been working with NHTS data? Which NHTS products do you typically use?

PROBE:

-Datasets - Which surveys have you worked with? Only the 2009 survey? 2001? Earlier versions?

• User Guidance documents
  
  
  • – Briefs, reports
  • – Online analysis tools
  • – Other?
    
    
3. Can you briefly describe how you have used the NHTS data? If you have used the data in a variety of contexts, please pick 3 or 4 examples, and we can follow up with you after the interview to obtain a more complete list of your efforts.
   
   

   [FOR EACH EXAMPLE, ASK:]

1. First, what was the purpose or the main question being addressed by your work?
   
   
2. How did you use the NHTS data to address that question (e.g., incorporate NHTS data into your model, conduct trend analysis, etc.)?

PROBE:

• Did you use data from a single NHTS, or did you combine information from multiple surveys?

3. Did you produce a report or some other deliverable that included the NHTS data analysis? PROBE: Can we get the citation?
   
   
4. We are trying to trace how NHTS data and the outputs produced by that data impact decision-making. Do you know whether and how the example you just described has informed any phase of policy-making or rulemaking OR any phase of a program or project (e.g., planning, implementation, modifications)? IF YES – Please explain.

PROBE:

• What [policy, rulemaking, program or project] has your NHTS work informed?
• Do you know how your NHTS work informed the [policy, rulemaking, program or project]?
• Are there other decision- making decision-making* contexts in which your NHTS work has had an impact?

*Revised 4/18/2018

FOR ANY IMPACTS CITED ABOVE:

5. How much impact would you say the NHTS data had on this [policy/rulemaking/program/project]? Would you say it played a major, supporting or minor role?

EXAMPLE INTERVIEWER NOTES:

*Revised 4/18/2018

4. Beyond your own work, are you familiar with any examples in which NHTS data (or the outputs of that data, such as models, reports, etc.) have had an impact on policies, programs, projects, or other decision making decision-making* contexts?

*Revised 4/18/2018

IF YES:

1. Please describe the NHTS data that was used and the nature of the impact.

PROBE:

• What was the policy, program or project that was impacted?
• How did NHTS data inform the policy, program or project?

2. How much impact would you say the NHTS data had on this [policy/rulemaking/program/project]? Would you say it played a major, supporting or minor role?

5. We would like to identify other people who may be familiar with the impacts of NHTS data on decision-making. Can you suggest any names? Or agencies? May I have their contact information?

EXAMPLE INTERVIEWER NOTES:

Next, I’d like to ask you a couple of questions about your interactions with NHTS.

6. Do you ever contact the NHTS Program Office with questions about the data, specific data requests or web support issues?

IF YES:

1. How do you typically contact NHTS (email, phone, User Forum)?
   
   
2. How frequently have you done so?
   
   
3. What has your experience been in receiving a response?

PROBE: Did you receive the information you needed? Was your question answered?

7. Have you provided feedback to the NHTS on the survey (including content or methodology), the online tools or other outputs?

1. IF YES: In what ways? Please describe.

PROBE:

• Have you participated in any NHTS Task Force activities?
• Have you attended any NHTS conferences or workshops?

2. Do you feel that the NHTS was open to your comments and suggestions?

8. Do you have any suggestions for how NHTS might facilitate communication with its user community?

Those are all my questions.

9. Do you have any additional comments or feedback you would like to share regarding the issues we have discussed today?

PROBE: Do you have any final comments on the value of the NHTS Program to decision makers?

Thank you very much! We sincerely appreciate you taking the time to speak with us.

B.4 State/MPO/Add-On Partner Interview Guide

[NOTE: This interview guide will be attached to an email that more fully describes the Evaluation effort. We will send the questions in advance so interviewees have some time to think about their responses. Note that all of these interviews will take place by phone.]

Thank you for taking the time to meet with me today. We’d like learn about the ways in which your agency uses the NHTS data and how NHTS data (including outputs of the data, such as models, reports) have played a role in different types of decision making.

1. To start, can you tell us a little bit about your work and your job responsibilities at [INSERT AGENCY]?
   
   
2. How long have you been working with NHTS data?
   
   
3. Are you participating as an add-on partner for the 2015 NHTS survey?

1. Did you participate as an add-on partner in previous NHTS surveys -- in 2001? In 2009?

FOR THOSE WHO PARTICIPATED IN 2001 OR 2009 BUT NOT 2015:

4. Can you tell us why your [State/MPO] is no longer participating as an add-on partner?
   
   
5. Can you briefly describe how your State or region has used the NHTS data? For the purpose of this interview, we can discuss two or three key examples, and I will follow up with you after the interview to obtain a more complete list of your efforts.

[FOR EACH EXAMPLE, ASK:]

1. First, what was the purpose or the main question being addressed?
   
   
2. How did you use the NHTS data to address that question (e.g., incorporate NHTS data into your model, conduct trend analysis, etc.)?

Probe: Did you use only the 2009 data or earlier versions as well?

3. Did you produce a report or some other deliverable that included the NHTS data analysis?

PROBE: Can we get the citation?

4. We are trying to trace how NHTS data and the outputs produced by that data have impacted decision-making. Do you know whether and how the example you just described has informed any phase of policy-making OR any phase of a program or project (e.g., planning, implementation, modifications) in your State or region? IF YES – Please explain.

PROBE:

• What [policy, program or project] has your NHTS work informed?
• Do you know how your NHTS work informed the [policy, program or project]?
• Are there other decision- making decision-making* contexts in which your NHTS work has had an impact?

*Revised 4/18/2018

FOR ANY IMPACTS CITED ABOVE:

5. How much impact would you say the NHTS data had on this [policy/ program/project]? Would you say it played a major, supporting or minor role?
   
   
6. In addition to transportation, are you familiar with impacts of NHTS data in other fields, such as public health, energy, or the environment?

EXAMPLE INTERVIEWER NOTES:

*Revised 4/18/2018

6. We would like to identify other people who may be familiar with the impacts that NHTS data have had on decision making. Can you suggest any names? Or agencies? May I have their contact information?

EXAMPLE INTERVIEWER NOTES:

Next, I’d like to ask you a couple of questions about your interactions with NHTS.

7. Do you ever contact the NHTS Program Office with questions about the data, user guides or with specific data requests?
   
   
8. IF YES: Please describe.

1. How do you typically contact NHTS? (email, phone, User Forum)
   
   
2. How frequently do you/have you interact(ed) with NHTS ?
   
   
3. What has your experience been in receiving a response?

PROBE: Did you receive the information you needed? Was your question answered?

9. Have you provided feedback to the NHTS on the survey (including content or methodology), the online tools or other NHTS outputs?

1. IF YES: In what ways? Please describe.

PROBE:

• Have you participated in any NHTS Task Force activities?
• Have you attended any NHTS conferences or workshops?

2. Do you feel that the NHTS was open to your comments and suggestions?

10. Do you have any suggestions for how NHTS might facilitate communication with its add-on partners?

1. How about to the user community as a whole?

Now we’d like to turn to your experience as an add-on partner.

11. Can you describe any challenges or hurdles you have faced as an NHTS add-on partner?

Probe:

• Becoming an add-on partner
• During the planning phases of the survey (e.g., selecting you add-on sample size, designing the sampling strategy, etc.)
• During the data prep/delivery stage

Those are all my questions.

12. Do you have any additional comments or feedback you would like to share regarding the topics we have discussed today?

PROBE: Do you have any final comments on the value of the NHTS Program to decision makers?

Thank you very much! We sincerely appreciate you taking the time to speak with us.