U.S. Department of Transportation
Federal Highway Administration
1200 New Jersey Avenue, SE
Washington, DC 20590
Federal Highway Administration Research and Technology
Coordinating, Developing, and Delivering Highway Transportation Innovations
|This report is an archived publication and may contain dated technical, contact, and link information|
Publication Number: FHWA-RD-95-197
Date: December 1996
Development of Human Factors Guidelines for Advanced Traveler Information Systems and Commercial Vehicle Operations: Comparable Systems Analysis
CHAPTER 9. THE SIKORSKY COGNITIVE DECISION–AIDING SYSTEM
GENERAL SYSTEM DESCRIPTION AND OBJECTIVES
The Army's Aviation Advanced Technology Directorate (AATD) sponsors the Rotorcraft Pilot's Associate (RPA) program, which is intended to promote the application of advanced technology to enhance man–machine performance in Army aviation. Their approach has been to emphasize cognitive decision aiding (CDA) across a variety of cockpit tasks and subsystems. One aspect of that program is to develop prototype systems for aiding the pilot in navigation and piloting tasks (flying, navigating, and communicating) during extreme conditions such as nap–of–the–earth (NOE) flight at night in adverse weather. This Day–Night Adverse Weather Pilotage System (D/NAPS) program is a subset of RPA and is intended to enhance mission effectiveness through innovative integration of advanced sensors, computing technologies, and controls and displays.
Sikorsky Aircraft and Texas Instruments were one of two teams of contractors selected by AATD to develop and demonstrate a Cognitive Decision–Aiding System (CDAS) for the D/NAPS program. The CDAS was selected as one of the non–ground transportation systems in the ATIS Comparable Systems Analysis because it shares certain features with future intelligent navigation systems in ground transportation. The CDAS objectives were to aid the pilot in determining appropriate navigation and route selection decisions, to combine conventional and Artificial Intelligence (AI) processing to reason about data received from multiple sources (including the pilot), to use expert systems to formulate recommendations or decision augmentation, and to perform within operational time constraints.
The Sikorsky CDAS focused on mission replanning. After a pilot has established a route, perhaps with the aid of a mission planning system, and has begun to fly the mission, he or she may encounter unanticipated threats or other factors that override the planned route. Replanning is a difficult task for the pilot while fully engaged in flight tasks. Thus, the CDAS provides an expert system to process information about alternate routes while the pilot continues to focus on flying the aircraft at or below treetop level (Casper, 1993). NOE flight involves maintaining minimal clearance over terrain to limit exposure to threats. It requires nearly constant out–the–window attention to maintain clearance over ground and vegetation. Also, the pilot must keep hands on the flight controls for continual adjustment of the flight path. This "eyes out – hands on" requirement, plus communications, navigation, and other cockpit tasks, induce high–workload conditions that make navigation replanning particularly difficult for the hypothetical single–crew situation (Casper, Smith, Smith, and Hubanks, 1991).
Similar difficulties in navigation replanning may be faced by a driver in heavy traffic who has missed a turn and cannot safely consult a paper map to investigate alternate routes. The CDAS also may generate an alternate route when a mission change is promulgated by higher command. Similarly, a Commercial Vehicle Operator (CVO) may receive a priority change in destination from a dispatcher while en route and engaged in heavy traffic.
One objective of the Sikorsky effort was to achieve an intelligent Pilot–Vehicle Interface (PVI). The concept is to combine technological advances in automation and artificial intelligence with human factors engineering to fully integrate the pilot, the cockpit, and the aircraft (Casper et al., 1991). Key elements of the intelligent PVI are seen as pilot command assessment, pilot capability assessment, pilot intent assessment, and cockpit display management. The CDAS included a set of six cooperating expert systems that provided a single pilot with assistance in threat avoidance, navigation, and system failures.
The CDAS demonstration was accomplished on a full–mission simulator, comparing a baseline configuration, representing the RAH–66 Comanche, and the combination of the Comanche and CDAS. The CDAS calculated a route "cost" estimate based on terrain, threat location and lethality, fuel, time, distance, weather, and other information. When triggered by various events, the mission replanner computed alternative routes and presented the least–cost recommended route on the digital map. The recommended alternate route is presented to the pilot by a distinct color on the digital map.
Several CDAS evaluations were conducted in simulation, the results of which are not yet published in the open literature (Casper, 1993). The ATIS functional characteristics that apply to the Sikorsky system are shown in table 8.
The pilot interface to the CDAS was implemented through four displays--the digital map, the Helmet-Mounted Display (HMD) symbology, the Right Multi-Purpose Display (RMPD), and by synthesized speech output. Pilot controls included bezel switches around the digital map screen and a cursor control on the handle of the collective (flight control).
Visual Information Display
Symbology overlayed on the digital map was the primary display of route information. The display included waypoint locations and a path indication between the waypoints. When the CDAS recommended a new route, it was displayed in red to distinguish it from the original route, which was displayed in yellow. The portion of the route already flown was displayed in blue.
Table 8. Comparison of Sikorsky functions with those from ATIS/CVO systems.
In addition, waypoints were shown as symbology on the HMD. They appeared as earth–referenced signs, similar to a stop sign, but with a circular rather than octagonal top, with the waypoint number and distance depicted on the sign. The round portion of the sign for the upcoming waypoint was rendered a constant 2.58 degrees visual angle and the height of the sign pole was proportional to the aircraft altitude. This meant that the sign at the waypoint was always easy to see and appeared to be at the same altitude as the ownship. When a new waypoint was out of the field of view of the HMD by less than 30 degrees, an indication (> or <) was given showing the direction to the next waypoint. If the waypoint was greater than 30 degrees outside of the HMD field of view, the indication appeared as double arrows.
The alternate route information computed by the intelligent software and displayed on the digital map is directly relevant to ATIS/CVO systems. Also, the earth–referenced symbology shown in the HMD has potential application for future ATIS systems capable of displaying symbology on the vehicle windshield as a head–up display (HUD). One major difference, however, is that in the aircraft application, the field of view is wider and the user can slew it by natural head movements. In a ground vehicle, earth–referenced symbology on the windshield would be limited to the windshield field of view. Some ground–vehicle applications could be envisioned, however, where the driver wears a helmet, thus providing an extra safety margin, plus a head–oriented display medium.
When a new route was calculated by the CDAS and presented to the pilot, this fact was indicated by an icon on the RMPD. The icon represented three joined waypoints enclosed in a box. The box was depicted in inverse video when CDAS was calculating a new route. It changed to normal video when the new route was computed and presented.
Adjacent to the new–route icon was an "explanation" icon that gave an indication of the reason for calculating a new route. Examples include Fuel, Off Course, Threat, and Message (referring to receipt of a digital message that redirected the mission or warned of bad weather).
The digital map also had the capability to display other aids to location and navigation, such as grid lines (2 km), three levels of map scale, and coordinates (equivalent to latitude/longitude).
Auditory Information Display
When the system began to calculate a new route, in addition to displaying an icon, a synthesized voice message also was given, such as, "Threat; Planning," followed by "New Plan Ready." Time to compute a new route was around 5 seconds. Speech output also was given to note deviations in either time or course from the planned route.
Other speech output was associated with the baseline Comanche cockpit and included threat information, aircraft health and status information, and cautions and warnings, such as, "Warning, Engine Failure." In the simulator, the speech was produced by a Dec Talk speech synthesis system. Examples of speech output information are location and type of threat and, if lethality appears high, it suggests avoidance maneuvers.
User Input (Controls)
The pilot did not initiate a request for navigation assistance. The pilot did have normal control over the digital map (independent of the CDAS), including zoom in/out and slew (X,Y reposition of map). Other relevant controls included a toggle that either centered the map on the ownship symbol, or froze the map and allowed the ownship symbol to move over the frozen map.
The pilot activated an "Accept" button to acknowledge and accept a new route recommended by the CDAS.
Communication tasks were included as part of the mission in the CDAS simulation demonstration, but were not an integral part of the decision–aiding system.
The objective of the CDAS was to aid pilots in navigation and route replanning under adverse conditions when cognitive task loading is extreme (Casper et al., 1991). Flying at NOE levels at night and in adverse weather is assumed to be a worst–case scenario for pilot workload. It is under such extreme cases of cognitive demand that expert systems for decision aiding can be most beneficial. Under such circumstances, pilots are in a moment–to–moment survival situation and simply do not have spare resources to evaluate multiple sources of information and thoroughly consider alternative navigation solutions. Because this level of demand was difficult to achieve in the simulator, an extra task was given to the pilots, namely, an "authentication" task, essentially requiring mental arithmetic and verbal report.
System Temporal Requirements
The CDAS demonstration required that the system operate in real time with respect to the pilot's tasks and the simulated mission.
DESIGN GUIDELINES USED
Human Factors Design Guidelines
Human factors guidelines, such as MIL-STD 1472D and Boff and Lincoln (1988), were used in the development of the baseline Comanche aircraft that provided the basis for the simulator. However, for the CDAS itself, no human factors guidelines were used directly. A small group of human factors experts played a role in the development and demonstration of the system and were able to make some inputs to the design of the system. For this demonstration, the emphasis was placed on AI software, expert system architectures, and real–time performance, rather than optimizing the pilot interface to the system.
[SK 01] COLOR–CODED ROUTES SUCCESSFULLY DEPICTED RECOMMENDED PATH ON DIGITAL MAP
[SK 02] SPEECH OUTPUT SHOULD BE USED FOR EXCEPTIONS, NOT FOR CONFIRMATION OF ROUTE COMPLIANCE
[SK 03] THE TIME AT WHICH EXPERT SYSTEMS GENERATE NAVIGATION ADVICE CAN BE OF INTEREST TO THE USER
[SK 04] USERS OF NAVIGATION EXPERT SYSTEMS MAY WANT DIAGNOSTIC INFORMATION
[SK 05] DANGEROUS AREAS CAN BE COLOR–CODED ON A DIGITAL MAP
[SK 06] PILOTS PREFERRED TO FLY IN THE HEADING–UP ORIENTATION ON THE DIGITAL MAP
[SK 07] MESSAGE SEMANTICS AND SYNTACTICS IMPORTANT IN SYSTEM DESIGN
[SK 08] NAVIGATION EXPERT SYSTEMS SHOULD ADVISE, BUT NOT ACTIVELY CONTROL WITHOUT USER CONSENT
[SK 09] ACKNOWLEDGEMENT OF ACTIONS TAKEN BY AN EXPERT SYSTEM PROVIDE SYSTEM STATUS INFORMATION TO THE USER
[SK 10] USER–EXPERT SYSTEM INTERFACE DESIGN MUST BE EXPLAINED TO THE USER
[SK 11] TIMELY ASSISTANCE FROM THE EXPERT SYSTEM CAN BE ACHIEVED IF THE SYSTEM "ANTICIPATES" THE USER
[SK 12] INTELLIGENT INTERFACES CAN MAKE MULTIPLE DISPLAY MODE CHANGES TO ACHIEVE A USER'S REQUEST FOR INFORMATION
[SK 13] KNOWLEDGE ACQUISITION IS THE KEY TO EFFECTIVE EXPERT SYSTEM DEVELOPMENT
[SK 14] A USER–VEHICLE INTERFACE FOCUS CONTRIBUTED TO A SUCCESSFUL DECISION–AIDING SYSTEM
[SK 15] HMD's AND HUD's SHOULD BE USED ONLY FOR CRITICAL INFORMATION
[SK 16] NON–INTRUSIVE CURSOR CONTROL FOR IN–VEHICLE NAVIGATION DISPLAYS PROMOTES CONTINUOUS VEHICLE CONTROL
[SK 17] SME's PROVIDE INVALUABLE INFORMATION FOR THE DESIGN OF INTELLIGENT SYSTEMS
[SK 18] SIMULATION WAS A VALUABLE DEVELOPMENT TOOL
[SK 19] SYSTEM PERFORMANCE MEASUREMENT ISSUES ARE IMPORTANT
[SK 20] INTELLIGENT DECISION AIDING IS FEASIBLE
Topics: research, safety
Keywords: research, safety, Advanced Traveler Information Systems (ATIS), Commercial Vehicle Operations (CVO), Intelligent Transportation Systems (ITS), Intelligent Vehicle-Highway Systems (IVHS)