U.S. Department of Transportation
Federal Highway Administration
1200 New Jersey Avenue, SE
Washington, DC 20590
202-366-4000


Skip to content
Facebook iconYouTube iconTwitter iconFlickr iconLinkedInInstagram

Federal Highway Administration Research and Technology
Coordinating, Developing, and Delivering Highway Transportation Innovations

 
REPORT
This report is an archived publication and may contain dated technical, contact, and link information
Back to Publication List        
Publication Number:  FHWA-HRT-13-044    Date:  August 2013
Publication Number: FHWA-HRT-13-044
Date: August 2013

 

Traffic Control Device Conspicuity

MDS Classification of Roadways

If perceptions of the roadway environment are important to the behavioral response to TCDs, then methods of identifying determinants of those perceptions are likewise important. There have been many attempts to accomplish this task and classify our visual environment in a meaningful way.(11,12) The Federal Highway Administration (FHWA) employs a functional-use system with the following classifications: interstates, other freeways, principal arterials, minor arterials, major collectors, minor collectors, and local roads.(13) This system relies on road functionality but ignores other environmental characteristics. For example, arterial roads in urban and rural areas can look vastly different. An arterial in a suburban or rural area may consist of two travel lanes and be surrounded by foliage and minimal signage. An arterial in an urban environment may contain six travel lanes and be surrounded by buildings and ample commercial signage, or with sufficient screening foliage, an urban arterial may look very much like a two-lane rural highway. Functional classes that do not reliably predict roadway appearance may not be a problem if the salient characteristics of roadway class determine driver responses to TCDs. However, alternative classification systems exist, and it is not known which classification systems best predict when drivers will notice and respond to TCDs.

Alternative roadway classification systems may rely on situational components-items that move freely to and from the area (e.g., pedestrians, vehicles). Items in a scene can also be classified as built, permanent components (e.g., grocery stores, trees). Whereas these types of functional use and component classification systems are quite useful in some respects (e.g., the implementation of speed limits, curbing, and sidewalks), they are unable to provide substantial objective information about environmental influences that may be vital to driver performance (e.g., detection of speed limit signs, stop signs, and construction zone warnings). Furthermore, these classifications fail to capture many driver-relevant perceptual differences between environments.

When performing a visual search task (looking for a specific target item among other items), the more non-target items present, the longer it takes to complete the task.(14-16) However, the exact manner for counting items is debatable. For instance, a person could be counted as a single item or as multiple items if shirt, shoes, pants, nose, fingers, etc. are considered separate elements. Further, the number of non-target items (set size) alone does not dictate the amount of time required to look at and identify a specific target object. In many cases the target item "pops out" (e.g., a red line among black lines).(17) People also have a tendency to direct attention toward items of relevance or guide attention to specific task-relevant areas of a visual environment.(18,19) For instance, drivers in countries that drive on the right look for signs on the right side of the road and may miss the same signs when they are placed on the left side of the road.(20)

Drivers tend to look at task-relevant signage. However, in visually complex environments, excessive clutter may increase the time required to identify, interpret, and respond to task-specific stimuli. This delay may lead to unsafe driving behavior.(15) It is easy to imagine that a driver might miss a relevant sign (e.g., lane ending) among a plethora of other signs and heavy traffic. As a result, the driver may be startled by a sudden change in the roadway or behave erratically.

It is obvious that the roadway environment is complex and it can be difficult to determine exactly what visual information degrades driver performance and what does not. It would be beneficial to increase the saliency of environmental components that improve driving performance. A first step toward accomplishing that goal is to better understand which items drivers attend to in a roadway environment. Such information could then be exploited in roadway design by directing drivers' attention to pertinent items and away from the non-essential. This study sought to increase the understanding of drivers' perceptions of the roadway environment and to use this understanding in the interpretation of data from subsequent studies that examined driver eye glance behavior and detection and identification of highway signs. Participants were asked to rate the similarity of various photographs of roadway environments. The analysis of observer perceptions of roadway environments utilized MDS, a somewhat novel methodology for the realm of transportation research.(21)

At the simplest level, MDS is a mathematical technique that recovers the spatial relationships between objects based on the distances between those objects. For example, Kruskal and Wish demonstrated that a map of the location of 10 major U.S. cities could be accurately reconstructed by submitting the distances between all pairs of those cities to an MDS.(22) Other methods exist for accomplishing this task when all paired distances are known and measured without error. MDS becomes useful when measurements cannot be made without error. That is, whereas the spatial distances between cities can be measured with great accuracy, subjective judgments of the similarity of objects, such as pictures of outdoor scenes, may reflect both inter- and intra-individual variability. Furthermore, if it is assumed that people perceive the similarity of objects based on multiple factors and that those factors can be conceived of in spatial relationships, then MDS can be used to tease out the factors that define the space. For instance, Wish asked students to make similarity judgments between pairs of nations constructed from a list of 12 nations. He identified two perceptual dimensions that predicted the spatial relationships extracted from MDS analysis: degree of industrialization (development) and communist/non-communist political orientation.(23) The latter dimension probably reflected the Cold War era during which Wish conducted his study.

MDS analyses might provide valuable clues as to the how drivers perceive roadway environments. When combined with the studies that follow, this type of information has the potential to extend understanding of the interactions between roadway sign placement, lane markings, and roadway geometry with other environmental factors that influence driver performance.

Method

Participants were asked to rate the similarity of roadway scenes. These similarity ratings were then used to infer a mental model of the scenes.

Stimuli

The roadway scenes were panoramic photographs of the environment surrounding the TCDs that served as the stimuli of interest in subsequent studies. The environments around 21 TCDs were photographed from a point 85 ft (26 m) upstream of the target TCD so as to present a driver's view as the TCD was approached. Each panorama consisted of three photographs that were stitched together to form a wide-angle panorama. All three photographs were shot from the right through lane of the roadway. The center photograph approximated a driver's view of the road and centered on the right lane at a point slightly beyond the target TCD. The left and right photographs bracketed the center photograph with approximately 30 percent overlap. From the original set of 21 panoramas, 14 were chosen for the similarity comparisons. The down selection was intended to maintain the widest range of roadway environments while limiting the number of paired comparisons needed.

Procedure

Participants were asked to rate the similarity of 91 unique pairs of the 14 panoramic roadway photographs (see figure 1 through figure 14). They rated the pairs on a scale from 1 (not at all similar) to 10 (very similar). Each panorama was presented on a laptop computer at approximately 960 (width) by 304 (height) pixels. Each panorama was presented as the upper or lower member of a pair an equal number of times.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. Three lanes are visible in the direction of travel shown. On the right side of the roadway there is a sidewalk that directly abuts the roadway. A restaurant is on the right. A fluorescent warning sign can be seen next to newspaper racks on the sidewalk. There is a small median strip separating the three lanes in the direction of travel from the opposing lanes. There is a no U-turn sign in the median. On the left side of the highway, cars can be seen in a parking lot. There are trees in the distance.
Figure 1. Photo. Panorama 1.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. Three lanes are visible in the direction of travel. A grassy median obstructs the view of the opposing lanes. Trees line the roadway on all sides. Thirty-five mi/h signs are in the median and on the right shoulder.
Figure 2. Photo. Panorama 2.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. The view is from the right lane of a four-lane undivided roadway that curves to the right in the distance. Buildings that appear to be four- or five-story apartments are directly ahead and visible above a line of small trees. To the right is a curb and unkempt grass that slopes upward away from the curb. A tractor and white truck are parked on the sloping grass. Telephone cables that stretch across the road originate behind the viewer on the right side of the roadway and cross to the left in the direction of the apartment buildings.
Figure 3. Photo. Panorama 3.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. There is a straight two-lane roadway with on-street parking on both sides of the roadway, although only two parked cars are visible. There are red-brick sidewalks on both sides of the roadway. Red-brick buildings of two or three stories abut the sidewalk. There are decorative street lamps and planters at intervals on the sidewalks on both sides. Directly ahead, in the far distance, an obelisk is aligned with the center lane marking.
Figure 4. Photo. Panorama 4.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. A four-lane undivided roadway curves to the left. The asphalt has many cracks. A sidewalk abuts the roadway on both sides. A driveway on the right provides access to a gas station and garage. On the left side of the road, a parking lot is visible. There is a restaurant at the far end of that lot. A speed limit sign is attached to a power pole that is in the sidewalk on the right side of the roadway.
Figure 5. Photo. Panorama 5.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. A four-lane undivided roadway curves to the left. The asphalt has many cracks. A sidewalk abuts the roadway on both sides. A driveway on the right provides access to a gas station and garage. On the left side of the road, a parking lot is visible. There is a restaurant at the far end of that lot. A speed limit sign is attached to a power pole that is in the sidewalk on the right side of the roadway.
Figure 6. Photo. Panorama 6.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. A straight four-lane divided roadway with an additional left-turn lane is shown. A signalized intersection is ahead. A concrete barrier to the right of the roadway separates the road from a sidewalk that is not visible. There is a metal railing above the concrete barrier. At intervals, there are decorative street lamps on poles attached to the concrete barrier. In the distance, on the right, there is a high-rise apartment building and a large water tank. Trees are visible ahead on the left.
Figure 7. Photo. Panorama 7.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. A two-lane roadway with a double yellow centerline appears to be entering a residential neighborhood. On the right is a sidewalk, which is separated from the roadway by a thin grass strip. Wooden power poles rise from the thin grass strip. A parking lot and commercial building are to the left of the roadway. A speed limit sign is attached to a power pole on the right. In the distance, trees line both sides of the road.
Figure 8. Photo. Panorama 8.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. A four-lane roadway through a commercial area is shown. A wide driveway on the right provides access to a mid-rise concrete and glass building. There is an asphalt sidewalk that is separated from the roadway by a thin grass strip. There are brick buildings on the left side of the roadway. The landscape includes a few small trees on both sides of the road. Power poles are visible on the left side of the road.
Figure 9. Photo. Panorama 9.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. A straight four-lane road appears to curve to the right in the distance. The road is just wide enough for the four lanes and a small brick-lined median. There are sidewalks on either side, which are separated from the road by a thin grass strip. Ahead on the right is a parking lot and older red-brick building. On the left is a larger parking lot and what appears to be a store set back from the road. Power lines are prominent on the left side of the road.
Figure 10. Photo. Panorama 10.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. A straight four-lane undivided road is shown, and there is no shoulder that would allow parking. A sidewalk abuts the curb on the right. A wrought-iron fence abuts the sidewalk. Gravestones are visible through the fence. On the left, the sidewalk has a small grass strip separating it from the curb, and a residence is visible. A pedestrian-crossing warning sign is visible on the left, although there is no marked crosswalk. There are mature trees on both sides of the road.
Figure 11. Photo. Panorama 11.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. Travel lanes abut the curb and leave no room for parking. An unimproved dirt path abuts the curb on the right. A wooden fence, more than 6 ft (2 m) high, is to the right of the dirt path. Trees lean over the fence and shade the road. On the left side of the road, a mowed lawn slopes upward away from the curb. There are a few trees on the lawn. At the top of the lawn is another fence that looks similar to the one on the right.
Figure 12. Photo. Panorama 12.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. A straight four-lane divided road is shown. Travel lanes abut the curb and leave no room for parking. The grassy median has trees at intervals. No sidewalks are visible. A neatly trimmed grass strip, about 3 ft (0.9 m) wide, abuts the curb on the right side. Beyond the grass strip is a row of neatly trimmed bushes. Behind the row of bushes is more grass and a single-story building with what appears to be a metal roof. To the left side of the road are trees and a white painted wall that frames both sides of a driveway. In the distance, trees line both sides of the road. A yellow warning sign is visible ahead on the right side of the road.
Figure 13. Photo. Panorama 13.

This photo shows 1 of 14 roadway panoramas presented to participants in the similarity rating task. A straight four-lane divided highway is shown. The travel-way is concrete, and the shoulder is asphalt. Weeds grow along the curb that abuts the asphalt shoulder. The median has mown grass, but no trees or other plants. Street lights of the type used on freeways and other major roads are on both sides of the highway. There is a yellow warning sign ahead on the right. Trees are visible in the distance, but the nearby areas are covered by either grass or tall weeds.
Figure 14. Photo. Panorama 14.

After rating the similarity of each of the pairs of photographs, participants were asked to rate each of the roadway photographs individually on five different descriptors: (1) built-up, (2) clutter, (3) openness, (4) aesthetically pleasing, and (5) organized/predictable. These ratings were on a 1-10 scale with 1 representing the high end of the scale and 10 representing the low end of the scale (e.g., 1 for "very built-up" and 10 for "not at all built-up"). These descriptors were derived from pilot testing in which colleagues were asked to generate a verbal description of the panoramic photographs. Participants were not provided definitions or examples for the descriptors but were left to interpret the terms on their own.

Participants

Thirteen people (7 males, 6 females) provided similarity ratings. All participants were recruited at a local community center, where they also completed the descriptor ratings. The mean age of participants was 39.8 years (range 24-63). All participants had a valid driver's license. MDS can be performed on similarity rating from as few as one individual. Unless individual differences are of interest, sample sizes in the range used for this study are generally adequate.

Results

Table 1 shows the x, y coordinates of the MDS results for a two-dimensional solution.

Table 1 . MDS coordinates of a two-dimensional solution for the panorama similarity ratings.


Panorama ID

Clutter/Built
Dimension

Predictable
Dimension

1

-1.438

0.457

2

1.712

-0.01

3

0.782

-1.189

4

-0.132

1.872

5

0.147

-1.266

6

-1.11

-1.183

7

-1.475

-0.416

8

-0.869

1.321

9

-0.529

0.014

10

-0.504

-1.121

11

0.37

1.09

12

0.486

0.363

13

1.217

0.863

14

1.342

-0.794

The MDS routine PROXSCAL was used to analyze the similarity ratings.(24) The data were treated as interval scale. (24) An examination of the scree plot suggested a two-dimensional solution (stress = 0.117). The two-dimensional MDS solution is shown in figure 15. The number beside each point in the plot refers to the panorama ID number. The labels on the axes are not MDS outputs; they have been supplied by the authors.

A two-dimensional multidimensional scaling (MDS) plot with orthogonal axes is shown. The abscissa is labeled Clutter/Built and ranges from -2 to 2. The ordinate is labeled Organized/Predictable and ranges from -2.5 to 2.5. The axes cross at 0. The item numbers of the 14 stimuli in the MDS study are arranged according to their scores on the two dimensions. The scores on these dimensions are given in table 1 of the report.
Figure 15 . Graph. MDS solution for 14 panoramas along field study route.

The Pearson product-moment correlation between each of the five descriptor ratings of the panoramas and the MDS dimension scores of the panoramas was computed. As shown in table 2, each of the MDS dimensions correlated significantly with ratings of at least one of the preselected descriptors. The first MDS dimension significantly correlated with three descriptors: built-up (r = 0.56, p < 0.05), clutter (r = 0.75, p < 0.01), and aesthetically pleasing (r = ‑0.66, p < 0.01). The descriptor ratings built-up and clutter strongly positively correlated with one another (r = 0.78, p < 0.01). Thus, those environments with a high degree of manmade or built components were also judged to be cluttered. The first MDS dimension was also negatively correlated with aesthetically pleasing. Aesthetically pleasing was not significantly related to any of the other descriptors. Thus, it appears that dimension 1 may reflect the participants' perception of clutter; however, the possibility that the correlation is coincident with some factor that was not explored cannot be ruled out-MDS is an exploratory technique. If a scene is judged to be high on clutter, it is generally judged to be low with respect to being aesthetically pleasing. The inverse is also true.

The second dimension most closely correlated to the predictability or organization of the environment (r = -0.55, p < 0.05). Items that had high scores on the second MDS coordinate were judged to have low predictability or organization. Ratings of organization and predictability had a significant positive correlation with aesthetically pleasing (r = 0.826, p < 0.01).

Table 2 . Matrix of correlations between each descriptor rating and each MDS dimension.

 

Dimension 2

Built-Up

Clutter

Openness

Aesthetically Pleasing

Organized/
Predictable

Dimension 1

-0.010

0.559*

0.745**

-0.437

-0.664**

-0.472

Dimension 2

 

-0.391

-0.108

0.394

-0.485

-0.554*

Built-Up

 

 

0.779**

-0.756**

-0.128

-0.011

Clutter

 

 

 

-0.691**

-0.457

-0.369

Openness

 

 

 

 

0.074

0.125

Aesthetically Pleasing

 

 

 

 

 

0.826**

*Significant at 0.05.
**Significant at 0.01.

Discussion

This study used MDS to identify environmental factors that observers attended to when comparing roadway scenes. Two dimensions emerged that mapped well to previously suggested roadway environment descriptors. These factors provide insight into the types of characteristics that are salient to roadway users. It appears that participants attended to environmental components that have the potential to affect driving behavior. For example, an organized/predictable environment may allow drivers to better predict where vehicles are likely to turn or pedestrians are likely to cross.

The study utilized a range of roadway scenes that were present along the intended route for a field study of driver behavior. Because of constraints on the selection of TCDs to be included in that field study, the range of variability in the pictured environments may have limited the range of environmental factors that emerged from paired comparison ratings. It is important that subsequent research in this area include a wider variety of roadway environmental factors, such as traffic, nighttime scenes, greater variability in access control, a greater range of roadside advertising, and a greater range of pedestrian and bicycle activity. MDS relies on comparisons of nearly exhaustive pairings between items. As a result, the number of items compared generally needs to be limited to around 15 to avoid overwhelming participants. Nonetheless, MDS may prove to be a robust methodology for identifying aspects of an environment attended to by drivers. As a result, use of MDS in combination with other research tools has the potential to set the foundation for a driver-centric roadway classification system. For signing and marking applications, such an approach may be as or more useful in guiding practitioners than functional classification systems. Future studies may explore other methods of quantifying visual scenes, such as automated image analysis. Such methods combined with driver-centric techniques have the potential to greatly expand our understanding of the interaction between users and roadway environmental factors.

Each of the 14 panoramas used in the MDS analysis included a TCD that was a target for recall in the field study that followed. Each panoramic photograph was taken 85 ft (26 m) upstream of a TCD for which recall was requested after the driver passed the TCD. One question to be addressed in the analysis of the field study data is whether the MDS classifications predict either glances to or recall of the TCDs.