U.S. Department of Transportation
Federal Highway Administration
1200 New Jersey Avenue, SE
Washington, DC 20590
202-366-4000


Skip to content U.S. Department of Transportation/Federal Highway AdministrationU.S. Department of Transportation/Federal Highway Administration

Federal Highway Administration Research and Technology
Coordinating, Developing, and Delivering Highway Transportation Innovations

Overview | Projects | Laboratory Physical Modeling | Laboratory Numerical (CFD) Modeling | Ongoing Laboratory Activities
Hydraulics Laboratory Personnel | Research Publications | Office of Bridge Technology: Hydraulics

 

 

J. Sterling Jones Hydraulics Research Laboratory

 

Hydraulics Laboratory Numerical/CFD Modeling

 

Computational Fluid Dynamics (CFD) Modeling Workspace

The CFD modeling is conducted using THFRC’s high-speed Internet2 connection line to the Transportation Research and Analysis Computing Center (TRACC) cluster at the Argonne National Laboratory (ANL). The user interface is based on the Linux operating system. The CFD code, STARCCM+, is remotely executed at assigned computational nodes on the cluster. The computational results can then be transferred to local computers in the Hydraulics Laboratory for further data analysis.

The image shows the CFD work environment at TFHRC’s J. Sterling Jones Hydraulics Research Laboratory. Large displays and a high-performance desktop computer are shown. The CFD models shown on the screens are conducted over a high-speed Internet connection to the cluster at the Argonne National Laboratory.
One of the CFD workstations at the Federal Highway Administration’s J. Sterling Jones Hydraulics Research Laboratory, located at the Turner-Fairbank Highway Research Center (TFHRC).

 

The picture shows several client computers at the Turner-Fairbank Highway Research Center and other research institutes. These computers are connected via high-speed Internet2 with server cluster computers at the Transportation Research and Analysis Computing Center (TRACC) located at the Argonne National Laboratory.
Client server architecture for CFD modeling in the J. Sterling Jones Hydraulics Research Laboratory.

 

Argonne National Laboratory (ANL) Transportation Research and Analysis Computing Center (https://www.tracc.anl.gov/)

The FHWA’s J. Sterling Jones Hydraulics Research Laboratory's numerical modeling is carried out at the Argonne National Laboratory's (ANL) Transportation Research and Analysis Computing Center (TRACC) through remote access and collaboration. TRACC studies CFD-based simulation techniques in highway hydraulics and erosion/sediment transport applications. Engineers compare these simulations to tests conducted at the hydraulics laboratory to develop and validate design formulation.

The TRACC components consists of Phoenix and Zephyr clusters and include high-performance computing, visualization, and networking systems, with 1024-core (Phoenix) and 2944 (Zephyr), customized system from Dell that comprises 128 compute nodes (Phoenix) and Atipa tech (Zephyr), each with two quad-core AMD 2378 Opteron CPUs and 8 gigabytes of RAM (Phoenix), two 16-core AMD 6273 and 32 gigabytes of RAM (Zephyr), a DataDirect Networks storage system consisting of 180 terabytes of shared RAID storage (Phoenix) and 120 terabytes (Zephyr), and a high-bandwidth, low-latency InfiniBand network for computations. Available software packages include: ANSYS FLUENT, HyperMesh, LS-DYNA®, LS-OPT®, MADYMO, MATLAB, NoMachine, STAR-CD, STAR-CCM+, STAR-Design, and TRANSIMS.

Training on the CFD software is conducted every year. Lectures and tutorial-based drills are offered during the training to onsite and remote participants. TRACC staff works with TFHRC users to identify the most useful topics to include in the training courses.

Zephyr (left) and Phoenix (right) computer clusters are shown in seven black cabinets. The clusters are located at the Argonne National Laboratory (ANL) in Lemont, Illinois.
The photo shows the Zephyr (left) and Phoenix (right) computer clusters at Argonne National Laboratory. Both clusters consist of 3,968 total cores on 220 total compute nodes with 32 cores each, a DataDirect Networks storage system, and a high-bandwidth network.

 

The photo shows an ongoing lecture and practice session. Trainees conduct hands-on practice on individual computers as guided by the instructor.
 Training course on CFD modeling conducted at Argonne National Laboratory. The Argonne National Laboratory provides engineers and students with an advanced training course on CFD simulation. Shown in the photograph is the instructor sitting in the classroom with onsite participants. Remote participants through videoconferencing are not shown in this picture.

 

 

 

Federal Highway Administration | 1200 New Jersey Avenue, SE | Washington, DC 20590 | 202-366-4000
Turner-Fairbank Highway Research Center | 6300 Georgetown Pike | McLean, VA | 22101