Skip NavigationDepartment of Transportation Logo  U.S. Department of Transportation Keyword Links | Contact Us | Español

Federal Motor Carrier Safety Administration

Home Rules & Regulations Registration & Licensing Forms Safety & Security Facts & Research About FMCSA
  Home > Safety & Security > Hazardous Materials > Appendix D. Beta Test
back to: Safety & SecuritySafety & Security
Hazardous Materials
HM Topics
Regulations
Permits & Forms
Cargo Tank Safety
Training & Education
Security
Spill Reporting & Prevention
State HM Programs
HM FAQs
Publications
Reports
Brochures
 
  

Appendix D. Beta Test

  Print this page Print    

Introduction

The Beta Test summary provides detailed information on the Beta Test that took place in July of 2003 at Qualcomm Headquarters in San Diego. The purpose of the Beta Test was to test the functionality of each technology individually as well as in concert with one another. In addition, it provided both the Deployment and Evaluation teams with a chance to view the data streams and adjust collection process accordingly. The Beta Test Addendum outlines those configuration changes that were identified during the Beta Test. The Beta Test of the FOT was performed on July 14-18, 2003 and utilized the Qualcomm technology truck and included members of the Deployment Team and the Independent Evaluation Team.

D.1 Objective

There were two primary Beta Test objectives. The first was to ensure that selected test technologies perform adequately in simulated scenario conditions. The second objective was to ensure that generated test data streams fulfilled requirements to allow for thorough Independent Evaluation analysis.

D.2 Process

The Beta Test focused specifically on Scenario 1 - Bulk Fuel, and Scenario 4 - Truckload Explosives. These Scenarios were chosen as they represented the full continuum of FOT technologies and it was recognized that if their functionality met test conditions, it was generally unnecessary to pre-test the other scenarios. For the purpose of the Beta Test, Scenarios 2 and 3 were treated as subsets.

Scenario testing was broken into 3 functional components: (1) system configuration, (2) daily operations/processes, and (3) security breaches. A detailed script was developed for each scenario. The following are Scenario 1 and 4 overviews.

D.2.1 Scenario 1 - Bulk Fuel

  • Scenario Participants: 1A - Dupre Transport LLC; 1B - Cox Petroleum
  • 25 trucks
  • HazMat: Class 3 (Flammable Liquids)
  • Platform: QTRACS/400 and QT Brazil
  • Technologies Tested:
    • Wireless Satellite/Terrestrial Communications
    • In-Dash Panic Button with Notification
    • Global Login
    • OBC with Remote Disabling
    • OBC with Loss of Signal Disabling
    • OmniOne Digital Phone
    • Wireless Panic Button with Local Disabling

D.2.2 Scenario 4 - Truckload Explosives

  • Carrier Participant: 4A - R&R Trucking; 4B - Dyno
  • 25 Trucks
  • Hazmat: Class1.1-1.6 (Explosives)
  • Platform: QTRACS/Web; Saflink Web; QT/Brazil
  • Technologies Tested:
    • Wireless Satellite Communications
    • Dash Panic Button with Notification
    • Wireless Panic Button with Local Disabling and Notification
    • Biometric Verification
    • ESCM
    • OBC with Remote Disabling and Loss of Signal Disabling
    • Geofenced Mapping
    • OBC with Trailer Door Lock System
    • Electronic Cargo Seals
    • Untethered and Tethered Trailer Tracking

Each detailed Scenario script went through a "day in the life of" a driver and their possible route (Figure D-1). The technology truck was equipped with a switch box which allowed all technologies to be connected at once and, based on the scenario, the appropriate switches turned on. The Beta Test was operated from one of the vendor headquarters, so the shipper and consignee roles were simulated using a laptop computer and defining locations such as a rest area as the consignee.

Map showing start and end of Beta Test Route on U.S. Interstate 5 in southern California

Figure D-1. Beta Test Route

Each segment of the detailed test script was tested and its performance documented. Throughout the Beta Test, the teams identified several possible configuration changes. Those will be noted in the Section D.3. Figure D-2 shows a screenshot depicting Global Login in which the driver has logged on/off.

Screen capture of Global Login showing driver event history, such as the driver logging on and logging off, identified by driver ID, event time, vehicle ID, and event description.

Figure D-2. Global Login Data

The last day of the Beta Test, the Deployment and Evaluation Teams went through the data streams generated by the test to ensure that the data would be presented in a digestible format. Category headings were changed and some data fields were deleted.

Using the feedback and performance issues for each of the technologies during the Beta Test, several configuration improvements were identified.

  • The 'OBC with loss of signal disabling' was re-configured to activate throttle disable while vehicle is driving >20 mph.
  • The 'OBC with trailer door lock' was reconfigured to allow a driver 60 seconds from the time the button is pushed to the trailer door automatically re-locking.
  • The Savi software will incorporate an e-mail notification to carriers of seal status changes.
  • Differentiation of color coding for Savi website events was made.
  • Investigation of the placement of the seal on a trailer door in order for the antennae to be read was performed.

A presentation was made to the Hazmat Working Group via WebEx of Beta Test process and the configuration changes. After the changes were agreed on by all, an Addendum to the Detailed Test Plans document was prepared and can be found in the next section.

D.3 Beta Test System Design Addendum

*System design changes are highlighted throughout the table.

Technology Function Pass Fail Revisions Needed
Wireless Satellite Communications (w/ GPS and/or QASPER)Utilizes satellites to link and log all system technologies from vehicle to the communications system.X  
Wireless Terrestrial (w/ GPS and/or Cellular)Utilizes cellular communications to link and log all system technologies from vehicle to the communications system.X  
OmniOne Digital PhoneHost creates and sends a load assignment to driver w/ OmniOne phone.X  
OmniOne Digital PhoneDriver and host exchange five different macros based on situation, i.e., unload/load, departing, stop.X  
Dash Panic Button w/ NotificationDriver depresses the wired panic button and a "panic message" is sent to NMC from mobile unit.X  
Dash Panic Button w/ NotificationNMC forwards "panic message" to carrier.X  
Dash Panic Button w/ Notification"Panic message" is copied to Law Enforcement via QMASS.X  
Dash Panic Button w/ NotificationNMC personnel call to notify carrier of emergency situation. Call received w/ vehicle identification number.X  
Wireless Panic Button w/ Notification Driver depresses red panic button on wireless panic button transmitter.   
Wireless Panic Button w/ Notification Wireless panic button transmitter sends "panic message" signal to mobile unit, which in turn sends message to NMC. Host receives panic message.X  
Wireless Panic Button w/ Notification NMC forwards message to carrier, as well as calls carrier and law enforcement (in some scenarios) with vehicle identification number.X  
Wireless Panic Button w/ Notification Law enforcement account, QT/Web 3.1, is copied with panic messages and positions of truck.X  
Wireless/Local DisablingAttached to wireless panic button w/ notification, although driver disables vehicle by pressing separate Aux button on wireless panic button transmitter.X  
Wireless/Local DisablingWireless panic button transmitter sends a command to disable vehicle; throttle is disabled.X Long Term Consideration: Develop notification for local disabling
Wireless/Local DisablingDriver depresses reset button on wireless panic button transmitter; throttle reverts to normal.X  
Global LoginLogonX  
Global LoginLogoffX  
Global LoginCommunications between NMC and MCT validating driver logon.X  
Global LoginDriver hears audible warning and gets a message prompting him to logon every two minutes. X  
Global LoginDriver starts engine but does not logon. After five minutes of idling a Global Logon security breach is sent to the Carrier.X  
Global LoginDriver starts engine and departs without logging on. After driving one mile a Global Login security breach is sent to the Carrier.X  
Global LoginDriver logs into mobile three times unsuccessfully, and security breach is sent to the Carrier.X  
Global LoginHost dispatcher logs off driver.X  
Biometrics LoginDriver inserts smart card into slot on biometric device; driver places finger on scanner for verification; when verified green LED blinks.X  
Biometrics LoginMessage containing driver's global login user name and password to NMC for verification; NMC sends notification to carrier. Driver ID is displayed next to vehicle name.X  
Biometrics LoginDriver starts engine and does not log on via biometrics. An audible beep is generated after two minutes to prompt driver to logon. After five minutes or one mile driven with no logon, a Global Login security breach is sent to the Carrier. X  
ESCMShipper logs onto ESCM w/ fingerprint and smart card and creates electronic manifest.X  
ESCMAn e-mail is generated to inform the carrier and consignee of manifest ID; carrier notifies driver.X  
ESCMDriver departs for shipper; at shipper, driver logs on to ESCM system and logs on to accept responsibility for specific load/manifest. E-mail notifications sent to carrier and consignee.X  
ESCMDriver departs for consignee; at consignee, he logs on to ESCM system and transfers responsibility of load/manifest to consignee. E-mail notifications sent to carrier, consignee and shipper.X  
OBC w/ Remote Vehicle DisablingCarrier sends an over-the-air message to the OBC disabling the vehicle.X  
OBC w/ Remote Vehicle DisablingVerify that after message is sent, throttle is disabled.X  
OBC w/ Remote Vehicle DisablingCarrier sends over-the-air message to OBC enabling the vehicle.X  
OBC w/ Remote Vehicle DisablingThrottle is enabled.X  
OBC w/ Loss of Signal DisablingOBC monitors the communication system for a loss of signal; recognizes loss of signal.X  
OBC w/ Loss of Signal DisablingOBC identifies loss-of-signal for seven minutes while vehicle is driving >35 mph and activates throttle disable. Host sees Signal Loss Alert.  'OBC with loss of signal disabling' will be re-configured to activate throttle disable while vehicle is driving >20 mph. Seven minute threshold remains the same.
OBC w/ Trailer Door Lock SystemDriver sends an over-the-air message to host requesting trailer door unlocked; host receives "unlock trailer macro."X  
OBC w/ Trailer Door Lock SystemDriver presses trailer door switch in cab and then has 20 seconds to walk back to open the door, or door will default to lock.  OBC w/ trailer door lock system will be re-configured to allow driver 60 seconds from time button is pushed to trailer door opening.
OBC w/ Trailer Door Lock SystemIf door lock is tampered with, an alert is sent to the mobile, which in turn sends an alert event to NMC and then Carrier.X  
Electronic Cargo SealsDriver logs onto the TSS system and uses mobile reader to collect the S/N of the e-seal in range; seals are bolted, and driver notes S/N of e-seal.X  
Electronic Cargo SealsDriver sends an over-the-air command to assign and seal each seal separately.  Extremely time consuming to assign and seal each separately. It may be possible for this to occur all at once. It is also very hard to view information on the handheld.
Electronic Cargo SealsCarrier is able to view sealed locks on website.  Screen has to be constantly refreshed to see updates. New SAVI software will incorporate e-mail notification to carriers.
Electronic Cargo SealsDriver enters mobile reader into surveillance mode for assigned seals.X  
Electronic Cargo SealsWhen a seal is tampered with, an alert is sent to the carrier, and an audible alarm sounds.   Differentiation must be made between red and black type for events logged on the SAVI website.
Electronic Cargo SealsIf a seal becomes undetected, and alert is sent to the carrier and an audible alarm sounds.  Investigation must be made into the placement of seal on door in order for antennae to be read.
Geofenced MappingCarrier initiates a route-based geofence trip on a designated route.X  
Geofenced MappingOnce trip is initiated, 15 minute position requests are made to the unit by the host system.X  
Geofenced MappingCarrier monitors vehicle for positions and is able to view on a route map.X  
Geofenced MappingWhen driver deviates from the designated route over mile, the host system begins requesting positions every five minutes. X  
Geofenced MappingAs driver enters geofenced area, the host system begins requesting positions every 3 minutes.X  
Tethered Trailer TrackingDriver hooks tractor to trailer, tethered trailer unit transmits the tethered trailer track ID over power bus to the mobile unit. Trailer ID displayed on unit.X  
Tethered Trailer TrackingMobile unit sends and over-the-air message to carrier to notify them of connect event. Connect message is displayed on TT/Win.X  
Tethered Trailer TrackingDriver unhooks the tractor in consignees yard, mobile unit detects lack of trailer tracks ID and sends over-the-air disconnect event to carrier.X  
Untethered Trailer TrackingWhen trailer is disconnected the Carrier creates a rectangular geofence around trailer, and GT unit verifies hourly that it has not left that area.X  
Untethered Trailer TrackingIf it is taken from geofenced area an alert is sent to carrier, and position reports can be configured to be sent frequently.X  
QTRACS/400Computer system/server for satellite and terrestrial communications.X  
QTRACS/WebComputer system/server for satellite and terrestrial communications.X  
QTRACS/WinComputer system/server for satellite and terrestrial communications.X  
SAFlink WebComputer system/server for biometrics and ESCM.X  
SAVI WebComputer system/server for electronic cargo seals.X  
QT/BrazilComputer system/server that controls remote vehicle shut down and trailer lock/unlock.X  
GT/WebComputer system/server that monitors untethered trailer status.X  
TT/WinComputer system/server that monitors tethered trailer status.X  


Go To Top of Page