February 2007 System Assessment and Validation for Emergency Responders (SAVER) S u m m a r y Small Robot User Assessment irobot PackBot EOD Evaluation Report The U.S. Department of Homeland Security (DHS) established the System Assessment and Validation for Emergency Responders (SAVER) Program to assist emergency responders making procurement decisions. The SAVER Program conducts unbiased operational tests on commercial equipment and systems and provides those results along with other relevant equipment information to the emergency response community in an operationally useful form. SAVER provides information on equipment that falls within the categories listed in the DHS Authorized Equipment List (AEL). The SAVER Program mission includes: Conducting impartial, practitioner relevant, and operationally oriented assessments and validations of emergency responder equipment; Providing information that enables decision makers and responders to better select, procure, use, and maintain emergency responder equipment. Information provided by the SAVER Program will be shared nationally with the responder community, providing a life-saving and cost-saving asset to the U.S. Department of Homeland Security, as well as to federal, state, and local responders. The SAVER Program is established and supported by a network of technical agents who perform assessment and validation activities. Further, SAVER focuses primarily on two main questions for the emergency responder community: What equipment is available? and How does it perform? To contact the SAVER Program Support Office Telephone: 877-347-3371 E-mail: saver.odp@dhs.gov Visit the SAVER website: https://saver.fema.gov The Technical Support Working Group (TSWG) has performed user assessments of the irobot PackBot Explosive Ordnance Disposal (EOD) robot s capabilities and characteristics. The Small Robot User Assessment irobot PackBot EOD Evaluation Report provides a user rating of the irobot PackBot EOD robot s capability to perform specific tasks and user comments on the robot s technical characteristics. Background The TSWG Operational Analysis Team has been tasked by the U.S. Department of Homeland Security to provide expertise and analysis on key emergency response-related subject areas such as the assessment of small bomb-disposal robots. In support of this tasking TSWG has developed a standardized process for a user assessment of small bomb-disposal robots. This process ensures the robots are assessed by the user community against standard tasks, by common technical characteristics, and under operationally and tactically relevant conditions that are typically encountered by the responder community. The primary goal is to provide information that will assist bomb squads across the country in selecting robotic platforms that will meet their needs. In addition, the robotic platform provided to the evaluating organization will be left behind to provide a capability to the participating unit. The end objective is to evaluate a number of small robots (small robot is defined as a platform weighing between 31 and 400 pounds), and post the results on the SAVER website, making it available to all law enforcement and fire department bomb squads. The TSWG Operational Analysis Team developed a methodology that allows the users to rate the performance of the robot against specific mission tasks and comment on the robot s technical characteristics. This report focuses on the robot s ability to perform tasks that might be accomplished during a response to a terrorist incident. Additionally, since the evaluating bomb squad will maintain custody of the robot, they will be required to report maintenance and reliability data for a period of 12 months. This data
will be posted in a supplement to the report at the end of the 12-month period. This report provides a user rating of the irobot PackBot EOD robot s capability to perform specific tasks and user comments on the robot s technical characteristics. Both the ratings and comments are based on the use of a single robot. As with any electro-mechanical device, problems encountered may or may not be indicative of the entire product line. Assessment System Description The PackBot EOD robot (figure 1) is manufactured by irobot of Burlington, Massachusetts. The PackBot EOD robot is one of several small robot systems purchased by the Department of Defense for use in Iraq and Afghanistan. The basic system includes the platform, three (3) battery packs, battery charger kit with two (2) micro chargers, portable command console, manipulator, fiber optic spooler, two-way audio, and transit cases. Additional kits and options can be purchased. For this evaluation the PackBot system was purchased with the following options: Link-2 Dovetail clamp assembly and a Richmond RE70 Disrupter mount assembly. TSWG supplied the evaluating organization with an RE1212 disrupter. Process and Methodology Data was gathered using a combination of surveys and one-on-one interviews with two certified bomb technicians. Forty robotic tasks that are usually performed when responding to an improvised explosive device (IED) located inside a structure or container were executed and rated by each of the bomb technicians on a scale of zero to five with a total possible score of 200. The surveys not only provide an overall rating, but also show the remote control vehicle s (RCV s) strengths and weaknesses in performing various mission tasks. A one-on-one interview was conducted with each participating bomb technician. The interview focused on 39 technical characteristics of the RCV. These characteristics come from the TSWG Common Architecture Document for Robotics. During this phase, the technician is asked to rate each of the RCV characteristics on a scale of one to five. A rating of one indicating the RCV does not have this characteristic and five being the RCV performs the characteristic optimally. This report gives the reviewer a numeric rating of the RCV against IED mission tasks as well as a subjective evaluation of the technical characteristics of the RCV. Operational Scenarios Scenario #1 Confirmed IED (suspect backpack inside of an office) Figure 1. PackBot EOD Robot A small room on the second floor of a two story building (figure 2) was used for the confirmed IED scenario. The suspect backpack (approximately 11 pounds) was inside a closed vanity in the room. To gain 2
access to the building, the RCV had to ascend a small flight of wooden stairs (three stairs) (figure 3) then pivot/turn left on a wooden landing and ascend a second flight of stairs (17 stairs). The RCV then traveled along a walkway/balcony and made a right turn to a doorway (figure 4). After entering the door, the RCV crossed the main room negotiating several obstacles (figure 5) and then passed through a second doorway into the small room. Once inside the office, the operator negotiated the RCV to gain access to the vanity. The bomb technician then had to open the vanity door, remove the suspect backpack, and take it outside of the building. This task was performed three times by each technician, once in the radio frequency (RF) mode without any attachments, once in the RF mode with a disrupter mounted to the manipulator arm, and once in the fiber optic mode with a disrupter attached. Scenario #2 Vehicle-Borne Improvised Explosive Device (VBIED) The parking lot outside of the Arson and Explosive Detail office/facility was the location for the VBIED scenario. The construction of the VBIED included a time power unit (TPU) with a cell phone backup in the front seat and a power cable running to the main charge in the trunk of the vehicle. The main charge consisted of an 18-pound propane tank. An unserviceable vehicle (Chevrolet Figure 2. Confirmed IED Scenario Figure 3. RCV Ascending Stairs Figure 4. RCV Opens Door Figure 5. RCV Negotiating Obstacles 3
Caprice) (figure 6) was provided to support this scenario. Technicians were required to gain access to the vehicle and disable the TPU (figure 7). They then gained access to the trunk (figure 8) and attempted to remove the main charge (figures 9 and 10). Results The results of the PackBot EOD robot s ability to complete tasks performed in support of the operational scenarios are contained in chart 1, located on pages 5 and 6. The rating scale used by the bomb technicians to describe the robot s capability in performing the tasks was zero (robot does not have the capability) and one (very limited capability) through five (perfectly and easily). The results of the PackBot EOD robot s ability to complete tasks performed in support of the operational scenarios in comparison with other robots assessed are located in chart 2, located on page 7. Chart 2 illustrates how the PackBot EOD performed in relation to other small robots that were assessed by TSWG, results of which are available on the SAVER website. The user evaluation of technical characteristics can also be found in chart 2 included in the report. The user comments were acquired while interviewing the bomb technicians on the 39 technical characteristics of the RCV, which Figure 6. Vehicle Provided for Scenario #2 Figure 7. RCV Accessing Vehicle Figure 8. RCV Entering Trunk Figure 9. RCV Attempting to Remove Charge 4
Chart 1. Tasks Performed Results Figure 10. RCV Removing Charge are derived from the TSWG Common Architecture Document for Robotics. The bomb technicians comments regarding the technical characteristics are based upon their experience with the irobot PackBot robot during the evaluation process. Summary The Small Robot User Assessment irobot PackBot EOD Evaluation Report presents a user evaluation of the irobot PackBot EOD remote control vehicle. The results are based on the subjective evaluation of the system by certified bomb technicians. The numeric scoring is based on the robotic systems performance of 40 specific tasks, which were exercised during realistic response scenarios. The user comments are based against 39 technical characteristics taken from the TSWG Common Architecture Document for Robotics. Results of how the PackBot EOD performed in relation to other small robots that were assessed by TSWG are located in chart 2. As with any electro-mechanical device, problems encountered may or may not be indicative of the entire product line. The Los Angeles County Sheriffs Arson and Explosive Detail will be providing logistics information on the robotic system over the 5
Chart 1. Tasks Performed Results (Continued) Note: a During the evaluation of the RCV PackBot, the two-way audio system was inoperable. 6
Chart 2. Small Robot User Evaluation Comparison Note: a During the evaluation of the PackBot RCV the two-way audio system was inoperable, which affected the capability rating. next 12 months. This data will be posted in a supplement to the report at the end of a 12-month period. If your agency is considering purchasing one or more small bomb-disposal robots, this full assessment report and other reports in the series may provide important information that can provide greater mission and agency efficiencies. Documents are available on the SAVER website (https://saver.fema.gov). Reports on other technology being assessed in the SAVER Program can also be found on the website. SAVER Program Support Office Telephone: 877-347-3371 Fax: 443-402-9489 E-mail: saver.odp@dhs.gov website: https://saver.fema.gov SAVER is sponsored by the U.S. Department of Homeland Security, Systems Support Division, Office of Grants and Training. Opinions or points of view expressed in this document are those of the authors and do not necessarily represent the view or official position of the U.S. Government. For more information on the irobot PackBot EOD Robot project, please see the SAVER website or contact the SAVER Program Support Office. 7