Test and Evaluation of Concealed Weapons Detection Systems. NIJ's 8th Annual Critical Incident Preparedness Conference Atlanta, GA 7 September 2006

Size: px

Start display at page:

Download "Test and Evaluation of Concealed Weapons Detection Systems. NIJ's 8th Annual Critical Incident Preparedness Conference Atlanta, GA 7 September 2006"

Frederick O’Neal’
5 years ago
Views:

1 Test and Evaluation of Concealed Weapons Detection Systems NIJ's 8th Annual Critical Incident Preparedness Conference Atlanta, GA 7 September 2006 Presented by: Peter J. Costianes Air Force Research Laboratory Rome Research Site costianesp@rl.af.mil (315)

2 Briefing Outline 1. Materials used for testing clothing and weapons. 2. Testing and test results conducted on the Trex ST-150. Includes definitions of test parameters, display of results, and traceability to requirements established at the first CWD TWG meeting. 4. Passive MMW imagery from the ST Ratheon AN/PAS13B(V)2 Thermal Imager. 6. Luna Nonlinear Acoustic Concealed Weapons Detection with experimental results. 7. Future system testing. 2

3 Weapons and Accessories Used Type Non-Metal Non-Metal Non-Metal Metal Metal Metal Metal Metal Metal Metal 1 in. x 6 in. PVC Pipe /w caps filled /w latex caulk (Red Cap) 1 in. x 6 in. PVC Pipe /w caps filled /w sand (Black Cap) 1 in. x 6 in. PVC Pipe /w caps empty (White Cap) ½ in. x 6 in. Black Pipe w/ caps - empty 1 in. x 6 in. Galvanized Pipe, no caps filled /w latex caulk, one end sealed with putty 1 in. x 6 in. Galvanized Pipe, no caps filled /w putty throughout 1 in. x 6 in. Galvanized Pipe, no caps empty Fake Hand Gun (blue) Buck knife, 5 in. blade /w sheath Folding knife, 4 in. blade /w sheath Description # Belts Cloth Waist Support Belt Elastic Waist Support Belt Accessories Nylon Hip Pack Backpack Leather Purse Computer Case 3

4 Weapons and Accessories Used 4

5 Clothing Used Plaid Long Sleeve Shirt Heavy Plaid Long Sleeve Shirt Winter Down Coat green Wind Breaker blue Fall Jacket, with liner blue Striped Long Sleeve Dress Shirt - for Wet Clothing Test 5

6 ST150 Passive Millimeter-wave Imager a subsidiary of Trex Enterprises, Inc. Cell Phone Indoor Gun Outdoor Buck Knife 6

7 CWD ST-150 Indoor Setup Test Subject 16 ST-150 Device 7

8 CWD ST-150 Outdoor Setup 8

9 Requirements Established by First CWD TWG Meeting Detect Concealed Weapons on an Individual (Law Enforcement) Priority: High Detect Large Concealed Weapons on an Individual (School Safety) Priority: High Detect Concealed Weapons on an Individual (Executive Security) Priority: High Detect Concealed Weapons and Contraband (Corrections) Priority: Medium Detect Concealed Weapons on an Individual (Transportation Security) Priority: Medium 9

10 Requirement Code Definitions Verification Code I A D T N Verification Code Definition Inspection Analysis Demonstration Test Not Verified Requirement Met Code Yes No Partially Unknown Requirement Met Code Definition Entire requirement was met. Entire requirement was not met. Part of the requirement was met. Not enough information available to determine if requirement can be met. 10

11 Verification Cross Reference Index (VCRI) Code Definitions Inspection (I). Verification by examination of the item, reviewing descriptive documentation, and comparing the appropriate characteristics with a predetermined standard to determine conformance to requirements without the use of special laboratory equipment or procedures. Analysis (A). Verification by technical evaluation using mathematical representations, software code reviews, charts, graphs, circuit diagrams, data reduction, and/or representative data. Demonstration (D). Verification by operation, movement, and/or adjustment of the item under specific conditions to perform the design functions without recording of quantitative data. Test (T). Verification through systematic exercising of the applicable item under appropriate conditions with instrumentation to measure required parameters and the collection/analysis/evaluation of quantitative data to show that measured parameters meet specified requirements. Not Verified (N). Requirement not verifiable. 11

12 CWD Tests Test Name Stationary Test Depth of Field Test Max Range Test Minimum Range Test Camouflage Test Object Resolution Test Test Description This test determines how well the Device Under Test (DUT) detects concealed weapon(s) on a stationary target. The test subject will be positioned at different aspect angles to the DUT. Different stand-off distances will be used, depending on the capability of the DUT. This test determines the extent of the in focus range of the DUT for devices that are designed to operate at a fixed stand-off distance. This test determines, for the DUT, the maximum range at which test object(s) remain in focus on a test subject. This test determines, for the DUT, the minimum range at which test object(s) remain in focus on a test subject. This test determines if the DUT can operate in a covert manner from behind an obstruction such as a tarp or drywall. This test determines, for the DUT, the maximum range(s) at which test object(s), spaced certain distances apart, can be resolved. TREX Sentinel MMW (ST-150) Yes Yes N/A N/A Yes Yes EMI Test This test determines if the operation of the DUT is interfered with by, or causes interference to, the operation of common electronic devices such as microwave oven, cordless telephones, computer WLAN (802.11). Yes 12

13 CWD Tests (Continued) Test Name Wet Clothing Test Device Setup / Power Up Test Portable Power Test Platform Mount Test Motion Test Crowd Test Remote Access Test Test Description This test determines if the ability of the Device Under Test (DUT) to detect concealed weapons under clothing is affected by whether that clothing is wet or dry. This test determines the time it takes to set up and power up the DUT to the point were the DUT is ready to operate. For devices operating on AC power only, this test determines whether the DUT can be run on portable power such as a generator or battery powered AC inverters. If the DUT operates on internal batteries, the length of time the device operates will be recorded. This test determines if the DUT can be mounted to a platform. This test determines the ability of the DUT to detect concealed weapons on moving test subjects. The test subject will traverse a pre-determined route which would be suitable for use at a checkpoint. This test determines the ability of the DUT to scan and observe a crowd of people. For devices where the sensor can be remotely controlled via a data link, this test determines the maximum range from the sensor that the controlling unit can be operated from. TREX Sentinel MMW (ST-150) Yes Yes Yes N/A N/A N/A Yes 13

14 CWD Device Performance Criteria What is it? Criteria Items are Derived from CWD Requirements Criteria Item Values are Obtained for each Device Under Test (DUT) using the Requirements Verification Results Criteria Items Allow All the DUT to be Compared via a Common Nomenclature 14

15 CWD Device Performance Criteria Derivation Example Criteria Number: 1 Device Criteria: Size/Weight Associated Requirements: 2, 18, 47 Requirement 2: Weighs less and is smaller than a standard refrigerator. Requirement 18: Weighs less than 500 pounds and operates on standard 110-volt current. This requirement also associates with Criteria 3a: AC Power Source Requirement 47: Weighs between 5 and 10 pounds, is durable, and meets all applicable military specifications. This requirement also associates with Criteria 31: Equipment Durability 15

16 CWD ST-150 Indoor Hand Gun, Plaid Shirt 16

17 CWD ST-150 Outdoor Hand Gun, Plaid Shirt 17

18 CWD ST-150 Indoor Hand Gun, Winter Down Coat 18

19 CWD ST-150 Outdoor Hand Gun, Winter Down Coat 19

20 CWD ST-150 Indoor 1 x6 PVC Pipe (Red Cap), Heavy Plaid Shirt 20

21 CWD ST-150 Indoor 1 x6 PVC Pipe (Red Cap), Winter Down Coat 21

22 CWD ST-150 Outdoor 1 x6 PVC Pipe (Red Cap), No Outer Clothing 22

23 CWD ST-150 Indoor ½ x6 Black Metal Pipe, Plaid Shirt 23

24 CWD ST-150 Outdoor ½ x6 Black Metal Pipe, Plaid Shirt 24

25 CWD ST-150 Indoor ½ x6 Black Metal Pipe, Winter Down Coat 25

26 CWD ST-150 Outdoor ½ x6 Black Metal Pipe, Winter Down Coat 26

27 CWD Summary TREX ST-150 ST-150 Strengths Minimal training required for set-up and operation Weapons detectable on image Can see small weapons as well as large weapons Sees through most types of clothing Can store images to file ST-150 Weaknesses One standoff distance (~16 ft) Can only use for stationary test subjects Outdoor set-up requires experimentation ST-150 Cost (single unit) - $75,000 27

28 Raytheon AN/PAS-13B(V)2 Infrared Camera System Rail Grabber Adjustment 28

29 Raytheon AN/PAS-13B(V)2 Infrared Camera System Major Components Telescope: Provides magnification of thermal image. Sensor Assembly: Process thermal image for display on the cathode ray tube (CRT). Eyepiece: Displays thermal image and all system indicators on the CRT for the operator. Carrying Case: Soft cloth bag with cleaning kit, two batteries, manual and weapon bracket. Provides straps for soldier to hand carry or strap on back. Transit/Storage Case: Hard case used for transportation and storage. 29

30 Equipment Data Height/Width/Length (inches) 6.25x6.25x15.50 Weight (lbs.) 4.19 Field of View (FOV) 6 x18 deg Telescope magnification (WFOV/NFOV) 1.66X/5.0X Telescope magnification is doubled in zoom mode. Power Consumption --- Battery life 62 0 F) 71% Standby Mode (Hrs) 12 Emergency Mode (Hrs) 6.5 On Mode (watts) 8.1 Standby Mode (watts)

31 CWD PAS 13B Indoor Setup External Monitor & Digital Recorder External Hi Res Camera PAS 13B Distance from PAS 13B to Test Subject Test Subject 31

32 CWD PAS 13B Indoor Hand Gun, Wind Breaker at 100 Ft 32

33 CWD PAS 13B Indoor 1 x6 PVC Pipe (4), Plaid Shirt at 100 Ft 33

34 Concealed Weapons Detection Non-Linear Acoustic Concealed Weapons Detection Luna Innovations Funded by NIJ through AFRL/IF Funded by HSARPA under Phase 1 SBIR Program 34

35 Transmitter and Receiver with test Subject receiver transmitter 35

36 Sample signatures in the Spectrogram: Timefrequency analysis No target Flat plate Tube Gun f1 = 53 khz, f2 = 48 khz f1-f2 = 5-15 khz 36

37 Future System Testing 1. Received delivery of Brijot Passive MMW. 2. Purchase Luna Nonlinear Acoustic Breadboard System. 3. Breadboard/prototype systems in development funded by NIJ and HSARPA as they become available. 37

Overview of New Surveillance Technologies

Overview of New Surveillance Technologies Overview of Stanley E. Borek Air Force Research Laboratory Information Directorate Stanley.Borek@rl.af.mil Background Concealed Weapons Detection (CWD)/Concealed Explosives Detection (CED) Terahertz Imaging