A Comparison of Ship Self Defense Analysis Simulations. Shahrokh Hafizi

Similar documents
Simulation Studies of Naval Warships using the Ship Air Defence Model (SADM)

The Application of Wargaming to Education in Naval Design & Survivability

Huge Power Containers to Drive the Future Railgun at Sea

Our Acquisition Challenges Moving Forward

Expanded Use of the Probability of Raid Annihilation (P RA ) Testbed

Ultra Electronics Integrated Sonar Suite

ARMY RDT&E BUDGET ITEM JUSTIFICATION (R2 Exhibit)

Amendment 0002 Special Notice N SN-0006 Future X-Band Radar (FXR) Industry Day

Leveraging Simulation to Create Better Software Systems in an Agile World. Jason Ard Kristine Davidsen 4/8/2013

The LVCx Framework. The LVCx Framework An Advanced Framework for Live, Virtual and Constructive Experimentation

Combining Air Defense and Missile Defense

59TH ANNUAL FUZE CONFERENCE MAY 3-5, 2016 CHARLESTON, SC Fuzing Challenges for Guided Ammunition

Unmanned Maritime Vehicle (UMV) Test & Evaluation Conference

STK Missile Defense. Introduction: Scenario Storyline:

Electronic Warfare (EW) Principles and Overview p. 1 Electronic Warfare Taxonomy p. 6 Electronic Warfare Definitions and Areas p.

PLEASE JOIN US! Abstracts & Outlines Due: 2 April 2018

ASM(AR) Demonstration Engagements Anti-Ship Missile Active Radar Homing

Capability in Complexity SHOAL-REPORT J590

Integrated Multi-Sensor Testing of EW/Radar Platforms Dr. Bob Andrews

COMPANY RESTRICTED NOT EXPORT CONTROLLED NOT CLASSIFIED Your Name Document number Issue X FIGHTING THE BATTLE. Thomas Kloos, Björn Bengtsson

Application. Design and Installation Variants

UNCLASSIFIED. UNCLASSIFIED R-1 Line Item #13 Page 1 of 11

Update on R&M Engineering Activities: Rebuilding Military Readiness

Comparison of Two Detection Combination Algorithms for Phased Array Radars

RAND S HIGH-RESOLUTION FORCE-ON-FORCE MODELING CAPABILITY 1

RDT&E BUDGET ITEM JUSTIFICATION SHEET (R-2 Exhibit)

Company Profile Amertec Systems is a leading private manufacturer of electronic systems for the defense sector, having more than 20 years of experienc

Quantifying the Effects of Chaff Screening on Hardkill and Softkill Coordination

Introduction Objective and Scope p. 1 Generic Requirements p. 2 Basic Requirements p. 3 Surveillance System p. 3 Content of the Book p.

DEFENSE ACQUISITION UNIVERSITY EMPLOYEE SELF-ASSESSMENT. Outcomes and Enablers

Networked Targeting Technology

UNCLASSIFIED. UNCLASSIFIED Office of Secretary Of Defense Page 1 of 5 R-1 Line #102

AAC/XR: Shaping Tomorrow

ALR-400 RADAR WARNING RECEIVER

Digital Engineering and Engineered Resilient Systems (ERS)

Purpose 4133/ /990224

Multi-Function Fuze Capability Against High Speed Mobile Water Attack Craft

TRINITY Standard configuration for littoral defence

DESIGN AND CAPABILITIES OF AN ENHANCED NAVAL MINE WARFARE SIMULATION FRAMEWORK. Timothy E. Floore George H. Gilman

Closing the Knowledge-Deficit in the Defense Acquisition System: A Case Study

SAAB SEA POWER CAPABILITIES FOR MALAYSIA AND APAC LIMA Robert Hewson Vice President Head of Communications, Saab Asia Pacific

«Integrated Air Defence Systems - Countering Low Observable Airborne Threats»

UNCLASSIFIED R-1 ITEM NOMENCLATURE FY 2013 OCO

AN/ALE-55 Fiber-Optic Towed Decoy ELECTRONIC SYSTEMS

Dr. Barton Halpern Advanced Small Unit Small Arms Technology Concepts Project 15 May 2012

The New DoD Systems Acquisition Process

Michael Gaydar Deputy Director Air Platforms, Systems Engineering

Central T&E Investment Program. Net-centric Weapons Test and Evaluation Environment (NCWTEE)

AEROSPACE TECHNOLOGY CONGRESS 2016

Technology & Manufacturing Readiness RMS

DEFENSE and SECURITY RIGEL ES AND. Defense and security in five continents. indracompany.com

An Assessment of Acquisition Outcomes and Potential Impact of Legislative and Policy Changes

The University of Texas at Austin Institute for Advanced Technology, The University of Texas at Austin - AUSA - February 2006

WSARA Impacts on Early Acquisition

ACOUSTIC RESEARCH FOR PORT PROTECTION AT THE STEVENS MARITIME SECURITY LABORATORY

Free Gyro Imaging IR Sensor In Rolling Airframe Missile Application

Engineered Resilient Systems NDIA Systems Engineering Conference October 29, 2014

Model-Based Design for Sensor Systems

The Swedish Armed Forces Sensor Study

The Army s Future Tactical UAS Technology Demonstrator Program

Track Generation and Management Within ACES

The C2/C4ISR Systems Market

Engineered Resilient Systems DoD Science and Technology Priority

DoDI and WSARA* Impacts on Early Systems Engineering

Digital Engineering (DE) and Computational Research and Engineering Acquisition Tools and Environments (CREATE)

Guided Projectiles Theory of Operation Chris Geswender - Raytheon

Willie D. Caraway III Randy R. McElroy

New Generation Naval Fuze FREMEN Efficiency against New Threats

Decision making in complex systems Workshop Facilitators: Dr Mal Tutty, Dr Keith Joiner, Luke Brown

Pilot Training with the Full Capability of an Integrated LVC Training System

ARCHIVED REPORT. Marine Technology - Archived 7/2005

Mission Solution 300

National Aerospace Initiative

International Armaments Technology Symposium & Exhibition NDIA

RAPID FIELDING A Path for Emerging Concept and Capability Prototyping

Near-field RCS and Fuze Modeling: Assessment and Strategy

Technology Roadmapping. Lesson 3

A New Way to Start Acquisition Programs

WHOLE LIFE WARSHIP CAPABILITY MANAGEMENT

Radio Communications Management Solutions. Advancing Towards New Frontiers

A new Sensor for the detection of low-flying small targets and small boats in a cluttered environment

Tailored Tactical Surveillance

Silent Sentry. Lockheed Martin Mission Systems. Jonathan Baniak Dr. Gregory Baker Ann Marie Cunningham Lorraine Martin.

System of Systems Integration Technology & Experimentation (SoSITE)

TECHNOLOGY COMMONALITY FOR SIMULATION TRAINING OF AIR COMBAT OFFICERS AND NAVAL HELICOPTER CONTROL OFFICERS

USAF Digital Thread Initiative Overview

Applying Multisensor Information Fusion Technology to Develop an UAV Aircraft with Collision Avoidance Model

The EDA SUM Project. Surveillance in an Urban environment using Mobile sensors. 2012, September 13 th - FMV SENSORS SYMPOSIUM 2012

Click to edit Master title style. Joint Service Small Arms Technology Plan

Range Instrumentation Radar Roadmap. Tim Boolos Ira Ekhaus Mike Kurecki BAE Systems Instrumentation Products and Sustainment

Active Towed Array Sonar Outstanding Over-The-Horizon Surveillance

RIGEL RESM SYSTEM NAVAL

Naval Combat Systems Engineering Course

UAV CRAFT CRAFT CUSTOMIZABLE SIMULATOR

Jager UAVs to Locate GPS Interference

vstasker 6 A COMPLETE MULTI-PURPOSE SOFTWARE TO SPEED UP YOUR SIMULATION PROJECT, FROM DESIGN TIME TO DEPLOYMENT REAL-TIME SIMULATION TOOLKIT FEATURES

Wide-Area Motion Imagery for Multi-INT Situational Awareness

Simulation Techniques & Systems for EW Test & Evaluation

SBA Yesterday & Today: Current View of SBA in Advanced Systems Engineering and System-of-Systems Environment. Dr. Judith Dahmann

CRAFT UAV CRAFT CUSTOMIZABLE SIMULATOR

Transcription:

A Comparison of Ship Self Defense Analysis Simulations Tim Jahren Lee Schamp Hank Embleton Mike Kamrowski Shahrokh Hafizi 1

Agenda Study Objectives Overview of Models SSD SADM Evaluation Process Evaluation Results System Life Cycle Utilization Next Steps Summary/Conclusions 2

Study Objectives (1) Compare capability of SADM model with the Raytheon Ship Self Defense (SSD) model Find out what it can do that we currently can t do but would if we could Compare model inputs/outputs/fidelity Establish common scenarios for apples to apples comparison Create test cases that we can directly compare with the same test case run in the Raytheon Ship Self Defense model, to build confidence that we get the results we expect to get Model features Identify missions which each model works best for, and why Identify discriminating features of each model 3

Study Objectives (2) Investigate capability of SADM model for usage in Raytheon Get to know how to set it up, exercise it, understand what it can and can t do for the types of analysis we typically do Document what is immediately useful with the tool Document its naval weapons analysis issues Identify what is required to build new models for use in SADM Identify additional features that are required Build some scenarios with multiple firing platforms and related weapons coordination to understand what capability is there 4

SSD Overview Developed by Raytheon First-order effectiveness model of short range air defense against multiple antiship missiles by a single firing ship Measures of Effectiveness Probability of killing all incoming ASMs Number of Leakers Kill statistics Number of weapons expended Monte Carlo events Probability of kill at intercept ASM launch times and azimuth spacing Sensor detection range User created/modified ship configuration files, threat scenario files, and weapon/sensor database 5

SSD Model Architecture WEAPON PARAMETERS - MAX RGE - MIN RGE - MAX INTERCEPT ALT - GUIDANCE TYPE - ILLUMINATION TIME - LOADOUT - SALVO POLICY - LAUNCH RATE - LAUNCH DELAY - RE-ENGAGE DELAY - RF/IR UNIQUE INPUTS - PK FUNCTION OF RGE - TIME OF FLIGHT - GUN EXPECTED HITS THREAT PARAMETERS - PROFILE - RCS - VELOCITY - ALTITUDE - GUIDANCE TYPE - SAFE KILL RANGE ASM RAID - THREAT TYPE - QUANTITY - START RANGE - START TIME - RAID INTERVAL - AZIMUTH - SHIP TARGETING SSD A/C-LAUNCHED ASM's - NUMBER OF AIRCRAFT - START RANGE - BEARING - ALTITUDE - VELOCITY - RCS - START/END TIMES - NO. OF ASM's CARRIED - ASM TYPE - WPN RELEASE LINE - LAUNCH INTERVAL - SHIP TARGETING GRAPHICAL OUTPUT SENSOR PARAMETERS - MAX ELEVATION ANGLE - DETECT TO TRK DELAY - ANTENNA HEIGHT - KILL ASSESSMENT DELAY - HANDOVER DELAY - DETECTION VS. ALTITUDE & RCS - PROB. FIRM TRACK VS. RANGE SHIP PARAMETERS - WEAPON/SENSOR SUITES - NUMBER OF ILLUMINATORS - ILLUMINATOR TIE-UP TIME - NUMBER OF ESCORTED SHIPS - RANGE - BEARING OUTPUT SUMMARIES - PROBABILITY OF NO LEAKERS - ASMS KILLED BY WEAPON TYPE - AMMO EXPENDED - LEAKERS TO SHIPS - AVG KILL RANGE BY THREAT TYPE - MIN/MAX KILL RANGE - PROB. ALL KILLS BEYOND SAFE RANGE - CONFIDENCE INTERVALS 6

SSD Video Clips 7

SSD Sample Measures of Prob of No Leakers Effectiveness Total Kills Missiles Expended 8 7 6 5 4 3 2 1 Average Kill Range 0 AC1 AC2 AC3 AC4 M1 M2 M3 M4 8

SADM Overview Developed by BAE Systems SADM is a software simulation tool directed at the Maritime Self Defence problem (air and surface threats) Simulates the defence of a task group against other ships, aircraft, ASMs, and background targets Includes littoral effects Consists of detailed models of Platforms (ships, aircraft, land-based weapon sites etc) Sensors (many types of radars, IRST, ESM) Trackers and track management systems Command and control, weapons control systems Weapons (hard kill and soft kill) Anti-ship missiles (seekers, body and electronic environment) Environment (atmosphere, terrain, propagation) Interactions between subsystems BAE Systems Australia Limited 9

SADM Model Architecture Composed of interacting objects Environment, propagation, and signature models Sensors Trackers, track management, data fusion, and hostility classification models C2/WCS system(s) Hard-Kill Weapons Soft-Kill Weapons This architecture is Useful to the user (add-ins) Useful for code maintenance BAE Systems Australia Limited 10

SADM Video Clip 11

Evaluation Process Identify Core Capabilities Develop Baseline Scenarios Run Scenarios in each Model Identify Differences and Evaluate Evaluate Unique Features/ Interoperability Missile Type Active Active Active Active HAW HAW HAW HAW SATH SATH SATH SATH Scenario Description ASM Type 1 and 2 Subsonic; ASMs; P k =1 300 m/sec inbound Supersonic; ASMs; P k =1 800 m/sec inbound Subsonic; ASMs; P k =0 300 m/sec inbound Supersonic; ASMs; P k =0 800 m/sec inbound Subsonic; ASMs; P k =1 300 m/sec inbound Supersonic; ASMs; P k =1 800 m/sec inbound Subsonic; ASMs; P k =1 300 m/sec inbound Supersonic; ASMs; P k =1 800 m/sec inbound Subsonic; ASMs; P k =1 300 m/sec inbound Supersonic; ASMs; P k =1 800 m/sec inbound Subsonic; ASMs; P k =1 300 m/sec inbound Supersonic; ASMs; P k =1 800 m/sec Start Firing Ranges Doctrines 8 nmi; 20 nmi SLS, SSLSS 8 12 nmi; 20 nmi 8 nmi; 20 nmi 12 nmi; 20 nmi # Runs SLS, SLSS, SSLSS 12 SLS, SLSS, SSLSS 12 SLS, SLSS, SSLSS 12 8 nmi; 20 nmi SLS, SSLSS 8 12 nmi; 20 nmi SLS, SSLSS 8 8 nmi; 20 nmi SLS, SSLSS 8 12 nmi; 20 nmi SLS, SSLSS 8 8 nmi; 20 nmi SLS, SSLSS 8 12 nmi; 20 nmi SLS, SSLSS 8 8 nmi; 20 nmi SLS, SSLSS 8 12 nmi; 20 nmi SLS, SSLSS 8 Update Model(s) 12

Subsonic Threat Performance Active Missiles Results showed excellent agreement for subsonic threats with active missiles. Generally, times for intercept are within 2 seconds and intercept ranges are within 0.2 nautical mile. Some of the initial detection ranges were a little further out for SSD, but that difference can be attributed to the fact that SSD assumes perfect radar detection and SADM models actual radar performance. Test # 1 2 3 4 5 6 7 8 Blue Ship Ship Ship Search Radar Firing Doctrine ASMs Notes R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) SLS 1 SBS @ 20 nm Set PK = 1 14.8 31.0 12.8 43.0 7.8 HIT 73.0 16.3 22.3 13.0 41.7 8.0 HIT 71.7 SLS 1 SBS @ 8 nm Set PK = 1 7.9 1.0 6.3 11.0 4.0 HIT 24.5 8.0 0.1 6.3 10.1 4.2 HIT 22.7 SSLSS 1 SBS @ 20 nm SSLSS SLS SLS SSLSS SSLSS Threats 1 SBS @ 8 nm 2 SBS @ 20 nm; 1 second apart 2 SBS @ 8 nm; 1 second apart 2 SBS @ 20 nm; 1 second apart 2 SBS @ 8 nm; 1 second apart Set Pk = 1. 14.8 31.0 12.8 43.0 7.8 HIT 73.0 16.3 22.3 13.0 41.7 8.0 HIT 71.7 SAM2 12.4 45.0 Overkill 43.7 Overkill Set Pk = 1. 7.9 1.0 6.3 11.0 4.0 HIT 24.5 8.0 0.1 6.3 10.1 4.2 HIT 22.7 SAM2 5.9 13.0 Overkill 12.1 Overkill Set Pk = 1. ASM1/SAM2 15.0 30.0 12.7 43.5 7.8 HIT 73.3 16.3 22.3 13.0 41.7 8.0 HIT 71.7 ASM2/ 15.0 30.0 12.6 45.5 7.7 HIT 74.8 16.3 23.3 12.8 43.7 7.9 HIT 73.2 Set Pk = 1. ASM1/ 7.9 1.0 6.3 11.0 4.0 HIT 24.5 8.0 0.1 6.3 10.1 4.2 HIT 22.7 ASM2/ 8.1 1.0 6.1 13.0 3.9 HIT 26.2 8.0 1 6.1 12.1 4.1 HIT 24.3 Set Pk = 1. ASM1/ 14.8 31.0 13.0 42.5 7.8 HIT 73.0 16.3 22.3 13.0 41.7 8.0 HIT 71.7 ASM1/SAM2 12.6 44.5 Overkill 43.7 Overkill 73.7 ASM2/ 15.0 31.0 12.4 46.5 7.6 HIT 75.3 16.3 23.3 12.5 45.7 7.7 HIT 74.3 ASM2/SAM2 12.0 48.5 Overkill 47.7 Overkill Set Pk = 1. ASM1/ SADM Data SSD Data Initial Detect Launch Intercept Initial Detect Launch Intercept 7.9 1.0 6.3 11.0 4.0 HIT 24.5 8.0 0.1 6.3 10.1 4.2 HIT 22.7 ASM1/SAM2 5.9 13.0 Overkill 12.1 Overkill 24.6 ASM2/ 8.1 1.0 5.7 15.0 3.7 HIT 27.6 8.0 1 5.8 14.1 3.8 HIT 25.8 ASM2/SAM2 5.4 17.0 Overkill 16.1 Overkill 13

Supersonic Threat Performance Test # Blue Ship Ship Ship Search Radar Firing Doctrine Threats ASMs Notes Active Missiles SADM Data SSD Data Initial Detect Launch Intercept Initial Detect Launch Intercept R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) 9 10 11 12 13 14 SLS 1 SSS @ 20 nm Set Pk = 1. 19.1 2.0 14.0 14.0 5.7 HIT 33.0 19.1 2.1 14.7 12.1 6.1 HIT 32.0 SLS 1 SSS @ 12 nm Set PK = 1 11.4 1.0 7.1 11.0 2.7 HIT 21.3 11.9 0.1 7.6 10.1 3.1 HIT 20.4 SLSS 1 SSS @ 20 nm SLSS 1 SSS @ 12 nm SSLSS 1 SSS @ 20 nm SSLSS 1 SSS @ 12 nm Set Pk = 1. 19.1 2.0 14.4 13.0 5.8 HIT 33.0 19.1 2.1 14.7 12.1 6.1 HIT 32.0 SAM2 14.1 Overkill Set Pk = 1. 11.4 1.0 7.1 11.0 2.7 HIT 21.3 11.9 0.1 7.6 10.1 3.1 HIT 20.4 SAM2 12.1 Overkill Set Pk = 1. 18.7 3.0 14.4 13.0 5.8 HIT 33.0 19.1 2.1 14.7 12.1 6.1 HIT 32.0 SAM2 13.5 15.0 Overkill 14.1 Overkill Set Pk = 1. 11.4 1.0 7.1 11.0 2.7 HIT 21.3 11.9 0.1 7.6 10.1 3.1 HIT 20.4 SAM2 6.3 13.0 Overkill 12.1 Overkill Results showed excellent agreement for supersonic threats Generally, times for intercept are within 2 seconds and intercept ranges are within 0.5 nautical miles. 14

Subsonic Threat Performance Active Missiles, Pk=0 In this case, the probability of kill (P k ) was set to 0 to compare engagement ranges and timelines, with a special focus on quantifying the depth of fire and reengagement timelines in both models Initial results found significant differences in each model s reengagement timelines; with additional analysis of the parameters used to model engagement timelines in both models, we were able to reconfigure each model to produce similar results. Generally, times for intercept are within 2 seconds and intercept ranges are within 0.2 nautical mile. Test # 21 22 23 24 25 26 Blue Ship Ship Ship Search Radar Firing Doctrine ASMs SLS 1 SBS @ 20 nm SLS 1 SBS @ 8 nm SLSS 1 SBS @ 20 nm SLSS 1 SBS @ 8 nm SSLSS 1 SBS @ 20 nm SSLSS Threats 1 SBS @ 8 nm Notes SADM Data SSD Data Initial Detect Launch Intercept Initial Detect Launch Intercept R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) Set Pk = 0. 15.0 30.0 13.1 41.5 7.9 MISS 72.3 16.3 22.3 13.0 41.7 8.0 MISS 71.7 SAM2 6.7 80.0 4.3 MISS 94.3 6.6 79.8 4.4 MISS 93.1 SAM3 3.0 102.0 1.7 MISS 110.1 3.1 101.2 1.9 MISS 108.4 Set Pk = 0. 7.9 1.0 6.3 11.0 4.0 MISS 24.5 8.0 0.1 6.3 10.1 4.2 MISS 22.7 SAM2 2.8 32.0 1.5 MISS 39.8 2.8 30.7 1.7 MISS 37.6 Set Pk = 0. 16.2 23.0 13.0 42.0 7.9 MISS 72.6 16.3 22.3 13.0 41.7 8.0 MISS 71.7 SAM2 6.7 80.0 4.3 MISS 94.3 6.3 81.8 4.2 MISS 94.4 SAM3 6.3 82.0 4.1 MISS 95.7 2.5 104.5 1.4 MISS 110.9 SAM4 2.8 103.0 1.5 MISS 110.9 106.5 1.2 MISS 112.4 SAM5 2.5 105.0 1.3 MISS 112.4 Set Pk = 0. 7.9 1.0 6.3 11.0 4.0 MISS 24.5 8.0 0.1 6.3 10.1 4.2 MISS 22.7 SAM2 2.8 32.0 1.5 MISS 39.8 2.5 32.7 1.4 MISS 39.1 SAM3 2.4 34.0 1.2 MISS 41.3 34.7 1.2 MISS 40.6 Set Pk = 0. 16.2 23.0 12.8 43.0 7.8 MISS 73.0 16.3 22.3 13.0 41.7 8.0 MISS 71.7 SAM2 12.5 45.0 7.7 MISS 74.1 43.7 7.8 MISS 72.8 SAM3 6.3 82.0 4.1 MISS 95.7 6.5 80.9 4.3 MISS 93.8 SAM4 6.0 84.0 3.8 MISS 97.1 82.9 4.1 MISS 95.2 SAM5 2.5 105.0 1.3 MISS 112.4 2.7 103.3 1.6 MISS 110.0 SAM6 2.2 107.0 1.0 MISS 113.8 105.3 1.3 MISS 111.5 Set Pk = 0. 7.9 1.0 6.3 11.0 4.0 MISS 24.5 8.0 0.1 6.3 10.1 4.2 MISS 22.7 SAM2 5.9 13.0 3.8 MISS 25.9 12.1 4.0 MISS 24.0 SAM3 2.6 33.0 1.4 MISS 40.5 2.6 32 1.5 MISS 38.6 SAM4 2.3 35.0 1.1 MISS 42.0 34 1.3 MISS 40.1 15

Supersonic Threat Performance Active Missiles, Pk=0 Both models were able to generate results with good agreement after some reconfiguration of their reengagement parameters. Generally, times for intercept were within 2 seconds and intercept ranges within 0.5 nautical mile. The biggest finding in this set of data was that SADM had a different SLSS firing policy than SSD. SADM would shoot one shot the first engagement, and 2 shots for subsequent engagements. The SSD model employed an adaptive algorithm which would shoot 2 shots on the first round if it was the only engagement opportunity. Test # 39 40 41 42 43 44 Blue Ship Ship Ship Search Radar Firing Doctrine SLS SLS SLSS SLSS SSLSS SSLSS Threats ASMs Notes SADM Data SSD Data Initial Detect Launch Intercept Initial Detect Launch Intercept R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) 2 SSS @ 20 nm; Set Pk = 0. 1 second apart ASM1/ 18.7 3.0 14.4 13.0 5.8 MISS 32.9 19.1 2.1 14.7 12.1 6.1 HIT 32.0 ASM1/SAM2 2.8 40.0 0.4 MISS 45.5 ASM2/ 19.6 2.0 13.9 15.0 5.7 MISS 34.2 19.1 3.1 14.3 14.1 6.0 HIT 33.3 ASM2/SAM2 2 SSS @ 12 nm; Set Pk = 0. 1 second apart ASM1 11.5 1.0 6.3 13.0 2.3 MISS 22.4 11.9 0.1 7.6 10.1 3.1 MISS 20.4 ASM2 11.9 1.1 7.6 11.0 2.9 MISS 21.9 12.0 1 7.2 12.1 2.9 MISS 21.9 2 SSS @ 20 nm; Set Pk = 0. 1 second apart ASM1/ 18.7 3.0 14.4 13.0 5.8 MISS 32.9 19.1 2.1 14.7 12.1 6.1 MISS 32.0 ASM1/SAM2 2.8 40.0 0.4 MISS 45.5 14.1 5.9 MISS 32.6 ASM2/ 19.1 3.0 13.9 15.0 5.7 MISS 34.2 19.1 3.1 13.4 16.1 5.7 MISS 34.0 ASM2/SAM2 18.1 5.4 MISS 34.7 2 SSS @ 12 nm; Set Pk = 0. 1 second apart ASM1/ 11.5 1.0 6.3 13.0 2.3 MISS 22.4 11.9 0.1 7.6 10.1 3.1 MISS 20.4 ASM1/SAM3 12.1 2.7 MISS 21.4 ASM2/ 11.9 1.1 7.6 11.0 2.9 MISS 21.8 12.0 1 6.3 14.1 2.5 MISS 22.9 ASM2/SAM2 16.1 2.1 MISS 23.8 2 SSS @ 20 nm; Set Pk = 0. 1 second apart ASM1/ 18.7 3.0 12.7 17.0 5.2 MISS 34.3 19.1 2.1 14.7 12.1 6.1 MISS 32.0 ASM1/SAM2 11.8 19.0 4.8 MISS 35.2 14.1 5.9 MISS 32.6 ASM2/ 19.1 3.0 14.8 13.0 6.0 MISS 33.5 19.1 3.1 13.4 16.1 5.7 MISS 34.0 ASM2/SAM2 13.9 15.0 5.7 MISS 34.2 18.1 5.4 MISS 34.7 2 SSS @ 12 nm; Set Pk = 0. 1 second apart ASM1/ 11.5 1.0 5.4 15.0 1.8 MISS 23.4 11.9 0.1 7.6 10.1 3.1 MISS 20.4 ASM1/SAM2 4.6 17.0 1.3 MISS 24.5 12.1 2.7 MISS 21.4 ASM2/ 11.9 1.1 7.6 11.0 2.9 MISS 21.9 12.0 1 6.3 14.1 2.5 MISS 22.9 ASM2/SAM2 6.7 13.0 2.5 MISS 22.8 16.1 2.1 MISS 23.8 16

Threat Performance Home All the Way Missiles, SLS Firing Doctrine Test # Blue Ship Ship Ship Search Radar Firing Doctrine Threats ASMs Notes SADM Data SSD Data Initial Detect Launch Intercept Initial Detect Launch Intercept R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) 45 Default_Radar SLS 1 SBS @ 20 nm 12.5 44.8 9.5 63.1 6.1 HIT 83.4 12.5 44.8 10.8 54.9 6.8 HIT 78.6 46 Default_Radar SLS 1 SBS @ 8 nm 7.9 1.5 6.1 12.0 3.9 HIT 25.2 8.0 0.1 6.3 10.1 4.2 HIT 22.7 47 Default_Radar SLS 2 SBS @ 20 nm; 1 second apart ASM1/ 12.3 47.2 4.6 93.8 2.8 HIT 104.4 12.5 44.8 10.8 54.9 6.8 HIT 78.6 Default_Radar ASM2/ 12.0 45.7 9.8 58.9 6.3 HIT 80.1 12.5 45.8 5.0 90.6 3.2 HIT 101.1 48 Default_Radar SLS 2 SBS @ 8 nm; 1 second apart ASM1/ 7.9 1.0 6.1 12.0 3.9 HIT 25.2 8.0 0.1 6.3 10.1 4.2 HIT 22.7 Default_Radar ASM2/ 8.1 1.0 1.9 38.0 0.9 HIT 44.5 8.0 1 2.3 34.7 1.3 HIT 40.9 49 Default_Radar SLS 1 SSS @ 20 nm 16.1 8.9 10.8 21.4 4.4 HIT 36.2 16.0 9.2 11.7 19.2 5.1 HIT 34.5 50 Default_Radar SLS 1 SSS @ 12 nm 11.8 0.2 7.1 11.1 2.7 HIT 21.4 11.9 0.1 7.6 10.1 3.1 HIT 20.4 51 Default_Radar SLS 2 SSS @ 20 nm; 1 second apart ASM1/ 16.0 9.2 11.4 20.0 4.7 HIT 35.6 16.0 9.2 11.7 19.2 5.1 HIT 34.5 ASM2/ 15.1 12.2 No launch - HIT SHIP 16.0 10.2 No launch - HIT SHIP 52 Default_Radar SLS 2 SSS @ 12 nm; 1 second apart ASM1/ 11.6 0.8 6.4 12.8 2.3 HIT 22.2 11.9 0.1 7.6 10.1 3.1 HIT 20.4 ASM2/ 11.3 2.3 No launch - HIT SHIP 12.0 1 No launch - HIT SHIP Results for subsonic and supersonic cruise missiles engaging the ship, ship employs Home All the Way (HAW) missiles using a Shoot-Look-Shoot (SLS) firing doctrine. Both models were able to generate results with quite good agreement. Generally, times for intercept are within 2 seconds and intercept ranges are within 0.2 nautical miles for subsonic threats and 0.5 nautical mile for supersonic threats. Similarly, we had good agreement while employing a SSLSS firing doctrine as well. 17

Threat Performance Semi-Active Terminal Homing Missiles, SSLSS Firing Results for cruise missiles engaging the ship, ship employs missiles with semiactive terminal homing (SATH) capability using a Shoot-Shoot- Look-Shoot-Shoot (SSLSS) firing doctrine. Both models were able to generate results with quite good agreement. Generally, times for intercept are within 2 seconds and intercept ranges are within 0.2 nautical miles for subsonic threats and 0.5 nautical mile for supersonic threats. Similarly, the SATH results for cruise missile threats employing a SLS firing doctrine also showed good agreement. Test # Search Radar Doctrine Blue Ship Ship Ship Firing Doctrine ASMs Notes R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) R (nm) T (s) R (nm) T (s) R (nm) H/M? T (s) 69 Default_Radar SSLSS 1 SBS @ 20 nm ASM1/ 12.4 45.7 10.5 57.0 6.6 HIT 80.3 12.5 44.8 10.8 54.9 6.8 HIT 78.6 Default_Radar ASM1/SAM2 10.2 59.0 Overkill 56.9 Overkill 70 Default_Radar SSLSS 1 SBS @ 8 nm ASM1/ 8.0 0.4 6.3 11.0 4.0 HIT 24.5 8.0 0.1 6.3 10.1 4.2 HIT 22.7 Default_Radar ASM1/SAM2 5.9 13.0 Overkill 12.1 Overkill 71 Default_Radar SSLSS 72 Default_Radar SSLSS 2 SBS @ 20 nm; 1 second apart 2 SBS @ 8 nm; 1 second apart ASM1/ 12.2 46.6 9.3 64.0 6.0 HIT 84.2 12.5 44.8 10.8 54.9 6.8 HIT 78.6 ASM1/SAM2 9.0 66.0 Overkill 56.9 Overkill 80.5 ASM2/ 12.6 45.1 4.3 95.0 2.7 HIT 105.2 12.5 45.8 6.5 81.7 4.3 HIT 94.7 ASM2/SAM2 4.0 97.0 Overkill 83.7 Overkill ASM1/ 7.9 1.3 6.1 12.0 3.9 HIT 25.2 8.0 0.1 6.3 10.1 4.2 HIT 22.7 ASM1/SAM2 5.8 14.0 Overkill 12.1 Overkill 24.6 ASM2/ 8.0 1.3 2.2 36.5 1.0 HIT 43.3 8.0 1 2.9 31.1 1.8 HIT 38.2 ASM2/SAM2 1.9 38.5 Overkill 33.1 Overkill 73 Default_Radar SSLSS 1 SSS @ 20 nm ASM1/ 15.9 9.5 11.4 20.0 4.7 HIT 35.6 16.0 9.2 11.7 19.2 5.1 HIT 34.5 ASM1/SAM2 10.5 22.0 Overkill 21.2 Overkill 74 Default_Radar SSLSS 1 SSS @ 12 nm ASM1/ 11.4 1.1 6.7 12.0 2.5 HIT 21.8 11.9 0.1 7.6 10.1 3.1 HIT 20.4 75 Default_Radar SSLSS 76 Default_Radar SSLSS Threats 2 SSS @ 20 nm; 1 second apart SADM Data SSD Data Initial Detect Launch Intercept Initial Detect Launch Intercept ASM1/SAM2 5.9 14.0 Overkill 12.1 Overkill ASM1/ 15.6 10.3 No launch - HIT SHIP 16.0 9.2 11.7 19.2 5.1 HIT 34.5 ASM1/SAM2 21.2 Overkil 36.4 ASM2/ 16.0 10.3 10.5 23.0 4.3 37.5 16.0 10.2 No launch - HIT SHIP ASM2/SAM2 9.6 25.0 Overkill 2 SSS @ 12 nm; 1 second apart ASM1/ 11.3 1.4 No launch - HIT SHIP 11.9 0.1 7.6 10.1 3.1 HIT 20.4 ASM1/SAM2 12.1 Overkil 22.3 ASM2/ 11.7 1.4 7.1 12.0 2.7 HIT 22.4 12.0 1 No launch - HIT SHIP ASM2/SAM2 6.3 14.0 Overkill 18

SSD/SADM Comparison Criteria SSD SADM Ease of use Execution Speed Modeling approach Sensor models Weapon models Target audience Easy to set up and use low learning curve. Easy to set up exact conditions (detect, launch, intercept, etc.) you wish to study. Runs fast and provides many Monte Carlo runs to analyze in minutes. Uses look up tables to characterize most performance. Validity depends on source of data; excellent if from high fidelity sims. Sensor models are very basic, providing low fidelity. Analyst will use sensor as black box using SSD. Models exist for a large variety of weapons, and model can be readily adapted for new weapon models using look up tables. Provides results tuned to missile analyst s needs. Significant learning curve for new users. Large set of default values available, but analyst must validate them for his study. Requires many more inputs to run a scenario Runs fairly quickly, though it can take hours to complete large numbers of Monte Carlo runs. Uses physics based models more than look up tables (models sensor detections / flies missile at physics level). Sensor models are medium fidelity, allowing an analyst to configure a realistic sensor model for their study with a sensor as key component. Medium fidelity physics based models. No capability to model dual mode missiles like RAM or future ESSM Block 2 today, though in development. Provide results tuned to ship system designer s needs with enhanced trade-offs for sensors, weapons, and threats available. Utilized in Navy for hard kill / soft kill interaction analysis. Fidelity Differences between Models Drive Data Requirements and Learning Curve 19

Model(s) Life Cycle View DoD 5000 Lifecycle Phase Goals SSD Data Produced SADM Data Produced Material Solution Analysis Assess potential materiel solutions, Develop ICD, Conduct AoA Ship Self Defense combat survivability data for projected ship systems and threats. Ship Self Defense combat survivability data for projected ship systems and threats. Technology Development Reduce technology risk, determine and mature the appropriate set of technologies to be integrated into a full system, demonstrate on prototypes. Ship Self Defense combat survivability data for projected ship systems and threats. This will include updated sensor and weapon performance data from this phase. Ship Self Defense combat survivability data for projected ship systems and threats. This will include updated sensor, C2, and weapon models using updated design and performance data during this phase. Engineering and Manufacturing Development Develop a system or an increment of capability; complete full system integration (technology risk reduction occurs during Technology Development); develop manufacturing process; ensure operational systems integration (HSI); design for producibility; ensure affordability; minimizing the logistics footprint; and demonstrate system integration, interoperability, safety, and utility. Ship Self Defense combat survivability data for developed ship systems and projected threats. This will include updated sensor and weapon performance data from this phase. Ship Self Defense combat survivability data for developed ship systems and projected threats. This will include updated sensor, C2, and weapon models using updated design and performance data during this phase. Production and Deployment Achieve an operational capability that satisfies mission needs. Operational test and evaluation shall determine the effectiveness and suitability of the system. Ship Self Defense combat survivability data for existing ship systems and projected threats. Ship Self Defense combat survivability data for existing ship systems and projected threats. This will include updated sensor, C2, and weapon models using updated design and performance data during this phase. Operations and Support Execute a support program that meets materiel readiness and operational support performance requirements, and sustains the system in the most costeffective manner over its total life cycle. Ship Self Defense combat survivability data for existing ship systems and projected threats. This illustrates how SSD and SADM might be utilized over the acquisition life cycle SSD will utilize updated performance data as the weapon system design matures SADM will incorporate updated models for the sensors, C2, and weapons The higher fidelity of the SADM model is expected to increase its utility later in the lifecycle, while SSD shines in the early stages of the lifecycle We plan to update this initial assessment after we completed our next phase of the study. Ship Self Defense combat survivability data for existing ship systems and projected threats. This will include updated sensor, C2, and weapon models using updated design and performance data during this phase. 20

Extended SADM Applications SADM w/ Missile 6 DOF SADM can be extended to include higher fidelity missile models for stand alone analysis, or.. SADM can be embedded into LVC experiments for Advanced Mission Test Environments (AMTEs). 21

Link AMTE into JMETC Exercises CNR Radio JLENS Bethpage: NG BAMS WPAFB: SIMAF Whiteman: B-2 Redstone (3): DTCC, GMAN, SED Tucson : RMS Charleston (2): IPC, MEF-MEU Ft Huachuca: JITC Ft Hood (2): CTSF, TTEC 22 Army Air Force Navy Marines Joint Industry

Summary/Conclusions This study identified a strong correlation between fidelity, data requirements, and learning curve for the models evaluated Our initial results indicate that both SSD and SADM, while similar models in many ways, provide unique capabilities SSD provides an important quick look capability that is important early in the lifecycle SADM provides a more in depth look at relationships between system components that will increase in importance as the lifecycle advances We are currently looking at a mixed use strategy where both SSD and SADM will be used at different points in the system lifecycle to support weapon system analysis 23

About the Author TIM JAHREN, PHONE: 407-341-9780, EMAIL: JAHREN@RAYTHEON.COM TIM JAHREN has been with the Raytheon family of companies for 30 years. Tim has been a leader in the Simulation Interoperability Standards Organization (SISO) for 15 years. He is the current chair for SISO's System Life Cycle (SLC) forum. He has supported a wide variety of M&S and Simulation Based Acquisition (SBA) programs, including the Joint Simulation System (JSIMS) Enterprise, the Navy's DD- 21 and DD(X) programs, and the Army's Future Combat System. Tim holds a bachelors degree in electrical engineering from Northwestern University and a masters degree in electrical engineering with a focus on communication systems from the University of Southern California. 24