Test & Evaluation/Science & Technology Program

Transcription

1 Test & Evaluation/Science & Technology Program 2012 Underwater Acoustics for T&E Workshop Penn State University 26 April 2012 Advanced Instrumentation Systems Technology (AIST) Executing Agent George Shoemaker, Ph.D

2 Outline T&E/S&T Program BAA Process Advanced Instrumentation Systems Technology (AIST) Overview & Mission Advanced Sensors Topics Advanced TSPI Challenges Unmanned Autonomous Systems Test (UAST) Overview & Mission Testing Scenarios UAST Topics Summary 2

3 T&E/S&T Program Overview Mission: Develop Technologies Required to Test Future Warfighting Capabilities Established in FY02 Joint DDR&E / DOT&E Initiative Transitioned to TRMC in FY05 RDT&E Budget Activity 3 funds Purpose High Risk / High Payoff R&D for Testing 80 Active Projects Foster technology transition to major DoD test ranges Risk reduction for test capabilities developments Annual Broad Agency Announcements (BAAs) Academia Industry Government Laboratories Tri-Service working groups Validate requirements Evaluate proposals Facilitate technology transition Central Oversight Distributed Execution High Speed Systems 13 Active Projects Eight Test Technology Areas Unmanned & Autonomous Systems 3 Active Projects Spectrum Efficiency 14 Active Projects Advanced Instrumentation 8 Active Projects Directed Energy 17 Active Projects Cyberspace 2 Active Projects Electronic Warfare 16 Active Projects Net-Centric Systems 7 Active Projects FY 2011 FY 2012 FY 2013 FY 2014 FY 2015 FY 2016 FY 2017 $94.6M $96.6M $92.6M $94.0M $95.8M $98.4M $100.2M Shaping Technology into Tomorrow s T&E Capabilities

4 Broad Agency Announcements Topics for Industry, Academia, and Government Laboratories to Propose Test Technology Solutions In cycle Process Declared schedule for white paper submissions (deadline) Requires an allocation of available funding Priority over out cycle white papers (must be processed first) Out of cycle Process White papers submitted anytime after "in cycle" deadline Offerors "highly encouraged" to contact Executing Agent before submitting white paper Ensures interest Can address whether a 'chance' exists for funding All BAAs include an Other Test Technologies topic to enable offerors to propose test technology developments that were not previously identified by the Government All T&E/S&T BAAs are always open for new white papers 4

5 Drivers Broad Agency Announcement (BAA) Project Selection Process Announcements issued via TTA Tri Service Working Group Executing Agent (EA) T&E Community Reps S&T Community Reps Subject Matter Experts Needs/Requirements Topics and Announcements Open to All: White Papers Invited: Proposals PEO STRI Contract Awards Approvals PM Test Technology Area (TTA) Execution Executing Agent Recommendations Source Selection Evaluation Team Source Selection Evaluation Board (SSEB) Subject Matter Experts Contracting Reps 5

6 Proposal Review Process Proposals Contracting Team Responsive/ Compliant? (Meets BAA & letter RFP requirements) Source Selection Evaluation Team Evaluation Elements Based on FAR Criteria: T&E need/payoff? S&T challenge? (TRL) Technically sound and feasible? Transition potential? Cost realistic? Past performance issues? Subcontracting plan (large business only) adequate? Approval Recommendation Award Processing Contracting Team TRMC T&E/S&T PM Funding Technical Merit Importance to DoD T&E Executing Agent 6

7 Activity T&E/S&T New Project Selection Schedule T&E/S&T New Project Selection Schedule OCT NOV DEC JAN FEB MAR APR MAY JUN JUL AUG SEP Draft BAA Topic Areas Industry/Academia Days October in Atlanta Refine BAA Topics BAA Topics Finalized BAA Topics Announced White Paper Submissions BAA Pre FY Cycle White Paper Reviews Proposals Requested from Selected Offerors Proposal Submissions Proposal Review & Clarifications Executing Agents Recommendations to PM Call for White Papers White Papers due 20 March Proposals to be Requested on ~22 May Proposals due 26 June PM New Start Decisions Contract Awards Initiated Program Manager Action Executing Agent Action Contracting Officer Action Offeror Action

8 Advanced Instrumentation Systems Technology Mission Developmental Tests Operational Tests I. Time, Space, Position Information (TSPI) II. Advanced Sensors III. Advanced Energy & Power Systems IV. Non Intrusive Instrumentation V. Range Environmental Encroachment VI. Human Systems Decrease size, weight & power (SWaP) Live Fire Tests 8

9 AIST TTA Overview AIST will advance the field of device physics by investigating innovative materials, MEMS sensors, advanced platform level data management, human systems integration, range environmental encroachment and novel sensor packaging technologies to support T&E of warfighting systems TSPI High accuracy & continuous TSPI for high speed/high-g & GPS-degraded environments Advanced Energy & Power Next generation hybrid ionic, fuel cell based & harvesting techniques Advanced Sensors Non-Intrusive, miniature and hardened for harsh environments Non-Intrusive Instrumentation Advanced data acquisition, processing, mining, & storage Range Environmental Encroachment Unique test technology of high interest Human Systems Man-machine interface & cognitive workload assessment 9

10 T&E/S&T Focus Area and Project Names AMFTI: Advanced Munitions Flight Test Instrumentation CHDS: Compact Holographic Data Storage DCTDB: Digital Communications Test Data Bus HEDFS: Harsh Environment D Fiber Sensors HMCU: Holographic Memory Cube Upgrade HSTD: High Speed and Temperature Diagnostics MEMS FO: Microelectromechanical System Fiber Optic MSGSA:Multi species Gas Sensor Array OBWDC: Onboard Wireless Data Communications OMEA: Open Modular Embedded Architecture MOPS: MEMS Optical Pressure Sensor Instrumentation SPC: Self Powered Chip UHDGPS: Ultra High Dynamics GPS WLPS: Wideband Location Positioning System AMFTI DCTDB HEDFS HMCU HSTD MEMS FO OBWDC OMEA SPC WLPS MOPS MSGSA UHDGPS Vehicle Power Lines as Data bus Energy Harvesting Techniques Compact High Capacity Data Recorders Low Power Instrumentation Inertial Reference Instrumentation Synthetic Instrumentation Techniques for Applying Metadata Advanced Data Processing, Mining and Fusion Algorithms Distributed Autonomous Test Instrumentation Control Miniaturized Reduced Weight Sensor Instrumentation Packaging Human Performance instrumentation System of Systems Data Collection Techniques Tunable MEMS Transceiver Non intrusive Network Interfaces Anti jam Processing Techniques for NII Alternative High Density Micro Power Sources TSPI on a Chip Electro Adhesives Telemetry on a Chip FY 2014 AIST Process Advanced Technology Demonstration Programs DoD Inertial Doppler Radio Locator Robust Holographic Optical Memory Ultra High Dynamics GPS Advanced Sensors Strategic Plan TSPI Advanced Energy & Power AIST Roadmap NII FY 2007 FY 2008 FY 2009 FY 2010 FY 2011 FY 2012 FY 2013 Required S&T Near Term Mid Term Far Term T&E Gaps FOCUS AREA: NON INTRUSIVE INSTRUMENTATION (NII) Non intrusive sensors, data storage, and power sources to provide continuous, nonobtrusive T&E = Funded Project = Planned Efforts Human Systems T&E Capability Requirements Field Test M&S System Test Non Lethal Personnel Control Counter MADPADS, RAM Infrastructure Suppression Counter Mine/IED Missile Defense Target Response Interoperability Energy on Target Beam Characterization Target Susceptibility Propagation Modeling Model Validation High Interest Studies, (e.g., Next Gen TSPI) Data Storage Sensors Architecture Power TSPI AIST WG Range Environmental Encroachment 10

11 AIST Advanced Sensors Topics 1. Body Armor Blunt Trauma Evaluation 2. Angle of Incidence/Stores Separation Measurements 3. Advanced Optical and Acoustic Instrumentation 4. Station Keeping Buoys for Sea Ranges 5. Warfighter/Weapon Position and Orientation 6. Weapon System Orientation 7. Supercavitating Vehicle Cavity Sensing 8. Non traditional Sensors 9. Munition/Warhead Characterization Testing 11

12 Advanced Instrumentation Systems Technology Advanced TSPI Operational Constraints Emerging challenges for Time Space Position Information (TSPI) instrumentation Test operations in GPS blocked environments (urban, caves, dense foliage, undersea) Operation in a tactical GPS jamming environment Hypersonic vehicles in a plasma field Micro autonomous systems Low Observable (LO) Systems that can not mount external instrumentation

13 Domain: Range Environmental Encroachment Marine Mammal Effects from T&E on Ocean Ranges (METEOR) Naval Undersea Warfare Center, Newport, RI Blainville s Beaked Whale (Mesoplodon densirostris) FY12 Accomplishments Developed an initial prototype Blainville s beaked whale forage/buzz click detector/classifiers Identifying candidate odontocete & baleen classifiers/feature sets Develop candidate classifiers and data sets for baleen whales Deliverables Working real time classifiers for beaked and candidate small odontocete and mysticete species implemented on Navy ranges Description Determine features and establish statistics for detection and classification of beaked whale buzz clicks and selected small delphinid and baleen species Develop real-time detection/classification algorithms that can efficiently monitor khz. Demonstrate performance in-situ on Navy T&E ranges Current Status Phase I data collection establishing feature sets and development of classifiers to support laboratory algorithm testing Transition Partner / Date Navy Ranges (AUTEC, SCORE, PMRF)/4 th QTR FY14 Start / Finish: Aug 11 Aug 14 Key Future Events / FY12 Plans 9 10 May 22, 2012: Interim Project Review, SPAWARSYSCOM, San Diego, CA July 2012: Phase II decision meeting

14 Unmanned and Autonomy Systems Test (UAST) Mission Develop technologies that significantly advance the science of testing autonomous and intelligent systems for operation across the full spectrum of battlespace environments These technologies shall be pursued to enhance user s trust in system capability and operational safety 14

15 Self World Team Comms Unmanned and Autonomous Systems Test Overview Actors Mission Adversary Perceive World Model Reason Behavior Test Technologies to Measure & Assess: Behavior Sequence Task The functions of an autonomous system Sense UAS World Act Tester Tester Interaction Test Management Environment Environmental Complexity Measure Performance Sense Interact Battlespace Awareness Team UAS Network UAS Interaction/ Teaming Data Sharing Division of Task Situational Awareness Command and Control A priori knowledge Human Human Interaction The interactions of an autonomous system within its environment 15

16 UAS Testing Eras Unmanned Era Tester s Approach Automated Remotely commanded but operator assessed. Preprogrammed tasks with explicit outcomes. Limited proximity to humans and vital infrastructure. Dependence on reliable communications. Action Accomplishment derived by physical properties such as position, path, speed, separation distance, completion of event. UAST has identified 3 major eras of testing UAS Systems Automated, Autonomous and Intelligent Each era characterized by the approach needed to test them Action, Intent, Motivation Autonomous Greater independence but operator supervised. Primarily deterministic. Task level complexity with explicit task composition, Limited UAS to UAS interactions. Environmental interaction. Structured independence, locally aware Intent Decoupling of measureable cause and effect. Need to verify reasoning process not just action. Need to verify that SUT perceived situation correctly and meant to act the way it did. Intelligent Motivation Near Mid Far UAST focuses on unique challenges in Autonomous and Intelligent era Independent reasoning. Experience driven. Adaptive. High decision complexity. Multiple mission goals. UAS to UAS cooperation. Adversary interaction. Unstructured independence. Distributed understanding. Recognition that knowledge and decision ability are a function of time and experience. Need to verify SUT had sufficient knowledge of a situation to form correct intent. Need to verify combination of multiple mission goals. Instill user trust. Time 16

17 Persistent Stare Unmanned and Autonomous Systems Test Operational Scenarios Bio Monitoring Autonomous Refueling Autonomous Lift Wingman Collaborative Autonomy Swarming Recon Blockade Enforcement Mine Neutralization Medical Evac Sub Warfare Hold at Risk Perimeter Surveillance Convoy BDA Route Clearance IED Interrogation Dynamic Networks Targeting Cordon & Search 17

18 Hold at Risk Testing failure envelops Sea T&E Need Determine sets of conditions that will most likely produce failure Isolate stimulus that will test particular decision process Bind particular decision processes to a failure condition 18

19 Adaptive Testing of Autonomous Systems (ATAS) Description Utilization of Genetic Algorithm (GA) to search the performance (fault trees) of an UAS performing a specific mission to identify unsafe or failed behavior Technology will identify and populate a data base of failure scenarios that represent the operational bounds of an autonomous platform (air, sea, ground) T&E Needs Ability to characterize performance envelop of autonomous systems Understanding of how to assess autonomous operations S&T Challenges Generalized representation of UAS fault rules, evaluation functions Scaling GA up to represent complex UAS, lengthy missions Key Events, Deliverables, & Current Status Phase I 12 Months, in Progress Develop generalized (multiple UAS) representations of fault rules and evaluation function Deliverable - Software and Application Program Interface document Phase II 12 Months Demonstrate on initial auto controller for Navy Large Displacement Unmanned Underwater Vehicle (LD-UUV) Deliverable - Report and demonstration on missions with multiple autonomous systems Phase I 12 Months Demo on full scale LD-UUV simulator Deliverable Software user manual Transition Partners LD UUV, Naval Undersea Warfare Center Keyport Current Status: Project Award on 14 Jun 11. Held kick-off meeting on 20 Jul11 at NRL, spoke DISTRIBUTION with Mr. Schultz STATEMENT for update A. Approved for public release; distribution is unlimited. on models being developed 19

20 UAST Test Technology Topics Autonomous System Test Planning T&E Need: Ability to rapidly plan and execute an effective and efficient test strategy of an autonomous system 1. Predicting Autonomous Behavior for Testing 2. Rapid Design of Autonomous System Test Plans 3. Enhancing Safety of Autonomous Testing Autonomous System Performance Assessment T&E Need: Ability to assess the performance of an autonomous system interacting in its operational environment 1. Measure Human Autonomous System Interaction 2. Testing of Autonomy Functional Components 3. Measure Autonomous System Reliability and Performance 4. Assess Vulnerabilities of Autonomous Systems 20

21 T&E/S&T Program Summary T&E/S&T Program initiated to address critical T&E needs tied to S&T drivers Advancing the state of the art in T&E technologies The only DoD S&T program dedicated to T&E Broad Agency Announcements (BAAs) to Industry, Academia, and Government Laboratories to address test capability needs Competitive technology developments to get the best technologies possible to the test community Focused on transition into needed test capabilities Looking Ahead, Responsive, and Agile 21

22 FY13 BAA Advertisements W900KK 09 R 0037 AMENDMENT 0003 TTA Advanced Instrumentation Systems Technology Science & Technology (AIST S&T) formerly Non Intrusive Instrumentation Science & Technology (NII S&T), Annual Update for FY13 FBO: =core&_cview=1 ASFI: W900KK 09 R 0038 AMENDMENT 0004 TTA Unmanned and Autonomous Systems Science & Technology (UAST S&T), Annual Update for FY13 FBO: =core&_cview=1 ASFI: 22

23 Points of Contact T&E/S&T Program George Rumford Phone Unmanned and Autonomy Systems Test (UAST) Executing Agent Bill Hamel Deputy Executing Agent Stephanie Riddle Advanced Instrumentation Systems Technology (AIST) Executing Agent George Shoemaker, Ph.D Deputy Executing Agent Tom Fulton