Quality Management for Advanced Classification. David Wright Senior Munitions Response Geophysicist CH2M HILL
|
|
- Samuel Marsh
- 6 years ago
- Views:
Transcription
1 Quality Management for Advanced Classification David Wright Senior Munitions Response Geophysicist CH2M HILL
2 Goals of Presentation Define Quality Management, Quality Assurance, and Quality Control in the context of Advanced Classification Present current state of the art with examples Discuss direction of current development and associated challenges. 2
3 Quality Management Objectives Ensure the quality of the data being collected Ensure that the collected data and derived products support conclusions based upon these results Document the QC/QA findings so that the client can be assured of the quality of the results 3
4 Quality Management Quality Management: Program activities involved with all aspects of quality Quality Assurance: Audit project activities against planning documents Quality Control: Audit project data against planned or standard measurement quality objectives Quality Management Personnel Requirements Qualifications Training Quality Assurance Audit against planning docs 3 rd party data verification /validation Validate results Quality Control Verify data Validate data Project Planning QAPPs Work Plans MQOs System Maintenance Hardware upgrades Software upgrades SOPs 4
5 Recent Demonstrations Different Sites Different Sensor Technologies Different Analysts/ Approaches 5
6 Quality Control Verify and Validate: Data Acquisition Cued measurements Dynamic measurements Data Modeling Single-target or multi-target inversion to find model(s) that best fit observed data Output = features intrinsic to the target Classification Use features to sort targets into a prioritized list 6
7 Advanced Sensors Sensor Tx/ target orientation Tx/ Rx combinations Time gates Data pts/ cued target EM61 Mk2 Dynamic* Single 4 324* TEMTADS 2x2 Dynamic 4 Tx x 12 Rx = ,800 MetalMapper Dynamic 3 Tx x 21 Rx = ,500 * requires multiple positions (9x9 pt sample grid)
8 Sensor Function QC Attempts to use inversion results over known targets (IVS) for field QC often fail. Inversions tend to average out errors Inversions do not always exercise all sensor components. Single coil (Rx2Z) failure example Field QC inversion results for a medium ISO using MetalMapper sensor missing RX coil #7 Medium ISO
9 Betas Betas Sensor Function QC TEMTADS Single coil (Rx2Z) failure example (20 mm): Center of Array Coil 1 Coil 2 Coil 3 Coil 4 9
10 Advanced Sensor Function QC TX1 TX2 TX3 TX4 Rx4X Rx4Y Rx4Z Rx3X Rx3Y Rx3Z Tx/Rx1 Tx/Rx2 Tx/Rx3 Tx4/Rx4 Rx2X Rx2Y Rx2Z Monostatic Terms X Rx1X 1 2 Y Rx1Y Rx1Z 4 3 Z 10
11 blank 213am 213pm 214am 215am 215pm 217am 217pm 218am 218pm 219am 219pm 220am 220pm 224am 224pm Sensor Function Failure Example Single Single Multiple QC reports should be: Easy to generate on a daily basis Designed to identify problems in a timely manner Standardized for easy interpretation and evaluation TEMTADS 2x2 Function Test New Boston AFS (Cued) Tx0_Rx0X Tx0_Rx0Y Tx0_Rx0Z Tx1_Rx1X Tx1_Rx1Y Tx1_Rx1Z Tx2_Rx2X Tx2_Rx2Y Tx2_Rx2Z Tx3_Rx3X Tx3_Rx3Y Tx3_Rx3Z 11
12 Background Removal QC Background corrections applied to remove: 1. Soil response 2. Zero level drift Therefore background measurements must: 1. Be taken in similar soils to that of the target (minimize the spatial offset) 2. Be taken frequently (minimize temporal offset) 3. Be free of signal due to metal sources 12
13 Background Removal QC Dynamic surveys have the advantage of minimizing the temporal and spatial separation between the background measurement and the target measurement. Dynamic background locations 13
14 Background Removal QC Static Backgrounds are temporally and spatially offset so will inject some error Static background location 14
15 Data Modeling Principal Axes Polarizabilities (betas) + Refined Position /Attitude estimates 15
16 Data Modeling QC 1 Polarizability (m 3 /A) ? Time (ms) The intrinsic parameters are representative of the target if: 1. The modeled data match the observed data 2. The target was energized along all three principal axes 16
17 Data Modeling QC Fit coherence metric indicates how well the model fits the observed data Fit coh =
18 Data Modeling QC Fit coherence metric indicates how well the model fits the observed data Fit coh =
19 Data Modeling QC Targets outside of the sweet spot may not have been energized along all three axes Fit position offset > 40 cm indicate the results may be unreliable Plan View Side View 40 cm 40 cm 19
20 Classification State of art is converging to Library Matching Library Match Feature Space 20
21 Classification Library matching is the primary approach to classification, but there is considerable variability in how it is implemented: Some art still used optimize the approach for some sites Man-in-the-loop decisions are made on difficult targets more experience = greater success What is more important to the client, performance or transparency? 21
22 Classification QC Poor performances attributable to lack of: training, SOP s and proper QC/QA experienced analyst inexperienced analyst Variability Due to Analysts / Approach 22
23 Variability Due to Analysts Success Requires: Training Experience Quality Control/Assurance 23
24 Quality Management Personnel Requirements Qualifications Training Project Planning QAPPs Site considerations System Maintenance Hardware software upgrades SOPs 24
25 Personnel Requirements NAOC working group recommendations: Munitions Response Advanced Classification (AC) Geophysical Qualifications Position Experience 1 Education Training 2 Certifications 40 hours in applicable DGM Software, including Documented experience o Geosoft (or equivalent) applying advanced Degree in: o Geosoft QA QC tools (or classification 3 geophysics, equivalent) No applicable 1 year experience analyzing geology, or 16 hours of training on AC method certifications DGM data for MR projects a closely related and mode of operation being at present 24 hours AC analysis under scientific or implemented the direct supervision of a engineering field 5 8 hours AC analysis refresher qualified AC Data Analyst training, if no AC analysis has occurred in past year AC Data Analyst Lead NOTES: 1. Experience qualifications follow individuals. Companies can acquire experience through joint ventures, teaming arrangements, or mentor-protégé relationships in addition to self performance. 2. Training could be from hardware/software manufacturers, USACE or other agencies responsible for executing AC projects, ESTCP, or equivalent in-house training as appropriate. 3. Experience could be from a Standardized Test Site, ESTCP demonstration project, pilot study, characterization project, response action, remedial action, or an equivalent project or standardized test data set. Recommended minimum experience consists of AC analysis on two projects or AC analysis of 2,500 targets using the proposed project methodology. 4. Experience could be from a Standardized Test Site, ESTCP demonstration project, pilot study, characterization project, response action, remedial action, or an equivalent project. 5. Or has documented AC experience prior to
26 Personnel Requirements NAOC working group recommendations: Munitions Response Advanced Classification (AC) Geophysical Qualifications Position Experience 1 Education Training 2 Certifications Documented experience Degree in: 8 hours training on each advanced collecting AC data 4 geophysics, EMI sensor and mode of operation 1 year experience collecting geology, or being utilized No applicable DGM data for MR projects a closely related 8 hours AC data collection refresher certifications 24 hours in-field AC data scientific or training, if no AC data collection has at present collection under the direct engineering field 5 occurred in past year supervision of a qualified AC Instrument Operator AC Data Collection Lead NOTES: 1. Experience qualifications follow individuals. Companies can acquire experience through joint ventures, teaming arrangements, or mentor-protégé relationships in addition to self performance. 2. Training could be from hardware/software manufacturers, USACE or other agencies responsible for executing AC projects, ESTCP, or equivalent in-house training as appropriate. 3. Experience could be from a Standardized Test Site, ESTCP demonstration project, pilot study, characterization project, response action, remedial action, or an equivalent project or standardized test data set. Recommended minimum experience consists of AC analysis on two projects or AC analysis of 2,500 targets using the proposed project methodology. 4. Experience could be from a Standardized Test Site, ESTCP demonstration project, pilot study, characterization project, response action, remedial action, or an equivalent project. 5. Or has documented AC experience prior to
27 Personnel Requirements NAOC working group recommendations: Munitions Response Advanced Classification (AC) Geophysical Qualifications Position Experience 1 Education Training 2 Certifications Documented experience Degree in: 8 hours training on each advanced collecting AC data 4 geophysics, EMI sensor and mode of operation 1 year experience collecting geology, or being utilized No applicable DGM data for MR projects a closely related 8 hours AC data collection refresher certifications 24 hours in-field AC data scientific or training, if no AC data collection has at present collection under the direct engineering field 5 occurred in past year supervision of a qualified AC Instrument Operator AC Data Collection Lead NOTES: 1. Experience qualifications follow individuals. Companies can acquire experience through joint ventures, teaming arrangements, or mentor-protégé relationships in addition to self performance. 2. Training could be from hardware/software manufacturers, USACE or other agencies responsible for executing AC projects, ESTCP, or equivalent in-house training as appropriate. 3. Experience could be from a Standardized Test Site, ESTCP demonstration project, pilot study, characterization project, response action, remedial action, or an equivalent project or standardized test data set. Recommended minimum experience consists of AC analysis on two projects or AC analysis of 2,500 targets using the proposed project methodology. 4. Experience could be from a Standardized Test Site, ESTCP demonstration project, pilot study, characterization project, response action, remedial action, or an equivalent project. 5. Or has documented AC experience prior to
28 Personnel Requirements NAOC working group recommendations: Munitions Response Advanced Classification (AC) Geophysical Qualifications Position Experience 1 Education Training 2 Certifications Documented experience Degree in: 8 hours training on each advanced collecting AC data 4 geophysics, EMI sensor and mode of operation 1 year experience collecting geology, or being utilized No applicable DGM data for MR projects a closely related 8 hours AC data collection refresher certifications 24 hours in-field AC data scientific or training, if no AC data collection has at present collection under the direct engineering field 5 occurred in past year supervision of a qualified AC Instrument Operator AC Data Collection Lead NOTES: 1. Experience qualifications follow individuals. Companies can acquire experience through joint ventures, teaming arrangements, or mentor-protégé relationships in addition to self performance. 2. Training could be from hardware/software manufacturers, USACE or other agencies responsible for executing AC projects, ESTCP, or equivalent in-house training as appropriate. 3. Experience could be from a Standardized Test Site, ESTCP demonstration project, pilot study, characterization project, response action, remedial action, or an equivalent project or standardized test data set. Recommended minimum experience consists of AC analysis on two projects or AC analysis of 2,500 targets using the proposed project methodology. 4. Experience could be from a Standardized Test Site, ESTCP demonstration project, pilot study, characterization project, response action, remedial action, or an equivalent project. 5. Or has documented AC experience prior to Bachelor of Science degree or demonstrated equivalent proficiency with scientific concepts 28
29 Project Planning Quality Assurance Project Plan (QAPP) QAPP: a formal document describing in comprehensive detail the necessary quality assurance (QA), quality control (QC), and other technical activities that must be implemented to ensure that the results of the work performed will satisfy the stated performance criteria EPA web site
30 Project Planning: Site Considerations Soil composition / geology Types and variability of anticipated TOI s, % of TOI Density distribution of metal Pilot Studies/Cost Benefit Analysis to manage expectations 30
31 ssed TOI models passed TOI models 200 Site Conditions: Local Geology L2 L3 6 8 ssed models ssed TOI models rary 6 8 ssed models ssed TOI models Polarizability quality Polarizability Quality Median = 1.73 / 6.78 Polarizability quality Median = / 3.48 passed models passed TOI models passed models passed TOI models 10-4 Local geology Feature Extraction Classification (small ISO) Results Pole Mtn (resistive) Beale (conductive) Ltot L1 L2 L3 Polarizabilities for ISO seeds L1 L2 L L1 Ltot L2 L3 L1 L2 L Polarizability quality Median = / L1 Ltot L2 L3 ssed models ssed TOI models 400 passed models passed TOI models L1 L2
32 Site Conditions: TOI Types 20mm Projectiles Excluded 20mm Projectiles Included Results from Pilot Study at the Former VNTR 32
33 System Maintenance Sensor redesign/upgrades Data format moving to Hierarchical Data Format (HDF)5. Field-worthiness improvements Software upgrades Take advantage of HDF5 format Streamlining to create a standard workflow Emphasis on QC tools 33
34 Standard Operating Procedures 1 Assemble the MetalMapper System and Verify Correct Operation 2 Test Sensor and System at the IVS 3 Production Area Seeding 4 Collect Dynamic Data Using the MetalMapper Sensor 5 Preprocess Dynamic Data and Identify Anomalies 6 Collect Static Background Measurements 7 Collect Cued Target Measurements 8 Verify Usability of Advanced Sensor Data 9 Background Correct Cued Anomaly Data 10 Invert anomaly data to extract source parameters 11 Compare extracted parameters to MEC signatures in the data library 12 Develop prioritized dig list using library matching and other factors 13 Verify recovered objects are compatible with advanced classification predictions 14 Develop verification sampling dig list and perform verification sampling 34
35 Quality Assurance Challenges: Library maintenance Classification approach Operator threshold and validation of results 35
36 TOI Library What items are in the library? How can we ensure that the library is appropriate for the sensor configuration being used? How do we handle the risk of unexpected munitions types that are not in the library? 36
37 Objective vs Subjective Analysis Ranking should be performed using quantitative, objective, defensible criteria. Subjective decisions? Similar to today s standard DGM practice of having the analyst finalize the dig list by adding and/or removing targets based upon their expert judgment 37
38 Subjective Demotions Subjective decisions to move a target from the dig to no-dig category should be strongly discouraged 38
39 Subjective Promotions Subjective decisions to move a target from the no-dig to dig category are allowed but: They must be identified as subjective promotions If a QC or QA seed is found in this manner, a root cause analysis must be performed 39
40 Analysts Threshold Who should ultimately make the stop dig decision? Other factors such as remediation budget, end use, exposure pathways are beyond the purview of the analyst. 40
41 Classification Validation Can the results act as a QC tool? Analyst Threshold +10% +20% 41
42 Final Thoughts Advanced Classification has been shown to provide significant efficiencies in risk reduction at military munitions response sites Quality Management is critical to the successful implementation of Advanced Classification 42
43 Comments/Questions? Contact: David Wright (919)
Terminology and Acronyms used in ITRC Geophysical Classification for Munitions Response Training
Terminology and Acronyms used in ITRC Geophysical Classification for Munitions Response Training ITRC s Geophysical Classification for Munitions Response training and associated document (GCMR 2, 2015,
More informationAdvances in UXO classification
Advances in UXO classification Stephen Billings, Laurens Beran, Leonard Pasion and Nicolas Lhomme NSGG UXO213 Conference Outline A. Why classification? UXO contamination ESTCP Pilot Discrimination Studies
More informationWelcome to Munitions Response and Remediation Moderator: Ms. Nelline Kowbel Speakers:
Welcome to Munitions Response and Remediation Moderator: Ms. Nelline Kowbel Speakers: Mr. John Jackson, USACE, Sacramento District Mr. Charles Welk, InDepth Corporation Mr. Roman Racca, California Department
More informationCase Study: Advanced Classification Contracting at Former Camp San Luis Obispo
Case Study: Advanced Classification Contracting at Former Camp San Luis Obispo John M. Jackson Geophysicist USACE-Sacramento District US Army Corps of Engineers BUILDING STRONG Agenda! Brief Site Description
More informationGeophysical Classification for Munitions Response
Geophysical Classification for Munitions Response Technical Fact Sheet June 2013 The Interstate Technology and Regulatory Council (ITRC) Geophysical Classification for Munitions Response Team developed
More informationNew Directions in Buried UXO Location and Classification
New Directions in Buried UXO Location and Classification Thomas Bell Principal Investigator, ESTCP Project MR-200909 Man-Portable EMI Array for UXO Detection and Discrimination 1 Introduction Why this
More informationAPPENDIX E INSTRUMENT VERIFICATION STRIP REPORT. Final Remedial Investigation Report for the Former Camp Croft Spartanburg, South Carolina Appendices
Final Remedial Investigation Report for the Former Camp Croft APPENDIX E INSTRUMENT VERIFICATION STRIP REPORT Contract No.: W912DY-10-D-0028 Page E-1 Task Order No.: 0005 Final Remedial Investigation Report
More informationTECHNICAL REPORT. ESTCP Project MR Demonstration of the MPV at Former Waikoloa Maneuver Area in Hawaii OCTOBER 2015
TECHNICAL REPORT Demonstration of the MPV at Former Waikoloa Maneuver Area in Hawaii ESTCP Project MR-201228 Nicolas Lhomme Kevin Kingdon Black Tusk Geophysics, Inc. OCTOBER 2015 Distribution Statement
More informationINTERIM TECHNICAL REPORT
INTERIM TECHNICAL REPORT Detection and Discrimination in One-Pass Using the OPTEMA Towed-Array ESTCP Project MR-201225 Jonathan Miller, Inc. NOVEMBER 2014 Distribution Statement A REPORT DOCUMENTATION
More informationDEMONSTRATION REPORT
DEMONSTRATION REPORT Demonstration of the MPV at a Residential Area in Puako, Hawaii: UXO Characterization in Challenging Survey Environments Using the MPV ESTCP Project MR-201228 Dr. Stephen Billings
More informationTECHNICAL REPORT. ESTCP Project MR Live Site Demonstrations - Massachusetts Military Reservation SEPTEMBER John Baptiste Parsons
TECHNICAL REPORT Live Site Demonstrations - Massachusetts Military Reservation ESTCP Project MR-201104 John Baptiste Parsons SEPTEMBER 2014 Distribution Statement A Public reporting burden for this collection
More informationFINAL REPORT. ESTCP Project MR Clutter Identification Using Electromagnetic Survey Data JULY 2013
FINAL REPORT Clutter Identification Using Electromagnetic Survey Data ESTCP Project MR-201001 Bruce J. Barrow James B. Kingdon Thomas H. Bell SAIC, Inc. Glenn R. Harbaugh Daniel A. Steinhurst Nova Research,
More informationREPORT FOR THE MPV DEMONSTRATION AT NEW BOSTON AIR FORCE BASE, NEW HAMPSHIRE
REPORT FOR THE MPV DEMONSTRATION AT NEW BOSTON AIR FORCE BASE, NEW HAMPSHIRE ESTCP MR-201228: UXO Characterization in Challenging Survey Environments Using the MPV Black Tusk Geophysics, Inc. Nicolas Lhomme
More information(MR ) Demonstration of Advanced Geophysics and Classification Technologies on Munitions Response Sites
(MR-201161) Demonstration of Advanced Geophysics and Classification Technologies on Munitions Response Sites April 2015 REPORT DOCUMENTATION PAGE Form Approved OMB No. 0704-0188 Public reporting burden
More informationESTCP Live Site Demonstrations Former Camp Beale Marysville, CA
ESTCP Live Site Demonstrations Former Camp Beale Marysville, CA ESTCP MR-201165 Demonstration Data Report Former Camp Beale TEMTADS MP 2x2 Cart Survey Document cleared for public release; distribution
More informationESTCP Live Site Demonstrations Massachusetts Military Reservation Camp Edwards, MA
ESTCP Live Site Demonstrations Massachusetts Military Reservation Camp Edwards, MA ESTCP MR-1165 Demonstration Data Report Central Impact Area TEMTADS MP 2x2 Cart Survey September 6, 2012 Approved for
More informationAPPENDIX: ESTCP UXO DISCRIMINATION STUDY
SERDP SON NUMBER: MMSON-08-01: ADVANCED DISCRIMINATION OF MILITARY MUNITIONS EXPLOITING DATA FROM THE ESTCP DISCRIMINATION PILOT STUDY APPENDIX: ESTCP UXO DISCRIMINATION STUDY 1. Introduction 1.1 Background
More informationDEMONSTRATION REPORT
DEMONSTRATION REPORT Live Site Demonstrations: Former Camp Beale Demonstration of MetalMapper Static Data Acquisition and Data Analysis ESTCP Project MR-201157 Greg Van John Baptiste Jae Yun Parsons MAY
More informationFINAL REPORT MUNITIONS CLASSIFICATION WITH PORTABLE ADVANCED ELECTROMAGNETIC SENSORS. Demonstration at the former Camp Beale, CA, Summer 2011
FINAL REPORT MUNITIONS CLASSIFICATION WITH PORTABLE ADVANCED ELECTROMAGNETIC SENSORS Demonstration at the former Camp Beale, CA, Summer 211 Herbert Nelson Anne Andrews SERDP and ESTCP JULY 212 Report Documentation
More informationUXO Characterization in Challenging Survey Environments Using the MPV
(MR-201228) UXO Characterization in Challenging Survey Environments Using the MPV January 2018 This document has been cleared for public release; Distribution Statement A Page Intentionally Left Blank
More informationClutter Identification Using Electromagnetic Survey Data ESTCP MR Cost and Performance Report
Naval Research Laboratory Washington, DC 20375-5320 NRL/MR/6110--14-9518 Clutter Identification Using Electromagnetic Survey Data ESTCP MR-201001 Cost and Performance Report Bruce J. Barrow James B. Kingdon
More informationAdvanced EMI Data Collection Systems' Demonstration
(MR-201165) Advanced EMI Data Collection Systems' Demonstration October 2013 This document has been cleared for public release; Distribution Statement A COST & PERFORMANCE REPORT Project: MR-201165 TABLE
More informationAppendix C: Quality Assurance Project Plan DRAFT Phase II Interim Action Work Plan
FORA ESCA REMEDIATION PROGRAM Appendix C: Quality Assurance Project Plan DRAFT Phase II Interim Action Work Plan Interim Action Ranges Munitions Response Area Former Fort Ord Monterey County, California
More informationThe subject of this presentation is a process termed Geophysical System Verification (GSV). GSV is a process in which the resources traditionally
The subject of this presentation is a process termed Geophysical System Verification (GSV). GSV is a process in which the resources traditionally devoted to a GPO are reallocated to support simplified,
More informationFINAL REPORT. ESTCP Project MR High-Power Vehicle-Towed TEM for Small Ordnance Detection at Depth FEBRUARY 2014
FINAL REPORT High-Power Vehicle-Towed TEM for Small Ordnance Detection at Depth ESTCP Project MR-201105 T. Jeffrey Gamey Battelle Oak Ridge Operations FEBRUARY 2014 Distribution Statement A TABLE OF CONTENTS
More informationFINAL REPORT. ESTCP Pilot Program Classification Approaches in Munitions Response Camp Butner, North Carolina JUNE 2011
FINAL REPORT ESTCP Pilot Program Classification Approaches in Munitions Response Camp Butner, North Carolina JUNE 2011 Anne Andrews Herbert Nelson ESTCP Katherine Kaye ESTCP Support Office, HydroGeoLogic,
More informationDEMONSTRATION REPORT
DEMONSTRATION REPORT Demonstration of MPV Sensor at Yuma Proving Ground, AZ ESTCP Project Nicolas Lhomme Sky Research, Inc June 2011 TABLE OF CONTENTS EXECUTIVE SUMMARY... vii 1.0 INTRODUCTION... 1 1.1
More informationIntroduction to Classification Methods for Military Munitions Response Projects. Herb Nelson
Introduction to Classification Methods for Military Munitions Response Projects Herb Nelson 1 Objective of the Course Provide a tutorial on the sensors, methods, and status of the classification of military
More informationFINAL REPORT. ESTCP Project MR Hand-Held EMI Sensor Combined with Inertial Positioning for Cued UXO Discrimination APRIL 2013
FINAL REPORT Hand-Held EMI Sensor Combined with Inertial Positioning for Cued UXO Discrimination ESTCP Project MR-200810 APRIL 2013 Dean Keiswetter Bruce Barrow Science Applications International Corporation
More information(MR ) February This document has been cleared for public release; Distribution Statement A
(MR-201314) Empirical Evaluation of Advanced Electromagnetic Induction Systems - Factors Affecting Classification Effectiveness in Challenging Geologic Environments February 2017 This document has been
More information2011 ESTCP Live Site Demonstrations Vallejo, CA
Naval Research Laboratory Washington, DC 20375-5320 NRL/MR/6110--12-9397 2011 ESTCP Live Site Demonstrations Vallejo, CA ESTCP MR-1165 Demonstration Data Report Former Mare Island Naval Shipyard MTADS
More informationESTCP Cost and Performance Report
ESTCP Cost and Performance Report (MR-200809) ALLTEM Multi-Axis Electromagnetic Induction System Demonstration and Validation August 2012 ENVIRONMENTAL SECURITY TECHNOLOGY CERTIFICATION PROGRAM U.S. Department
More informationClosed Castner Firing Range Remedial Investigation
Closed Castner Firing Range Remedial Investigation Technical Project Planning (TPP) Meeting #3 9:00 AM 1:00 PM Imagine the result Meeting Agenda Meeting Goals Remedial Investigation (RI) Project Objectives
More informationFINAL Geophysical Test Plot Report
FORA ESCA REMEDIATION PROGRAM FINAL Geophysical Test Plot Report Phase II Seaside Munitions Response Area Removal Action Former Fort Ord Monterey County, California June 5, 2008 Prepared for: FORT ORD
More informationAbstract. Introduction
TARGET PRIORITIZATION IN TEM SURVEYS FOR SUB-SURFACE UXO INVESTIGATIONS USING RESPONSE AMPLITUDE, DECAY CURVE SLOPE, SIGNAL TO NOISE RATIO, AND SPATIAL MATCH FILTERING Darrell B. Hall, Earth Tech, Inc.,
More informationTomorrow's Energy Designed Today TECHNOVA
TECHNOVA Tomorrow's Energy Designed Today Who We Are Established in 1982, "Technova Petroleum Services" offers complimentary services to Oil & Gas project world wide. For more than 30 years, Technova provided
More informationGeophysical System Verification
Geophysical System Verification A Physics Based Alternative to Geophysical Prove Outs Herb Nelson 1 The evaluation and cleanup of current and former military sites contaminated with buried munitions relies
More informationFINAL PILOT STUDY ADVANCED GEOPHYSICAL CLASSIFICATION
FINAL PILOT STUDY ADVANCED GEOPHYSICAL CLASSIFICATION Spring Valley Formerly Used Defense Site Spring Valley, Washington, DC Prepared for: U.S. Army Corps of Engineers Baltimore District Contract: W912DR-15-D-0015,
More informationUsing the Streamlined Systems Engineering (SE) Method for Science & Technology (S&T) to Identify Programs with High Potential to Meet Air Force Needs
Using the Streamlined Systems Engineering (SE) Method for Science & Technology (S&T) to Identify Programs with High Potential to Meet Air Force Needs Dr. Gerald Hasen, UTC Robert Rapson; Robert Enghauser;
More informationAdvanced Utility Locating Technologies (R01B)
Advanced Utility Locating Technologies (R01B) Jacob Sheehan Senior Geophysicist Olson Engineering Phil Sirles Principal Geophysicist Olson Engineering Introduction: Utility Bundle Overview SHRP2 Strategic
More informationREMEDIAL INVESTIGATION OF THE CLOSED RANGES AT F.E. WARREN AFB: A CASE STUDY
REMEDIAL INVESTIGATION OF THE CLOSED RANGES AT F.E. WARREN AFB: A CASE STUDY Joint Services Environmental Management Conference March 22, 2006 Presented by Brian Powers, URS Coauthors: John Wright, F.E.
More informationAPPENDIX I Geophysical Data. Geophysical data is provided in the electronic copy of this report.
APPENDIX I Geophysical Data Geophysical data is provided in the electronic copy of this report. This page intentionally left blank. 1.0 INTRODUCTION SCHILLING AIR FORCE BASE GEOPHYSICAL SURVEY Parsons
More informationESTCP Cost and Performance Report
ESTCP Cost and Performance Report (MM-0108) Handheld Sensor for UXO Discrimination June 2006 ENVIRONMENTAL SECURITY TECHNOLOGY CERTIFICATION PROGRAM U.S. Department of Defense Report Documentation Page
More informationAutomated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF
Automated Driving Systems with Model-Based Design for ISO 26262:2018 and SOTIF Konstantin Dmitriev The MathWorks, Inc. Certification and Standards Group 2018 The MathWorks, Inc. 1 Agenda Use of simulation
More informationPaul Black, Ph.D. Kate Catlett, Ph.D. Mark Fitzgerald, Ph.D. Will Barnett, M.S.
Paul Black, Ph.D. Kate Catlett, Ph.D. Mark Fitzgerald, Ph.D. Will Barnett, M.S. www.neptuneandco.com 1 High costs for characterization & cleanup of munitions sites Need to be more cost effective Tendency
More informationMunitions and Explosives of Concern Hazard Assessment (MEC HA) Initiative. Joint Services Environmental Management Conference March 23, 2006
Munitions and Explosives of Concern Hazard Assessment (MEC HA) Initiative Joint Services Environmental Management Conference March 23, 2006 Purpose of this Briefing Overview Why a MEC HA? Discuss the participants,
More informationESTCP Cost and Performance Report
ESTCP Cost and Performance Report (MR-200601) EMI Array for Cued UXO Discrimination November 2010 Environmental Security Technology Certification Program U.S. Department of Defense Report Documentation
More informationSTANDARD OPERATING PROCEDURES SOP:: 2057 PAGE: 1 of 6 REV: 0.0 DATE: 07/11/03
PAGE: 1 of 6 1.0 SCOPE AND APPLICATION 2.0 METHOD SUMMARY CONTENTS 3.0 SAMPLE PRESERVATION, CONTAINERS, HANDLING, AND STORAGE 4.0 INTERFERENCES AND POTENTIAL PROBLEMS 5.0 EQUIPMENT/APPARATUS 6.0 REAGENTS
More informationWeather and Environmental Services - QMS Manual
1.0 SECTION ONE - INTRODUCTION 1.1 Purpose Reference.: Page 1 of 5 This process provides a new, changed or acquired off the shelf design, process, procedure, methodology or technology that addresses a
More informationSWEN 256 Software Process & Project Management
SWEN 256 Software Process & Project Management What is quality? A definition of quality should emphasize three important points: 1. Software requirements are the foundation from which quality is measured.
More informationEnvironmental Security Technology Certification Program (ESTCP) Technology Demonstration Data Report. ESTCP UXO Discrimination Study
Environmental Security Technology Certification Program (ESTCP) Technology Demonstration Data Report ESTCP UXO Discrimination Study MTADS Demonstration at Camp Sibert Magnetometer / EM61 MkII / GEM-3 Arrays
More informationEM61-MK2 Response of Standard Munitions Items
Naval Research Laboratory Washington, DC 20375-5320 NRL/MR/60--08-955 EM6-MK2 Response of Standard Munitions Items H.H. Nelson Chemical Dynamics and Diagnostics Branch Chemistry Division T. Bell J. Kingdon
More informationAD NO. DTC PROJECT NO. 8-CO-160-UXO-021 REPORT NO. ATC STANDARDIZED UXO TECHNOLOGY DEMONSTRATION SITE BLIND GRID SCORING RECORD NO.
AD NO. DTC PROJECT NO. 8-CO-160-UXO-021 REPORT NO. ATC-10523 STANDARDIZED UXO TECHNOLOGY DEMONSTRATION SITE BLIND GRID SCORING RECORD NO. 926 SITE LOCATION: U.S. ARMY YUMA PROVING GROUND DEMONSTRATOR:
More informationUnderwater Munitions Response Technologies. Herb Nelson
Underwater Munitions Response Technologies Herb Nelson herbert.h.nelson10.civ@mail.mil 571-372-6400 DoD s Environmental Technology Programs Science and Technology Demonstration/Validation DoD, DOE, EPA
More informationAPPENDIX B RISK ASSESSMENT
APPENDIX B RISK ASSESSMENT APPENDIX B RISK ASSESSMENT This section presents the results of the munitions (MEC) risk assessment (RA) that addresses the explosive hazards associated with MEC in the Del Rey
More informationMain Menu. Summary: Introduction:
UXO Detection and Prioritization Using Combined Airborne Vertical Magnetic Gradient and Time-Domain Electromagnetic Methods Jacob Sheehan, Les Beard, Jeffrey Gamey, William Doll, and Jeannemarie Norton,
More informationSoftware-Intensive Systems Producibility
Pittsburgh, PA 15213-3890 Software-Intensive Systems Producibility Grady Campbell Sponsored by the U.S. Department of Defense 2006 by Carnegie Mellon University SSTC 2006. - page 1 Producibility
More informationSAFETY CASES: ARGUING THE SAFETY OF AUTONOMOUS SYSTEMS SIMON BURTON DAGSTUHL,
SAFETY CASES: ARGUING THE SAFETY OF AUTONOMOUS SYSTEMS SIMON BURTON DAGSTUHL, 17.02.2017 The need for safety cases Interaction and Security is becoming more than what happens when things break functional
More informationWide Area UXO Contamination Evaluation by Transect Magnetometer Surveys
NOVA RESEARCH, INC. 1900 Elkin Street, Suite 230 Alexandria, VA 22308 NOVA-2031-TR-0005 Wide Area UXO Contamination Evaluation by Transect Magnetometer Surveys Pueblo Precision Bombing and Pattern Gunnery
More informationWork Type Definition and Submittal Requirements Work Type: Subsurface Utility Engineering (SUE)
MUST be qualified under Minnesota Department of Transportation Prequalification Program - Work Type 15.1 Subsurface Utility Engineering The first section, Work Type Definition, provides a detailed explanation
More informationAgricultural Data Verification Protocol for the Chesapeake Bay Program Partnership
Agricultural Data Verification Protocol for the Chesapeake Bay Program Partnership December 3, 2012 Summary In response to an independent program evaluation by the National Academy of Sciences, and the
More informationTraining. Education CALENDAR FEDEGARI TECH CENTERS DM#407036
2016 CALENDAR COLLABORATION IN THE LIFE SCIENCES WORLD Valued customer, The need to increase efficiency and reliability in pharmaceutical manufacturing presents firms with unique opportunities to develop
More informationGeophysical Survey Rock Hill Bleachery TBA Site Rock Hill, South Carolina EP-W EPA, START 3, Region 4 TABLE OF CONTENTS Section Page Signature
Geophysical Survey Rock Hill Bleachery TBA Site Rock Hill, South Carolina EP-W-05-054 EPA, START 3, Region 4 Prepared for: Tetra Tech EM, Inc. October 12, 2012 Geophysical Survey Rock Hill Bleachery TBA
More informationGerald G. Boyd, Tom D. Anderson, David W. Geiser
THE ENVIRONMENTAL MANAGEMENT PROGRAM USES PERFORMANCE MEASURES FOR SCIENCE AND TECHNOLOGY TO: FOCUS INVESTMENTS ON ACHIEVING CLEANUP GOALS; IMPROVE THE MANAGEMENT OF SCIENCE AND TECHNOLOGY; AND, EVALUATE
More informationTier I Guidance. Environmental Technology Acceptance and Reciprocity Partnership. December 2000
Tier I Guidance Environmental Technology Acceptance and Reciprocity Partnership December 2000 Prepared by Member States of the Six-State Memorandum of Understanding Massachusetts Pennsylvania New Jersey
More informationOther Transaction Authority (OTA)
Other Transaction Authority (OTA) Col Christopher Wegner SMC/PK 15 March 2017 Overview OTA Legal Basis Appropriate Use SMC Space Enterprise Consortium Q&A Special Topic. 2 Other Transactions Authority
More informationResearch on the Capability Maturity Model of Digital Library Knowledge. Management
2nd Information Technology and Mechatronics Engineering Conference (ITOEC 2016) Research on the Capability Maturity Model of Digital Library Knowledge Management Zhiyin Yang1 2,a,Ruibin Zhu1,b,Lina Zhang1,c*
More informationPortable Electromagnetic Induction Sensor with Integrated Positioning MR-1712
Portable Electromagnetic Induction Sensor with Integrated Positioning MR-1712 Interim Report Submitted to Strategic Environmental Research and Development Program (SERDP) April 16, 2012 Revision 1.1 By
More informationEMIT. RF Cosite and Coexistence RFI Modeling and Mitigation
RF Cosite and Coexistence RFI Modeling and Mitigation EMIT provides a powerful new capability to the ANSYS RF Option. It is used to predict radio frequency interference (RFI) in complex environments containing
More informationJerome Tzau TARDEC System Engineering Group. UNCLASSIFIED: Distribution Statement A. Approved for public release. 14 th Annual NDIA SE Conf Oct 2011
LESSONS LEARNED IN PERFORMING TECHNOLOGY READINESS ASSESSMENT (TRA) FOR THE MILESTONE (MS) B REVIEW OF AN ACQUISITION CATEGORY (ACAT)1D VEHICLE PROGRAM Jerome Tzau TARDEC System Engineering Group UNCLASSIFIED:
More informationDevelopment of a Manufacturability Assessment Methodology and Metric
Development of a Assessment Methodology and Metric Assessment Knowledge-Based Evaluation MAKE Tonya G. McCall, Emily Salmon and Larry Dalton Intro and Background Methodology Case Study Overview Benefits
More informationInnovative Solutions Across the E&P Lifecycle. ACCESS EXPLORATION APPRAISAL DEVELOPMENT PRODUCTION
Innovative Solutions Across the E&P Lifecycle. ACCESS EXPLORATION APPRAISAL DEVELOPMENT PRODUCTION Innovative Solutions, from Access to Production Uncertainty Knowledge ACCESS EXPLORATION APPRAISAL DEVELOPMENT
More informationA Knowledge-Centric Approach for Complex Systems. Chris R. Powell 1/29/2015
A Knowledge-Centric Approach for Complex Systems Chris R. Powell 1/29/2015 Dr. Chris R. Powell, MBA 31 years experience in systems, hardware, and software engineering 17 years in commercial development
More informationMEC HA: A Tool in the Decision Making Toolbox
Munitions and Explosives of Concern - Hazard Assessment MEC HA: A Tool in the Decision Making Toolbox Teresa Carpenter Kari Meier, Ph.D. Environmental and Munitions Center of Expertise 23 June 2015 US
More informationThis is a preview - click here to buy the full publication
IEC/TR 80002-1 TECHNICAL REPORT Edition 1.0 2009-09 colour inside Medical device software Part 1: Guidance on the application of ISO 14971 to medical device software INTERNATIONAL ELECTROTECHNICAL COMMISSION
More informationPlanning and Organising Two
Planning and Organising Two Quality Assurance and Control Presenter Tony Bosnich 2015 Unitec New Zealand DEPARTMENT OF CONSTRUCTION Quality Learning outcomes 1. Define quality for a part of a project and
More informationFormer Maneuver Area A Remedial Investigation Fort Bliss, Texas. Public Meeting November 16, 2016
Former Maneuver Area A Remedial Investigation Fort Bliss, Texas Public Meeting November 16, 2016 Agenda Purpose Terminology Location and Use of Former Maneuver Area A Description of the Remedial Investigation
More informationTITLE V. Excerpt from the July 19, 1995 "White Paper for Streamlined Development of Part 70 Permit Applications" that was issued by U.S. EPA.
TITLE V Research and Development (R&D) Facility Applicability Under Title V Permitting The purpose of this notification is to explain the current U.S. EPA policy to establish the Title V permit exemption
More informationI Need Your Cost Estimate for a 10 Year Project by Next Week
I Need Your Cost Estimate for a 10 Year Project by Next Week A Case Study in Broad System Analysis: DoD Spectrum Reallocation Feasibility Study, 1755-1850 MHz Momentum From Industry & Response from Government
More informationQUANTITATIVE IMAGE TREATMENT FOR PDI-TYPE QUALIFICATION OF VT INSPECTIONS
QUANTITATIVE IMAGE TREATMENT FOR PDI-TYPE QUALIFICATION OF VT INSPECTIONS Matthieu TAGLIONE, Yannick CAULIER AREVA NDE-Solutions France, Intercontrôle Televisual inspections (VT) lie within a technological
More informationThis document is a preview generated by EVS
TECHNICAL REPORT IEC/TR 80002-1 Edition 1.0 2009-09 colour inside Medical device software Part 1: Guidance on the application of ISO 14971 to medical device software IEC/TR 80002-1:2009(E) THIS PUBLICATION
More informationWelcome Thanks for joining us. ITRC s Internet-based Training Program. Survey of Munitions Response Technologies
1 Welcome Thanks for joining us. ITRC s Internet-based Training Program Survey of Munitions Response Technologies Survey of Munitions Response Technologies (UXO-4, 2006) This training is co-sponsored by
More informationWorkshop on Census Data Processing Doha, Qatar 18-22/05/2008
Palestinian National Authority Palestinian Central Bureau of Statistics United Nations Statistics Division (UNSD) Economic and Social Commission for Western Asia (ESCWA) Workshop on Census Data Processing
More informationVariable-depth streamer acquisition: broadband data for imaging and inversion
P-246 Variable-depth streamer acquisition: broadband data for imaging and inversion Robert Soubaras, Yves Lafet and Carl Notfors*, CGGVeritas Summary This paper revisits the problem of receiver deghosting,
More informationLessons Learned in Integrating Risk Management and Process Validation
Lessons Learned in Integrating Risk Management and Process Validation Medical Device Congress Harvard March 2007 Jim Handzo Senior Manager QA Innovative Spinal Technologies Fran Akelewicz Principal Practical
More informationG003 Data Preprocessing and Starting Model Preparation for 3D Inversion of Marine CSEM Surveys
G003 Data Preprocessing and Starting Model Preparation for 3D Inversion of Marine CSEM Surveys J.J. Zach* (EMGS ASA), F. Roth (EMGS ASA) & H. Yuan (EMGS Americas) SUMMARY The marine controlled-source electromagnetic
More informationMaking your ISO Flow Flawless Establishing Confidence in Verification Tools
Making your ISO 26262 Flow Flawless Establishing Confidence in Verification Tools Bryan Ramirez DVT Automotive Product Manager August 2015 What is Tool Confidence? Principle: If a tool supports any process
More informationGE105: Introduction to Engineering Design The Engineering Profession
GE105: Introduction to Engineering Design The Engineering Profession Dr. Mohammed A. Khamis December 18, 2016 What is Engineering? Engineering is a profession like medicine, law, etc. that aspires to high
More informationStatement of Qualifications
Revised January 29, 2011 ClearView Geophysics Inc. 12 Twisted Oak Street Brampton, ON L6R 1T1 Canada Phone: (905) 458-1883 Fax: (905) 792-1884 general@geophysics.ca www.geophysics.ca 1 1. Introduction
More informationHere the goal is to find the location of the ore body, and then evaluate its size and depth.
Geophysics 223 March 2009 D3 : Ground EM surveys over 2-D resistivity models D3.1 Tilt angle measurements In D2 we discussed approaches for mapping terrain conductivity. This is appropriate for many hydrogeology
More informationModel-Based Sensor Design Optimization for UXO Classification
Model-Based Sensor Design Optimization for UXO Classification Robert E. Grimm and Thomas A. Sprott Blackhawk GeoServices, 301 B Commercial Rd., Golden CO 80401 Voice 303-278-8700; Fax 303-278-0789; Email
More informationJOHANN CATTY CETIM, 52 Avenue Félix Louat, Senlis Cedex, France. What is the effect of operating conditions on the result of the testing?
ACOUSTIC EMISSION TESTING - DEFINING A NEW STANDARD OF ACOUSTIC EMISSION TESTING FOR PRESSURE VESSELS Part 2: Performance analysis of different configurations of real case testing and recommendations for
More informationBy the end of this chapter, you should: Understand what is meant by engineering design. Understand the phases of the engineering design process.
By the end of this chapter, you should: Understand what is meant by engineering design. Understand the phases of the engineering design process. Be familiar with the attributes of successful engineers.
More informationViolent Intent Modeling System
for the Violent Intent Modeling System April 25, 2008 Contact Point Dr. Jennifer O Connor Science Advisor, Human Factors Division Science and Technology Directorate Department of Homeland Security 202.254.6716
More informationFiscal 2007 Environmental Technology Verification Pilot Program Implementation Guidelines
Fifth Edition Fiscal 2007 Environmental Technology Verification Pilot Program Implementation Guidelines April 2007 Ministry of the Environment, Japan First Edition: June 2003 Second Edition: May 2004 Third
More informationSEAM Pressure Prediction and Hazard Avoidance
Announcing SEAM Pressure Prediction and Hazard Avoidance 2014 2017 Pore Pressure Gradient (ppg) Image courtesy of The Leading Edge Image courtesy of Landmark Software and Services May 2014 One of the major
More informationJacek Stanisław Jóźwiak. Improving the System of Quality Management in the development of the competitive potential of Polish armament companies
Jacek Stanisław Jóźwiak Improving the System of Quality Management in the development of the competitive potential of Polish armament companies Summary of doctoral thesis Supervisor: dr hab. Piotr Bartkowiak,
More informationCHAPTER 20 CRYPTOLOGIC TECHNICIAN (CT) NAVPERS C CH-72
CHAPTER 20 CRYPTOLOGIC TECHNICIAN (CT) NAVPERS 18068-20C CH-72 Updated: October 2017 TABLE OF CONTENTS CRYPTOLOGIC TECHNICIAN (INTERPRETIVE) (CTI) SCOPE OF RATING GENERAL INFORMATION LANGUAGE ANALYST OPERATOR
More informationAD NO. DTC PROJECT NO. 8-CO-160-UXO-021 REPORT NO. ATC-9106 STANDARDIZED UXO TECHNOLOGY DEMONSTRATION SITE WOODS SCORING RECORD NO.
AD NO. DTC PROJECT NO. 8-CO-160-UXO-021 REPORT NO. ATC-9106 STANDARDIZED UXO TECHNOLOGY DEMONSTRATION SITE WOODS SCORING RECORD NO. 381 SITE LOCATION: U.S. ARMY ABERDEEN PROVING GROUND DEMONSTRATOR: GEOPHYSICAL
More informationUnexploded ordnance (UXO) contamination is a high-priority problem for the Department of Defense (DoD). As
H.H. Nelson 1 and J.R. McDonald 2 1 Chemistry Division 2 AETC, Inc. Airborne Magnetometry Surveys for Detection of Unexploded Ordnance Unexploded ordnance (UXO) contamination is a high-priority problem
More information