Active and Passive Acoustic Detection, Classification and Recognition with the Hopkins Acoustic Surveillance Unit (HASU)

Transcription

1 Active and Passive Acoustic Detection, Classification and Recognition with the Hopkins Acoustic Surveillance Unit (HASU) Andreas G. Andreou Electrical and Computer Engineering and Center for Language and Speech Processing Johns Hopkins University

2 What is the Problem? Is there something interesting in the environment? detection in a specific class of objects Where is it? localization What is it? identification/recognition it is all about a few bits in the right place at the right time!

3 Computational Sensors and Memories Conventional Processing in Sensor Networks: Sensor Sensor Encoder and Transmitter Encoder and Transmitter Channel Receiver and Decoder Information Extraction Distributed Information Extraction (JHU Approach) Sensor Information Extraction Encoder and Transmitter Sensor Information Extraction Encoder and Transmitter Channel Receiver and Decoder reduced bandwidth requirements reduced power dissipation and form factor trade-off between complexity/power of integrated processing

4 JHU Acoustic Surveillance Unit (JHU-ASU) Localization display Unattended ground sensor Battery powered Small form factor (3 in diameter) Target detection and localization Micropower ASICs developed at Hopkins Wake-up detector Cross-correlation localizer Gradient flow localizer Wireless communication interface COTS Mica2 programmable interface (Xbow technologies) Wake-up activated for low power Mica2 wireless interface JHU-ASU

5 Passive Acoustic Sensing

6 Smart Microphone Integrated Prototype 4 chamber acoustic horn Cross-Correlation ASIC Gradient Flow ASIC Auto-Correlation Wake-Up ASIC Analog Sensor Data (test) & RS-232 Contact Reports Power Strobe Circuit 4 MEMs Microphones

7 Integrated Optoelectronic Readout Interface for Acoustic and Vibration Sensors Chip-scale Fabry-Perot Interferometer

8 Smart Microphone Power Budget Power Budget to Meet 9.5 Month Endurance on 4 AA Batteries Component Power 100% Duty Cycle Notes Budget Actual included in integrated prototype Microphone & Signal Cond /3.84 Power Strobe Micro-controller >9* *New controller Auto-Corr Wake-Up Pk Periodicity Wake Up.015 N/A mw on test board Gradient Flow Cross-Correlator Cochlea Bearing Est 3.7 N/A 3.7 meas on test board Clocks/Bias/Additional Amps Totals > 8* *Low power clocks and redo biases 10.9 (cochlea only) 58/60 -> = 6.5 month endurance (2.0 mw)

9 ACF Wake-Up Detector Architecture Even select (20 bits) Even ACF register (20x10 bits) ACC ACC ACC ACC [0] [2] [36] [38] Even ACF value (10 bits) XNOR XNOR XNOR XNOR Audio input (1 bit) INP [0] INP [2] INP [36] INP [38] INP [40] INP [50] Input shift register (52x1 bits) INP [1] INP [3] INP [37] INP [39] INP [41] INP [51] XNOR XNOR XNOR XNOR Odd ACF register (20x10 bits) Odd select (20 bits) ACC ACC ACC ACC [1] [3] [37] [39] Even ACF value (10 bits) Odd ACF value (10 bits) ABS DIFF Periodicity measure ACC (16 bits) COMP Threshold (16 bits) Odd ACF value (10 bits) Detect? (1 bit)

10 ACF Wake-Up Detector Algorithm A signal with periodic content has a bumpy autocorrelation function (ACF). Compute ACF over a range of time lags corresponding to the frequency range of interest. Compute the power of the derivative of the ACF---a bumpiness measure. Use the ACF derived from a 1-bit version of the signal : Replace multiplication with XNOR. Eliminate normalization, because the 1-bit signal is insensitive to amplitude. ~ R ~~ xx K 1 k 0 n ~ x n ~ x k n For the power of the derivative, replace squaring with absolute value: PM N max n N min ~ R ~~ xx ~ n 1 R~~ n xx

11 2 Gradient Flow Localization s( t ) t s (t) t s(t) Gradient flow bearing resolution is fundamentally independent of aperture Resolution is determined by sensitivity of gradient acquisition Mechanical differential coupling (Miles et al.) Optical differential coupling (Degertekin) Analog VLSI differential coupling d dt s ( t) s ( t) 1 s ( t) 2

12 Gradient Flow System Diagram Analog inputs x -10 x 01 x 10 Average, temporal derivative, and spatial gradient estimates Spatial gradients with suppressed common-mode Digital estimated delays x 0-1.

13 Broadband Bearing Estimation Architecture Maximum detector 1 bit A/D Mic2 u 2 (t) 0/1 z -1 z -1 Mic1 u 1 (t) 0/1 z -1 z stages α stages α 0

14 ACF Wake-Up Detector ASIC Fully functional Core power consumption: 0.8 uw Total power consumption: 6.3 uw

15 ACF Detector and BBB Estimator Chip 2.9 x 2.4 mm Die TSMC M2P 165,000 Transistors ACF Detector (1.25 x 0.6) mm BBB Estimator (2 x 2) mm XTAL Oscillator + Preamplifier (0.6 x 0.3) mm ACF Detector BroadBand Bearing Estimator

16 ACF Wake-Up Detector Simulation GV2A1078 GV3C1090 Ambient Lag (samples) Lag (samples) Lag (samples) Time (sec) Time (sec) Time (sec) Periodicity measure 10 3 Periodicity measure 10 3 Periodicity measure Time (sec) Time (sec) Time (sec)

17 ACF Wake-Up Detector Field Results Ambient noise Stimulus amb stim Frequency 150 Frequency Tim e No detection Detection Time No detection SNR: 25 db SNR: 12 db Minimum SNR for Detection: db (1 Hz Band) Pre-whitening filter needed for increased sensitivity

18 Acoustic Surveillance Unit Bearing Accuracy Field Test (Severna Park, MD) 10 2 GadF NB Bias GradF NB StdDev XCor NB Bias XCor NB StdDev Chip Avg Bias Avg Std Dev Error (Deg) 10 1 GradFlow 5.7º 1.2º X-Corr 4.0º.79º Angle of Arrival (Deg) Bias likely due to: - ambient noise, - electrical phase distortion, - non-uniform placement of phase centers

19 Spesutie Island Oval (Aberdeen Proving Grounds, MD) 108m Node V1 (N) M60 mid speed 662m V1 97m 132m206mV3 ASU #2, UGS AWS Node V2 (S) 88m V2 133m 80m ASU#3, AWS BS HEMET mid speed ASU#1 AWS, PC Base Station tent Network Fusion PC w/ three B vs T and Geoplot Display Colors Blue - Target Ground Truth Bearing Green - Analog bearings Red GF bearings Light Blue XC bearings

20 Ft. Devens field test (August 2005) Organized by BAE/Honeywell under MASINT Opportunity to field test JHU-HASU hardware and collect data for further experiments

21 Chevrolet Malibu 40 mph model data

22 Active Acoustic Sensing

23 Acoustic u-doppler sonar

24 Acoustic Attenuation in Air Ax ( ) Aexp( x) o 2 air : f db m 10 1 H.E. Bass et al, Atmospheric absorption of sound: Update, JASA, 1990.

25 COTS Transducers Frequency (khz) Maximum Detection (m)* 0% Humidity 50% Humidity Manufacturer Murata Murata Panasonic ITC ITC ITC ITC *Maximum detection is an approximate number based on a simple S/N calculation.

26 Sensing Principle V fo f 60 cm 30 cm 2v fo 2 f f o Transducer

27 Volunteer 1: Walking Towards CWAR (Hz) (s) December 2005

28 Volunteer 2: Walking Away From CWAR

29 Miniature Pinscher, 9.5lbs

30 American Pitbull

31 Horse of unknown breed

32 Classification preliminary results- Model: Gaussian Mixture Model Feature vectors: Cepstral vectors + differential cepstral vectors Decision rule: Maximum likelihood Input: 20 signatures from 8 people 50% for training, 50% for classification

33 Results (Direct Sampling)

34 Results (Bandpass Sampling)

35 Results: 14bit vs 8bit in Bandpass Sampling

36 In this project we will develop a cognitive acoustic scene analysis system that is able to synthesize composite representations of animate entities and their behaviour by integrating information from active and passive sound signatures; i.e. from actively self-generated (sonar) sounds and from passively received sounds emitted by those entities.