Efficient Estimation of CFA Pattern Configuration in Digital Camera Images

Similar documents
IDENTIFYING DIGITAL CAMERAS USING CFA INTERPOLATION

IMPROVEMENTS ON SOURCE CAMERA-MODEL IDENTIFICATION BASED ON CFA INTERPOLATION

Camera identification from sensor fingerprints: why noise matters

Camera Model Identification Framework Using An Ensemble of Demosaicing Features

Source Camera Model Identification Using Features from contaminated Sensor Noise

Color image Demosaicing. CS 663, Ajit Rajwade

Image Tampering Localization via Estimating the Non-Aligned Double JPEG compression

A Novel Method for Enhancing Satellite & Land Survey Images Using Color Filter Array Interpolation Technique (CFA)

Revisiting Weighted Stego-Image Steganalysis

Applying the Sensor Noise based Camera Identification Technique to Trace Origin of Digital Images in Forensic Science

SOURCE CAMERA IDENTIFICATION BASED ON SENSOR DUST CHARACTERISTICS

Digital Imaging with the Nikon D1X and D100 cameras. A tutorial with Simon Stafford

Digital Cameras The Imaging Capture Path

CS 365 Project Report Digital Image Forensics. Abhijit Sharang (10007) Pankaj Jindal (Y9399) Advisor: Prof. Amitabha Mukherjee

Edge Potency Filter Based Color Filter Array Interruption

Exposing Digital Forgeries from JPEG Ghosts

Fragile Sensor Fingerprint Camera Identification

Digital photography , , Computational Photography Fall 2017, Lecture 2

Linear Filter Kernel Estimation Based on Digital Camera Sensor Noise

ity Multimedia Forensics and Security through Provenance Inference Chang-Tsun Li

Forgery Detection using Noise Inconsistency: A Review

Survey On Passive-Blind Image Forensics

DIGITAL CAMERA SENSORS

Detection of Hue Modification Using Photo Response Non-Uniformity

Image acquisition. In both cases, the digital sensing element is one of the following: Line array Area array. Single sensor

Image Demosaicing. Chapter Introduction. Ruiwen Zhen and Robert L. Stevenson

Camera Requirements For Precision Agriculture

Topic 9 - Sensors Within

Digital photography , , Computational Photography Fall 2018, Lecture 2

Introduction to Digital Photography

Imaging Sensor Noise as Digital X-Ray for Revealing Forgeries

Camera Image Processing Pipeline

Spatially Varying Color Correction Matrices for Reduced Noise

Simultaneous Capturing of RGB and Additional Band Images Using Hybrid Color Filter Array

Filters. Materials from Prof. Klaus Mueller

AN EFFECTIVE APPROACH FOR IMAGE RECONSTRUCTION AND REFINING USING DEMOSAICING

Camera Requirements For Precision Agriculture

Moving Object Detection for Intelligent Visual Surveillance

Digital Imaging Group. 20th June Working at the High End

Noise Reduction in Raw Data Domain

Demosaicing and Denoising on Simulated Light Field Images

HDR videos acquisition

Artifacts Reduced Interpolation Method for Single-Sensor Imaging System

Analysis on Color Filter Array Image Compression Methods

4.5.1 Mirroring Gain/Offset Registers GPIO CMV Snapshot Control... 14

A CAMERA IS A LIGHT TIGHT BOX

Forensic Framework. Attributing and Authenticating Evidence. Forensic Framework. Attribution. Forensic source identification

Detection of Misaligned Cropping and Recompression with the Same Quantization Matrix and Relevant Forgery

Lecture 29: Image Sensors. Computer Graphics and Imaging UC Berkeley CS184/284A

2018 IEEE Signal Processing Cup: Forensic Camera Model Identification Challenge

Different-quality Re-demosaicing in Digital Image Forensics

VISUAL sensor technologies have experienced tremendous

CERIAS Tech Report Forensic characterization of image capture devices by Nitin Khanna Center for Education and Research Information Assurance

Multi-sensor Super-Resolution

EMVA1288 compliant Interpolation Algorithm

Source Camera Identification Forensics Based on Wavelet Features

Watermark Embedding in Digital Camera Firmware. Peter Meerwald, May 28, 2008

PROCESSING X-TRANS IMAGES IN IRIDIENT DEVELOPER SAMPLE

Laser Printer Source Forensics for Arbitrary Chinese Characters

Distinguishing between Camera and Scanned Images by Means of Frequency Analysis

Can We Trust Digital Image Forensics?

Goal of this Section. Capturing Reflectance From Theory to Practice. Acquisition Basics. How can we measure material properties? Special Purpose Tools

Multimedia Forensics

Method of color interpolation in a single sensor color camera using green channel separation

Improvements of Demosaicking and Compression for Single Sensor Digital Cameras

The Raw Deal Raw VS. JPG

in association with Getting to Grips with Printing

OVER the past couple of years, digital imaging has matured

IMAGE RESTORATION WITH NEURAL NETWORKS. Orazio Gallo Work with Hang Zhao, Iuri Frosio, Jan Kautz

Introduction to DSP ECE-S352 Fall Quarter 2000 Matlab Project 1

Design and Simulation of Optimized Color Interpolation Processor for Image and Video Application

Detection of Image Forgery was Created from Bitmap and JPEG Images using Quantization Table

Forensic Classification of Imaging Sensor Types

Double resolution from a set of aliased images

DIGITAL IMAGING. 10 weeks

Software & Computers DxO Optics Pro 5.3; Raw Converter & Image Enhancer With Auto Or Manual Transmission By Howard Millard March, 2009

MODULE No. 34: Digital Photography and Enhancement

Demosaicing Algorithms

Tamper Hiding: Defeating Image Forensics

Colour-Decoupled Photo Response Non-Uniformity for. Digital Image Forensics

Getting the Basics Right

Camera Image Processing Pipeline: Part II

Image Interpolation. Image Processing

Research Article Discrete Wavelet Transform on Color Picture Interpolation of Digital Still Camera

IMAGE TAMPERING DETECTION BY EXPOSING BLUR TYPE INCONSISTENCY. Khosro Bahrami and Alex C. Kot

Megapixels and more. The basics of image processing in digital cameras. Construction of a digital camera

Using raw files from digital cameras

COLOR IMAGE STEGANANALYSIS USING CORRELATIONS BETWEEN RGB CHANNELS. 1 Nîmes University, Place Gabriel Péri, F Nîmes Cedex 1, France.

Genuine Fractals 4.1 Evaluation Guide

Chapter 4: Image Transfer Choosing a Computer

Evaluating Commercial Scanners for Astronomical Images. The underlying technology of the scanners: Pixel sizes:

arxiv: v1 [cs.cv] 15 Mar 2017

Digital images. Digital Image Processing Fundamentals. Digital images. Varieties of digital images. Dr. Edmund Lam. ELEC4245: Digital Image Processing

Color Filter Array Interpolation Using Adaptive Filter

Introduction to Video Forgery Detection: Part I

High Performance Imaging Using Large Camera Arrays

Lecture 30: Image Sensors (Cont) Computer Graphics and Imaging UC Berkeley CS184/284A

How does prism technology help to achieve superior color image quality?

TECHNICAL DOCUMENTATION

IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 15, NO. 1, JANUARY Sina Farsiu, Michael Elad, and Peyman Milanfar, Senior Member, IEEE

Transcription:

Faculty of Computer Science Institute of Systems Architecture, Privacy and Data Security esearch roup Efficient Estimation of CFA Pattern Configuration in Digital Camera Images Electronic Imaging 2010 Media Forensics and Security II Matthias Kirchner Technische Universität Dresden San Jose, CA, 2010/01/18

CFA Interpolation typical digital cameras use only one CCD / CMOS sensor and a color filter array (CFA) to capture full-color images missing color information is estimated from surrounding genuine elements in the raw image B B B B AW image full-color image CFA interpolation / demosaicing Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 1 of 15

CFA Interpolation typical digital cameras use only one CCD / CMOS sensor and a color filter array (CFA) to capture full-color images missing color information is estimated from surrounding genuine elements in the raw image B B B B AW image full-color image demosaiced images exhibit specific inter-pixel correlation artifacts CFA interpolation / demosaicing Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 1 of 15

CFA Artifacts in Digital Image Forensics double compression make use of image statistics for identification of source device or detection of manipulations block artifacts copy & paste resampling artifacts image forensics sensor dust sensor noise lightning, shadows lens distortions CFA pattern color filter array (CFA) interpolation artifacts form an important class of device characteristics source identification different camera models use different interpolation procedures manipulation detection post-processing damages characteristic inter-pixel correlation pattern Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 2 of 15

CFA Artifacts in Digital Image Forensics double compression make use of image statistics for identification of source device or detection of manipulations block artifacts copy & paste resampling artifacts image forensics sensor dust sensor noise lightning, shadows lens distortions CFA pattern color filter array (CFA) interpolation artifacts form an important class of device characteristics source identification different camera models use different interpolation procedures manipulation detection post-processing damages characteristic inter-pixel correlation pattern applications in steganalysis or digital watermarking Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 2 of 15

Example Application [Popescu & Farid, 2005] periodic artifacts in the linear predictor residue (p-map) Dresden Palace, image is part of the Dresden Image Database [loe & Böhme, 2010]

Example Application [Popescu & Farid, 2005] periodic artifacts in the linear predictor residue (p-map) Dresden Palace, image is part of the Dresden Image Database [loe & Böhme, 2010]

Example Application [Popescu & Farid, 2005] periodic artifacts in the linear predictor residue (p-map) DFT(p-map) CFA peak Dresden Palace, image is part of the Dresden Image Database [loe & Böhme, 2010]

CFA Pattern Configuration early methods did not explicitly incorporate knowledge about the actual configuration of the CFA pattern [Popescu & Farid, 2005; Bayram et al, 2005] problem of periodic, but locally inconsistent inter-pixel correlation CFA configuration valuable both for source identification [Swaminathan et al., 2007] and manipulation detection [Dirik et al., 2009] generally a means to decrease the degrees of freedom in image forensics B B B B AW image full-color image CFA configuration B B B B CFA interpolation / demosaicing? forensic examination Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 4 of 15

[Swaminathan et al., 2007; Dirik et al., 2009] CFA Configuration Estimation in the Literature minimum re-interpolation error assumption x y C for CFA configuration C and the demosaicing function d d(x, C) Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 5 of 15

[Swaminathan et al., 2007; Dirik et al., 2009] CFA Configuration Estimation in the Literature minimum re-interpolation error assumption x y C d(x, C) for CFA configuration C and the demosaicing function d d 1 (y C, ) C 1 C2 C 3 C 4 Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 5 of 15

[Swaminathan et al., 2007; Dirik et al., 2009] CFA Configuration Estimation in the Literature minimum re-interpolation error assumption x y C d(x, C) for CFA configuration C and the demosaicing function d d d 1 (y C, ), C 1 C2 C 3 C 4 Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 5 of 15

[Swaminathan et al., 2007; Dirik et al., 2009] CFA Configuration Estimation in the Literature minimum re-interpolation error assumption x d(x, C) y C C = arg min for CFA configuration C and the demosaicing function d yc d d 1 (y C, ), C 1 C2 C 3 C 4 e Ci Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 5 of 15

[Swaminathan et al., 2007; Dirik et al., 2009] CFA Configuration Estimation in the Literature minimum re-interpolation error assumption x d(x, C) y C C = arg min for CFA configuration C and the demosaicing function d yc d d 1 (y C, ), C 1 C2 C 3 C 4 e Ci subsampling matrix S Ci as simple approximation of inverse demosaicing d 1 (y, ) = S Ci y Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 5 of 15

[Swaminathan et al., 2007; Dirik et al., 2009] CFA Configuration Estimation in the Literature minimum re-interpolation error assumption x d(x, C) y C C = arg min for CFA configuration C and the demosaicing function d yc d d 1 (y C, ), C 1 C2 C 3 C 4 e Ci subsampling matrix S Ci as simple approximation of inverse demosaicing d 1 (y, ) = S Ci y assume linear relationship between raw and interpolated pixels d(x, ) = H Ci x Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 5 of 15

An Alternative Approach assume that we actually know the genuine raw sensor output x d(x, C) y C C 1 C2 C 3 C 4 x C = arg min d 1 (y C, ) d 1 (y, ) = S Ci y subsampling matrix S Ci as simple approximation of inverse demosaicing re-interpolation for each possible configuration not necessary Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 6 of 15

CFA Pattern Synthesis [Kirchner & Böhme, 2009] basic idea find a possible sensor signal x such that following the linearity assumption this is an ordinary least squares (OLS) problem y C d( x, C) 2 min y C = H C x + ɛ x C = (H C H C) 1 H C y Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 7 of 15

CFA Pattern Synthesis [Kirchner & Böhme, 2009] basic idea find a possible sensor signal x such that following the linearity assumption this is an ordinary least squares (OLS) problem y C d( x, C) 2 min y C = H C x + ɛ x C = (H C H C) 1 H C y caveat for a N-pixel image, H s of dimension 3N N direct implementation of the OLS solution not tractable efficiency improvements H s typically sparse (finite filter support) and of regular structure (periodic CFA) H C 3N Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 7 of 15

CFA Pattern Synthesis [Kirchner & Böhme, 2009] basic idea find a possible sensor signal x such that following the linearity assumption this is an ordinary least squares (OLS) problem y C d( x, C) 2 min y C = H C x + ɛ x C = (H C H C) 1 H C y caveat for a N-pixel image, H s of dimension 3N N direct implementation of the OLS solution not tractable efficiency improvements H s typically sparse (finite filter support) and of regular structure (periodic CFA) analytical solution for the bilinear interpolation kernel H C 3N Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 7 of 15

Approximate Solution by considering an infinite image without border conditions, approximate solutions in terms of a channel-dependent fixed linear filter can be found [Kirchner & Böhme, 2009] 2 F () y () 3 6 x Ci S Ci (Fy) = S Ci 4F () y () 7 5 F (B) y (B) equivalent to the analytical solution for large enough filter kernels Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 8 of 15

Approximate Solution by considering an infinite image without border conditions, approximate solutions in terms of a channel-dependent fixed linear filter can be found [Kirchner & Böhme, 2009] 2 F () y () 3 6 x Ci S Ci (Fy) = S Ci 4F () y () 7 5 F (B) y (B) equivalent to the analytical solution for large enough filter kernels application to the CFA configuration estimation problem C = arg min x Ci S Ci y 2 process image with linear CFA synthesis filters sub-sample image and filtered image to CFA pattern calculate difference between both only one linear filtering operation Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 8 of 15

Approximate Solution by considering an infinite image without border conditions, approximate solutions in terms of a channel-dependent fixed linear filter can be found [Kirchner & Böhme, 2009] 2 F () y () 3 6 x Ci S Ci (Fy) = S Ci 4F () y () 7 5 F (B) y (B) equivalent to the analytical solution for large enough filter kernels application to the CFA configuration estimation problem C = arg min x Ci S Ci y 2 process image with linear CFA synthesis filters sub-sample image and filtered image to CFA pattern calculate difference between both only one linear filtering operation our assumptions: Bayer CFA pattern bilinear interpolation continuous solution Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 8 of 15

efinements to the Estimation Procedure CFA configuration can be best determined for the green channel elements (twice as much genuine sensor pixels) C () Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 9 of 15

efinements to the Estimation Procedure CFA configuration can be best determined for the green channel elements (twice as much genuine sensor pixels) two-stage approach: decision for the complete configuration conditional to the estimated green channel configuration C () C Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 9 of 15

efinements to the Estimation Procedure CFA configuration can be best determined for the green channel elements (twice as much genuine sensor pixels) two-stage approach: decision for the complete configuration conditional to the estimated green channel configuration locally large error terms can accumulate to overall wrong decision C () C Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 9 of 15

efinements to the Estimation Procedure CFA configuration can be best determined for the green channel elements (twice as much genuine sensor pixels) two-stage approach: decision for the complete configuration conditional to the estimated green channel configuration locally large error terms can accumulate to overall wrong decision block-based approach: majority voting over all non-overlapping 2 2 blocks count C () C Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 9 of 15

Experimental Setup test database derived from 1000 full-resolution digital camera images from the Dresden Image Database [loe & Böhme, 2010] JPE AW TIFF...... TIFF JPE QUAL1... JPE QUALn JPE QUAL1... JPE QUALn Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 10 of 15

Experimental Setup test database derived from 1000 full-resolution digital camera images from the Dresden Image Database [loe & Böhme, 2010] JPE each 1000 images AW 5 different camera models with combined JPE / AW output Nikon D200 (1) Nikon D70/s (each 1) Panasonic DMC-FZ750 (3) icoh X100 (2) TIFF...... TIFF JPE QUAL1... JPE QUALn JPE QUAL1... JPE QUALn Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 10 of 15

Experimental Setup test database derived from 1000 full-resolution digital camera images from the Dresden Image Database [loe & Böhme, 2010] JPE JPE QUAL1 TIFF... JPE QUALn each 1000 images AW...... TIFF JPE QUAL1... JPE QUALn 5 different camera models with combined JPE / AW output Nikon D200 (1) Nikon D70/s (each 1) Panasonic DMC-FZ750 (3) icoh X100 (2) AW images demosaiced using Adobe Lightroom and dcraw 4 interpolation procedures: bilinear, VN, AHD, L Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 10 of 15

Experimental Setup test database derived from 1000 full-resolution digital camera images from the Dresden Image Database [loe & Böhme, 2010] JPE JPE QUAL1 TIFF... JPE QUALn each 1000 images AW...... TIFF JPE QUAL1... JPE QUALn 5 different camera models with combined JPE / AW output Nikon D200 (1) Nikon D70/s (each 1) Panasonic DMC-FZ750 (3) icoh X100 (2) AW images demosaiced using Adobe Lightroom and dcraw 4 interpolation procedures: bilinear, VN, AHD, L JPE compression with varying quality factors after demosacing Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 10 of 15

round Truth in our Experiments experimental evaluation requires ground truth CFA configurations not explicitly known for the cameras in use EXIF data not necessarily contains this information sensor datasheets are unreliable (active vs. effective pixels) CFA pattern becomes visible in the raw data of almost blue / red scences raw data Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 11 of 15

round Truth in our Experiments experimental evaluation requires ground truth CFA configurations not explicitly known for the cameras in use EXIF data not necessarily contains this information sensor datasheets are unreliable (active vs. effective pixels) CFA pattern becomes visible in the raw data of almost blue / red scences raw data Lightroom images (and genuine camera images) are smaller than dcraw images synchronization by maximum cross-correlation over all possible crops of the larger image Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 11 of 15

Baseline esults Percentage of correctly determined configurations D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C bilinear interpolation e Ci (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (total) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (block) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 VN interpolation e Ci (total) 88.8 88.8 97.4 97.4 95.1 95.1 97.7 97.7 99.0 99.0 96.3 96.3 (total) 64.8 64.8 80.8 80.8 83.4 83.4 94.2 94.2 96.4 96.4 87.6 87.6 (block) 97.7 97.7 100 100 98.2 98.2 99.2 99.2 99.8 99.8 99.1 99.1 AHD interpolation e Ci (total) 95.0 91.1 96.2 71.8 96.9 59.5 98.8 98.4 99.3 97.8 97.9 89.3 C (total) i 86.0 81.6 88.5 66.7 93.3 66.9 98.4 98.1 98.6 97.1 95.0 88.1 C (block) i 100 98.9 100 94.9 100 96.9 99.2 99.2 100 99.8 99.8 98.7 Adobe Lightroom e Ci (total) 87.7 39.1 100 57.7 100 67.5 98.8 65.0 97.8 80.4 96.9 66.5 (total) 98.9 46.4 100 71.8 100 78.5 100 66.9 99.3 83.1 99.5 71.8 (block) 97.2 82.7 100 97.4 100 94.5 100 77.0 97.6 94.0 98.6 88.5

Baseline esults Percentage of correctly determined configurations D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C bilinear interpolation e Ci (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (total) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (block) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 i e VN interpolation Ci (total) re-interpolation with bilinear kernel e Ci (total) 88.8 88.8 97.4 97.4 [Dirik 95.1et 95.1 al., 2009] 97.7 97.7 99.0 99.0 96.3 96.3 C (total) i 64.8 64.8 ec d 1 (total) 80.8 80.8 CFA 83.4 synthesis, 83.4 94.2 global 94.2 decision 96.4 96.4 i 87.6 87.6 C (block) i 97.7 97.7 e 100 100 C d 1 (block) i CFA 98.2 synthesis, 98.2 99.2 block 99.2 decision 99.8 99.8 99.1 99.1 AHD interpolation e Ci (total) 95.0 91.1 96.2 71.8 96.9 59.5 98.8 98.4 99.3 97.8 97.9 89.3 C (total) i 86.0 81.6 88.5 66.7 93.3 66.9 98.4 98.1 98.6 97.1 95.0 88.1 C (block) i 100 98.9 100 94.9 100 96.9 99.2 99.2 100 99.8 99.8 98.7 Adobe Lightroom e Ci (total) 87.7 39.1 100 57.7 100 67.5 98.8 65.0 97.8 80.4 96.9 66.5 (total) 98.9 46.4 100 71.8 100 78.5 100 66.9 99.3 83.1 99.5 71.8 (block) 97.2 82.7 100 97.4 100 94.5 100 77.0 97.6 94.0 98.6 88.5

Baseline esults Percentage of correctly determined configurations D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C bilinear interpolation e Ci (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (total) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (block) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 VN interpolation e Ci (total) 88.8 88.8 97.4 97.4 95.1 95.1 97.7 97.7 99.0 99.0 96.3 96.3 (total) 64.8 64.8 80.8 80.8 83.4 83.4 94.2 94.2 96.4 96.4 87.6 87.6 (block) 97.7 97.7 100 100 98.2 98.2 99.2 99.2 99.8 99.8 99.1 99.1 AHD interpolation e Ci (total) 95.0 91.1 96.2 71.8 96.9 59.5 98.8 98.4 99.3 97.8 97.9 89.3 C (total) i 86.0 81.6 88.5 66.7 93.3 66.9 98.4 98.1 98.6 97.1 95.0 88.1 C (block) i 100 98.9 100 94.9 100 96.9 99.2 99.2 100 99.8 99.8 98.7 Adobe Lightroom e Ci (total) 87.7 39.1 100 57.7 100 67.5 98.8 65.0 97.8 80.4 96.9 66.5 (total) 98.9 46.4 100 71.8 100 78.5 100 66.9 99.3 83.1 99.5 71.8 (block) 97.2 82.7 100 97.4 100 94.5 100 77.0 97.6 94.0 98.6 88.5

Baseline esults Percentage of correctly determined configurations D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C bilinear interpolation e Ci (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 i green channel configuration can be determined most reliably C (block) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 i VN interpolation e Ci (total) 88.8 88.8 97.4 97.4 95.1 95.1 97.7 97.7 99.0 99.0 96.3 96.3 (total) 64.8 64.8 80.8 80.8 83.4 83.4 94.2 94.2 96.4 96.4 87.6 87.6 (block) 97.7 97.7 100 100 98.2 98.2 99.2 99.2 99.8 99.8 99.1 99.1 AHD interpolation e Ci (total) 95.0 91.1 96.2 71.8 96.9 59.5 98.8 98.4 99.3 97.8 97.9 89.3 C (total) i 86.0 81.6 88.5 66.7 93.3 66.9 98.4 98.1 98.6 97.1 95.0 88.1 C (block) i 100 98.9 100 94.9 100 96.9 99.2 99.2 100 99.8 99.8 98.7 Adobe Lightroom e Ci (total) 87.7 39.1 100 57.7 100 67.5 98.8 65.0 97.8 80.4 96.9 66.5 (total) 98.9 46.4 100 71.8 100 78.5 100 66.9 99.3 83.1 99.5 71.8 (block) 97.2 82.7 100 97.4 100 94.5 100 77.0 97.6 94.0 98.6 88.5

Baseline esults Percentage of correctly determined configurations D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C bilinear interpolation e Ci (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (total) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (block) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 VN interpolation e Ci (total) 88.8 88.8 97.4 97.4 95.1 95.1 97.7 97.7 99.0 99.0 96.3 96.3 (total) 64.8 64.8 80.8 80.8 83.4 83.4 94.2 94.2 96.4 96.4 87.6 87.6 (block) 97.7 97.7 100 100 98.2 98.2 99.2 99.2 99.8 99.8 99.1 99.1 AHD interpolation e Ci (total) 95.0 91.1 96.2 71.8 96.9 59.5 98.8 98.4 99.3 97.8 97.9 89.3 C (total) i 86.0 81.6 88.5 66.7 93.3 66.9 98.4 98.1 98.6 97.1 95.0 88.1 C (block) i 100 98.9 100 94.9 100 96.9 99.2 99.2 100 99.8 99.8 98.7 Adobe Lightroom e Ci (total) 87.7 39.1 100 57.7 100 67.5 98.8 65.0 97.8 80.4 96.9 66.5 (total) 98.9 46.4 100 71.8 100 78.5 100 66.9 99.3 83.1 99.5 71.8 (block) 97.2 82.7 100 97.4 100 94.5 100 77.0 97.6 94.0 98.6 88.5

Baseline esults Percentage of correctly determined configurations D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C bilinear interpolation e Ci (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 i C (block) 100 100 green 100channel configuration 100 100 99.2can 99.2be determined 100 100 99.8 99.8 i VN interpolation most reliably e Ci (total) 88.8 88.8 97.4 97.4 95.1 95.1 97.7 97.7 99.0 99.0 96.3 96.3 block-based CFA synthesis approach superior in C (total) 64.8 64.8 80.8 80.8 83.4 83.4 94.2 94.2 96.4 96.4 87.6 87.6 i virtually all cases C (block) 97.7 97.7 100 100 98.2 98.2 99.2 99.2 99.8 99.8 99.1 99.1 i AHD interpolation e Ci (total) 95.0 91.1 96.2 71.8 96.9 59.5 98.8 98.4 99.3 97.8 97.9 89.3 C (total) i 86.0 81.6 88.5 66.7 93.3 66.9 98.4 98.1 98.6 97.1 95.0 88.1 C (block) i 100 98.9 100 94.9 100 96.9 99.2 99.2 100 99.8 99.8 98.7 Adobe Lightroom e Ci (total) 87.7 39.1 100 57.7 100 67.5 98.8 65.0 97.8 80.4 96.9 66.5 (total) 98.9 46.4 100 71.8 100 78.5 100 66.9 99.3 83.1 99.5 71.8 (block) 97.2 82.7 100 97.4 100 94.5 100 77.0 97.6 94.0 98.6 88.5

Baseline esults Percentage of correctly determined configurations D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C bilinear interpolation e Ci (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (total) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (block) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 VN interpolation e Ci (total) 88.8 88.8 97.4 97.4 95.1 95.1 97.7 97.7 99.0 99.0 96.3 96.3 (total) 64.8 64.8 80.8 80.8 83.4 83.4 94.2 94.2 96.4 96.4 87.6 87.6 (block) 97.7 97.7 100 100 98.2 98.2 99.2 99.2 99.8 99.8 99.1 99.1 AHD interpolation e Ci (total) 95.0 91.1 96.2 71.8 96.9 59.5 98.8 98.4 99.3 97.8 97.9 89.3 C (total) i 86.0 81.6 88.5 66.7 93.3 66.9 98.4 98.1 98.6 97.1 95.0 88.1 C (block) i 100 98.9 100 94.9 100 96.9 99.2 99.2 100 99.8 99.8 98.7 Adobe Lightroom e Ci (total) 87.7 39.1 100 57.7 100 67.5 98.8 65.0 97.8 80.4 96.9 66.5 (total) 98.9 46.4 100 71.8 100 78.5 100 66.9 99.3 83.1 99.5 71.8 (block) 97.2 82.7 100 97.4 100 94.5 100 77.0 97.6 94.0 98.6 88.5

Baseline esults Percentage of correctly determined configurations D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C bilinear interpolation e Ci (total) 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (total) i 100 100 100 100 100 100 99.2 99.2 100 100 99.8 99.8 C (block) 100 100 green 100channel configuration 100 100 99.2can 99.2be determined 100 100 99.8 99.8 i VN interpolation most reliably e Ci (total) 88.8 88.8 97.4 97.4 95.1 95.1 97.7 97.7 99.0 99.0 96.3 96.3 block-based CFA synthesis approach superior in C (total) i 64.8 64.8virtually 80.8 80.8 all cases 83.4 83.4 94.2 94.2 96.4 96.4 87.6 87.6 C (block) i 97.7 97.7 reliability 100 100 depends 98.2 to 98.2some 99.2 extent 99.2 on99.8 the99.8 source99.1 99.1 AHD interpolation of the image e Ci (total) 95.0 91.1 96.2 71.8 96.9 59.5 98.8 98.4 99.3 97.8 97.9 89.3 C (total) i 86.0 81.6 88.5 66.7 93.3 66.9 98.4 98.1 98.6 97.1 95.0 88.1 C (block) i 100 98.9 100 94.9 100 96.9 99.2 99.2 100 99.8 99.8 98.7 Adobe Lightroom e Ci (total) 87.7 39.1 100 57.7 100 67.5 98.8 65.0 97.8 80.4 96.9 66.5 (total) 98.9 46.4 100 71.8 100 78.5 100 66.9 99.3 83.1 99.5 71.8 (block) 97.2 82.7 100 97.4 100 94.5 100 77.0 97.6 94.0 98.6 88.5

Influence of Image Size analysis of smaller image blocks of particular interest for the manipulation detection percentage of correctly determined configurations for all blocks of all images (CFA synthesis, block based) D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C AHD interpolation 256 256 98.7 95.7 99.2 92.1 98.6 91.2 98.1 97.2 99.0 97.4 98.7 96.2 512 512 99.1 96.5 99.4 93.7 99.0 93.4 98.7 98.1 99.4 98.1 99.1 97.3 1024 1024 99.7 97.1 98.7 94.2 99.1 95.1 98.8 98.4 99.8 99.2 99.4 98.2 Adobe Lightroom 256 256 92.7 65.3 99.4 83.9 99.3 81.9 99.1 52.0 96.7 79.8 96.9 70.2 512 512 94.4 72.6 99.9 90.0 100 88.7 99.3 56.6 96.7 88.2 97.3 76.8 1024 1024 95.4 79.0 100 96.8 100 92.9 99.7 66.0 96.3 91.1 97.4 82.1 Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 13 of 15

Influence of Image Size analysis of smaller image blocks of particular interest for the manipulation detection percentage of correctly determined configurations for all blocks of all images (CFA synthesis, block based) D200 D70 D70s FZ750 X100 overall C () C C () C C () C C () C C () C C () C AHD interpolation 256 256 98.7 95.7 99.2 92.1 98.6 91.2 98.1 97.2 99.0 97.4 98.7 96.2 512 512 99.1 96.5 99.4 93.7 99.0 93.4 98.7 98.1 99.4 98.1 99.1 97.3 1024 1024 99.7 97.1 98.7 94.2 99.1 95.1 98.8 98.4 99.8 99.2 99.4 98.2 Adobe Lightroom 256 256 92.7 65.3 99.4 83.9 99.3 81.9 99.1 52.0 96.7 79.8 96.9 70.2 512 512 94.4 72.6 99.9 90.0 100 88.7 99.3 56.6 96.7 88.2 97.3 76.8 1024 1024 95.4 79.0 100 96.8 100 92.9 99.7 66.0 96.3 91.1 97.4 82.1 configuration of Adobe Lightroom images is particularly harder to determine for smaller block sizes local, signal-adaptive post-processing? Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 13 of 15

JPE Post-compression green channel configuration C () 100 correct configuration [%] 80 60 40 20 0 bilinear VN AHD Lightroom * 100 98 95 90 80 JPE quality green channel configuration can be determined relatively reliable for JPE qualities as low as 90 Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 14 of 15

JPE Post-compression green channel configuration C () complete configuration C 100 100 correct configuration [%] 80 60 40 20 0 bilinear VN AHD Lightroom correct configuration [%] 80 60 40 20 0 bilinear VN AHD Lightroom * 100 98 95 90 80 JPE quality * 100 98 95 90 80 JPE quality green channel configuration can be determined relatively reliable for JPE qualities as low as 90 complete configuration estimation is more vulnerable to JPE Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 14 of 15

Concluding emarks CFA pattern configuration is valuable additional knowledge in the forensic examination of digital camera images in this study: efficient method to determine the CFA pattern approximate solution to the CFA synthesis problem two-stage, block-based approach requires only 1 linear filtering step per image promising results despite the overly simplistic assumptions Limitations strong post-processing and JPE compression hamper a reliable identifictation Future work extend the CFA synthesis method to more sophisticated demosaicing procedures separate filter coefficients for horizontal / vertical edges allow for neutral decision (CFA pattern not known) Kirchner Efficient Estimation of CFA Pattern Configuration in Digital Camera Images slide 15 of 15

Faculty of Computer Science Institute of Systems Architecture, Privacy and Data Security esearch roup Thanks for your attention Questions? Matthias Kirchner Technische Universität Dresden Matthias Kirchner gratefully receives a doctorate scholarship from Deutsche Telekom Stiftung, Bonn, ermany.