UNODC Workshop, 25-28 November, Bogota, Colombia 1 Textural analysis of coca plantations using 1-meter-resolution remotely-sensed data Workshop on Measurement of Cultivation and Production of Coca Leaves and Derivates United Nations Office on Drugs and Crime (UNODC) 25-28 November 2008, Bogota, Colombia Martino Pesaresi European Commission, Joint Research Centre, Institute for the Protection and Security of the Citizen (IPSC) Support to External Security Unit (SES) Via E. Fermi, 1 TP 267 Ispra 21020 (VA), Italy Tel. +39 0332 789524 (direct line) Fax. +39 0332 785154 Email: martino.pesaresi@jrc.it http://isferea.jrc.it
Index UNODC Workshop, 25-28 November, Bogota, Colombia 2 ISFEREA http://isferea.jrc.it Satellite Image Intelligence Very High Resolution Satellite Data Automatic Image Understanding Image Information Mining Geographic Information Systems Spatial Decision Support Systems Collaborative Mapping Systems Spatial Data Repositories Human Security Settlement Analysis Informal settlements Refugee and IDP Camps Population Risk Assessment Damage and Reconstruction Assessment Conflict Modeling Conflict Resources Monitoring Extraction of information from VHR data Image textural analysis The concept of mature coca index (MCI) Application of the MCI concept for monitoring coca crops
Textural analysis steps UNODC Workshop, 25-28 November, Bogota, Colombia 3 Data input: ikonos panchromatic 1m spatial resolution Reference information Anisotropic analysis Separability analysis Multi-scale accuracy analysis Dimensional reduction Mature Coca Index class hectares percent Mature coca 20.71 39.9% Forest 28.30 54.5% Clearing 1.09 2.1% Shadow 1.81 3.5% total 51.91 100.0%
UNODC Workshop, 25-28 November, Bogota, Colombia 4 A 380x530 meters subsample of the data input used for this experiment. A) mature coca field, B) forest, C) clearing areas, and D) shadows.
Radiometric Information UNODC Workshop, 25-28 November, Bogota, Colombia 5 2.00% 1.80% 1.60% 1.40% 1.20% 1.00% 0.80% 0.60% coca forest clear shadow 0.40% 0.20% 0.00% 0 50 100 150 200 250 DN
What is texture (GLCM) UNODC Workshop, 25-28 November, Bogota, Colombia 6 r tx = f d, DIS = ASM = ( w v m) Ng,,α Ng i= 1 j= 1 Ng Ng P i, j i j ( P ) i, j i= 1 j= 1 Ng Ng i= 1 j= 1 2 ( i j) 2 Pi j CON, = Ng Ng IDM = P 2 i, j i= 1 j= 11+ 1 ( i j) Ng Ng ENT = P i, j log Pi, j i= 1 j= 1 ( ) Grey Level Co-occurrence Matrix (GLCM) contains the relative frequencies with which two neighboring pixels (linked by a spatial relation) occur on the local domain (window) of the image, one with gray level I and the other with gray level J. angle = 270 distance 1 2 3 4 5 angle = 180 x angle = 0,360 angle = 90
2500 Anisotropic Analysis UNODC Workshop, 25-28 November, Bogota, Colombia 7 B4Stdv B5Stdv 18.00 r tx = f d, ( w v m),,α 2000 16.00 Stdv 1500 1000 d=1 d=2 d=3 d=4 d=5 Stdv 14.00 12.00 10.00 8.00 d=1 d=2 d=3 d=4 d=5 500 6.00 0 0.0 45.0 90.0 135.0 180.0 225.0 270.0 315.0 360.0 4.00 0.0 45.0 90.0 135.0 180.0 225.0 270.0 315.0 360.0 Angle Angle Figure 1 The anisotropic analysis of the contrast (left) and dissimilarity (right) co-occurrence textural measures. B3Stdv B6Stdv B7Stdv 0.085 0.230 0.058 0.220 0.056 0.080 0.210 0.054 Stdv 0.075 0.070 d=1 d=2 d=3 d=4 d=5 Stdv 0.200 0.190 0.180 d=1 d=2 d=3 d=4 d=5 Stdv 0.052 0.050 0.048 0.046 d=1 d=2 d=3 d=4 d=5 0.065 0.170 0.044 0.160 0.042 0.060 0.0 45.0 90.0 135.0 180.0 225.0 270.0 315.0 360.0 0.150 0.0 45.0 90.0 135.0 180.0 225.0 270.0 315.0 360.0 0.040 0.0 45.0 90.0 135.0 180.0 225.0 270.0 315.0 360.0 Angle Angle Angle Figure 2 From left to right the anisotropic analysis of the homogeneity, entropy and second moment co-occurrence textural measures
Separability Analysis UNODC Workshop, 25-28 November, Bogota, Colombia 8 Separability Analysis r tx = f d, ( w v m),,α J e ffrie s -M a tu s ita 2.00 1.50 1.00 0.50 0.00 homogeneity contrast dissimilarity entropy second moment c oca&forest forest&clear coca&clear shadow &clear Class Pairs s hadow &fores t shadow&coca Av erage Figure 1 Separability analysis of the selected co-occurrence textural measures
W size and accuracy r tx = f d, ( w v m),,α UNODC Workshop, 25-28 November, Bogota, Colombia 9 Producer Accuracy User Accuracy 100 100 95 90 90 80 % 85 80 75 70 65 Overall Accuracy coca forest shadow clear % 70 60 50 40 30 Overall Accuracy coca forest shadow clear 60 20 55 10 50 0 10 20 30 40 50 60 0 0 10 20 30 40 50 60 Window Size Window Size Commission Error Omission Error 100 100 90 90 80 80 % 70 60 50 40 30 Overall Accuracy coca forest shadow clear % 70 60 50 40 30 Overall Accuracy coca forest shadow clear 20 20 10 10 0 0 10 20 30 40 50 60 0 0 10 20 30 40 50 60 Window Size Window Size Figure 1 - Results of the accuracy analysis using contrast textural measure, α parameter d 1.. 9 distance parameter. equal to 45 degrees, and { }
Scale (distance) and Classes, MCI definition UNODC Workshop, 25-28 November, Bogota, Colombia 10 Contrast, 45deg 4000 r tx = f d, ( w v m),,α 3500 3000 Mean, Stdv 2500 2000 1500 coca forest clear shadow MCI w = ( w tx ) tx d = 1 w d = 5 2 1000 500 0 0 1 2 3 4 5 6 7 8 9 10 Distance
Contrast, d=1, w=51 UNODC Workshop, 25-28 November, Bogota, Colombia 11 Textural feature calculated in the same area. Linear min-max stretching has been applied for visualization.
Contrast, d=5, w=51 UNODC Workshop, 25-28 November, Bogota, Colombia 12 Textural feature calculated in the same area of Figure 11. Linear minmax stretching has been applied for visualization.
MCI UNODC Workshop, 25-28 November, Bogota, Colombia 13 MCI calculated using and in the same area of Figure 11. Linear minmax stretching has been applied for visualization.
Application pilot study UNODC Workshop, 25-28 November, Bogota, Colombia 14 It involves 3 test sites of 10x10 kilometers each Test sites are in the area of Magdalena Medio, Cantagallo, San Pablo, Simiti-Santa Rosa It is connected to the activity of ECfounded project Programa Desarrollo y Paz del Magdalena Medio http://www.pdpmm.org.co/portal.htm
Coca cultivations UNODC Workshop, 25-28 November, Bogota, Colombia 15 1. Young coca plants in recently-burned background 2. Mature coca field from the field survey 3. Mature coca fields as seen from satellite image processed by JRC IPSC 1 2 3
Data Sources UNODC Workshop, 25-28 November, Bogota, Colombia 16 Satellite Imagery Landsat TM/ETM, Ikonos Already existing maps INSTITUTO GEOGRÁFICO AGUSTÍN CODAZZI-IGAC 1:100.000 Digital Terrain Model NASA SRTM 90m spatial resolution Field survey GIS/GPS portable devices Reference and ancillary data UNODC Sistema Integrado de Monitoreo de Cultivo Ilícitos-SIMCI USAID Pan-American Development Foundation-FUPAD
Satellite image processing characteristics UNODC Workshop, 25-28 November, Bogota, Colombia 17 Multiple spatial/spectral resolution IKONOS multispectral 4 meters IKONS panchromatic 1 meter Landsat TM and ETM multispectral 30 meters Landsat ETM panchromatic 15 meters Multiple date IKONOS 3 dates, 6 months tot Landsat 4 dates, 4 years tot Multiple criteria Spectral signature Textural signature Contextual information Time persistence / change patterns
Automatic Image Understanding UNODC Workshop, 25-28 November, Bogota, Colombia 18 Image fusion for improving visual exploration and interpretation Emphasis on robust automatic detection Multiple radiometric and textural signatures to fuzzy multicriteria Multi-source spatial integration using object-based image processing approach Intensive use of contextual information and a priori knowledge General image understanding using rule-based fuzzy inferential model
Data Flow UNODC Workshop, 25-28 November, Bogota, Colombia 19 SRTM Spatial improvement Elevation Contours generation Ikonos MS 3 dates Ortho rectification Fusion Maps, reports Ikonos PAN 3 dates Mature Coca texture index Ortho rectification Coca Texture 3 dates Fuzzy Inferential Model Image Interpretation digitalization Roads, buildings Field survey, Image interpretation Ground Truth Validation
Spectral info of a coca field UNODC Workshop, 25-28 November, Bogota, Colombia 20
Textural info of coca field (from PAN) UNODC Workshop, 25-28 November, Bogota, Colombia 21 Input Ikonos P Channel Texture CON Co-occurrence Displ. 1,1 Texture CON Co-occurrence Displ. 3,3
Mature Coca Index from textural analysis UNODC Workshop, 25-28 November, Bogota, Colombia 22 Texture CON Co-occurrence Displ. 1,1 Texture CON Co-occurrence Displ. 3,3 Derived Mature Coca Index (d1/d3)
Radiometric info and Mature Coca Index UNODC Workshop, 25-28 November, Bogota, Colombia 23
Spatial degradation after orthorectification UNODC Workshop, 25-28 November, Bogota, Colombia 24
Mature Coca Index robust in multi-temporal processing UNODC Workshop, 25-28 November, Bogota, Colombia 25 MCI Time0 (January) MCI Time1 (March) MCI Time2 (May)
Coca detection (in yellow) by region-based image processing UNODC Workshop, 25-28 November, Bogota, Colombia 26
Inferential Model UNODC Workshop, 25-28 November, Bogota, Colombia 27 Inferential Model Ground Truth Primary input Derived input Ikonos MS t0 Ikonos PAN t0 Mature Coca Index t0 Vegetation Index t0 Static Fuzzy Inferential Model t0 Validation t0 Ikonos MS t1 Ikonos PAN t1 Mature Coca Index t1 Vegetation Index t1 Static Fuzzy Inferential Model t1 Validation t1 Multi-temporal Fuzzy Inferential Model OUT Ikonos MS t2 Ikonos PAN t2 Mature Coca Index t2 Vegetation Index t2 Static Fuzzy Inferential Model t2 Validation t2 Image Segmentation Roads, buildings
Static Inferential Model t0,t1,t2 UNODC Workshop, 25-28 November, Bogota, Colombia 28 6 classes based on radiometric and textural signatures derived from ground truth Mature Coca Young Coca Forest Bare soil No data (clouds or shadows) Other surfaces Validation
Multi-temporal Inferential Model 18 classes based on static fuzzy model at t0, t1, t2 UNODC Workshop, 25-28 November, Bogota, Colombia 29 Good input data/model and stable coverage Stable forest, Stable mature coca, Stable young coca, Stable bare soil, BuildRoad, Stable other Good input data/model and dynamic coverage Cropped coca, Growing mature coca, New plots in the forest, New plots with young coca Sufficient but partially contradictory input data/model Forest in any time, Suspect coca in any time, Young coca in any time, Bare soil in any time Insufficient input data/model ProbBareSoil, ProbForest, Always clouds or shadows, sub_instableresidual
Mapping Out UNODC Workshop, 25-28 November, Bogota, Colombia 30
Accuracy time0 UNODC Workshop, 25-28 November, Bogota, Colombia 31 Table 1 Accuracy Assessment: Best Class at Time 0 (January 2004) User Class \ Mature Forest Bare Young Sum Sample Coca Soil Coca Confusion Matrix Mature Coca 42 0 0 0 42 Forest 0 74 0 0 74 Bare Soil 0 0 15 0 15 Young Coca 0 0 3 34 37 Unclassified 0 0 4 0 4 Sum 42 74 22 34 Accuracy Producer 1.0000 1.0000 1.0000 0.9189 User 1.0000 1.0000 0.6818 1.0000 Hellden 1.0000 1.0000 0.8108 0.9577 Short 1.0000 1.0000 0.6818 0.9189 KIA Per Class 1.0000 1.0000 0.6514 1.0000 Totals Overall Accuracy 0.959302 KIA 0.941993
Accuracy Time1 UNODC Workshop, 25-28 November, Bogota, Colombia 32 Table 1 Accuracy Assessment: Best Class at Time 1 (March 2004) User Class \ Mature Forest Bare Young Sum Sample Coca Soil Coca Confusion Matrix Mature Coca 49 0 0 0 49 Forest 0 57 0 0 57 Bare Soil 0 0 13 0 13 Young Coca 0 0 2 15 17 Unclassified 0 0 0 0 0 Sum 49 57 15 15 Accuracy Producer 1.0000 1.0000 1.0000 0.8824 User 1.0000 1.0000 0.8667 1.0000 Hellden 1.0000 1.0000 0.9286 0.9375 Short 1.0000 1.0000 0.8667 0.8824 KIA Per Class 1.0000 1.0000 0.8526 1.0000 Totals Overall Accuracy 0.985294 KIA 0.978057
Accuracy Time2 UNODC Workshop, 25-28 November, Bogota, Colombia 33 Table 1 Accuracy Assessment: Best Class at Time 2 (June 2004) User Class \ Mature Forest Bare Young Sum Sample Coca Soil Coca Confusion Matrix Mature Coca 98 0 0 0 98 Forest 0 80 0 0 80 Bare Soil 0 0 12 0 12 Young Coca 0 0 0 27 27 Unclassified 0 0 1 0 1 Sum 98 80 13 27 Accuracy Producer 1.0000 1.0000 1.0000 1.0000 User 1.0000 1.0000 0.9231 1.0000 Hellden 1.0000 1.0000 0.9600 1.0000 Short 1.0000 1.0000 0.9231 1.0000 KIA Per Class 1.0000 1.0000 0.9186 1.0000 Totals Overall Accuracy 0.995413 KIA 0.992884
Average Accuracy UNODC Workshop, 25-28 November, Bogota, Colombia 34 Table 1 Accuracy Assessment: Average Best Class on Time 0, 1, and 2 (January, March, and June 2004) General User Class \ Sample Mature Coca Forest Bare Soil Young Coca Sum Confusion Matrix Mature Coca 189 0 0 0 189 Forest 0 211 0 0 211 Bare Soil 0 0 40 0 40 Young Coca 0 0 5 76 81 Unclassified 0 0 5 0 5 Sum 189 211 50 76 Accuracy Producer 1.0000 1.0000 1.0000 0.9338 User 1.0000 1.0000 0.8239 1.0000 Hellden 1.0000 1.0000 0.8998 0.9651 Short 1.0000 1.0000 0.8239 0.9338 KIA Per Class 1.0000 1.0000 0.8075 1.0000 Totals Overall Accuracy 0.9800 KIA 0.9710
Statistics UNODC Workshop, 25-28 November, Bogota, Colombia 35 Code CLASS Number of Objects Surface (sqkm) Surface % 1st MBR Average 2nd MBR Average Classification Stability Average Input Data/Model Quality Surface (sqkm) Surface % 11 Stable forest 11555 69.44 57.34% 0.8267 0.0004 0.9995 12 Stable mature coca 2314 10.93 9.02% 0.7385 0.0003 0.9996 13 Stable young coca 1181 3.18 2.62% 0.6958 0.1079 0.8449 14 Stable bare soil 1676 3.57 2.95% 0.7760 0.0018 0.9977 15 BuildRoad 486 0.52 0.43% 0.8446 0.0453 0.9464 19 Stable other 611 1.36 1.13% 0.6801 0.5592 0.1777 Good Static 88.99 73.49% 21 Cropped coca 1397 3.85 3.18% 0.9931 0.0582 0.9414 22 Growing mature coca 1282 3.72 3.07% 0.5159 0.4524 0.1230 23 New plots in the forest 1001 3.14 2.60% 1.0000 0.1941 0.8059 Good 24 New plots with young coca 833 3.03 2.50% 0.6717 0.5575 0.1699 Dynamic 13.75 11.35% 31 Forest in any time 978 4.17 3.45% 0.6124 0.2135 0.6513 32 Suspect coca in any time 269 1.04 0.86% 0.5972 0.3488 0.4159 33 Young coca in any time 435 1.17 0.96% 0.5890 0.2327 0.6049 34 Bare soil in any time 158 0.37 0.31% 0.5943 0.2202 0.6295 Sufficient but partially contradictory 6.76 5.58% 91 ProbBareSoil 600 1.54 1.27% 0.5742 0.2193 0.6181 92 ProbForest 1456 4.82 3.98% 0.5675 0.1448 0.7448 98 Always clouds or shadows 997 4.49 3.71% 0.6774 0.0011 0.9983 99 sub_instableresidual 235 0.74 0.61% 0.5405 0.0653 0.8792 Insufficient 11.59 9.57% Grand Total 27464 121.09 100.00% 0.7611 0.0953 0.8748 121.09
Conclusions UNODC Workshop, 25-28 November, Bogota, Colombia 36 VHR data can be suitable for automatic recognition of coca fields Optical tested Radar to be tested New approach needed Exploitation of image textural information Multi-criteria fuzzy inferential engine Multi-temporal improve reliability Possible uses Improve consistency of visual interpretation Automatise reference/sample processing Constraints 1 meter resolution at least Optical = cloud cover problems JRC is available for methodological support to UNODC More tests, fine-tuning in select test sites Test new sensors (VHR radar)
Thanks UNODC Workshop, 25-28 November, Bogota, Colombia 37 Martino Pesaresi European Commission, Joint Research Centre, Institute for the Protection and Security of the Citizen (IPSC) Via E. Fermi, 1 TP 267 Ispra 21020 (VA), Italy Tel. +39 0332 789524 (direct line) Fax. +39 0332 785154 Email: martino.pesaresi@jrc.it Web: http://isferea.jrc.it