VtWeb - Multi-data access / processing / sharing / export A door open to on-the-fly (cross) calibration

Transcription

1 IDEAS+ Cal/Val Workshop#5 VtWeb - Multi-data access / processing / sharing / export A door open to on-the-fly (cross) calibration Serge RIAZANOFF Director serge.riazanoff@visioterra.fr serge.riazanoff@u-pem.fr VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 1

2 Table of contents Presentation of VisioTerra EO engineering and education Software development skills A sustained R&D investment VtWeb High-level requirements Design concepts and VtWeb features Multi-data access On-the-fly processing Sharing with hyperlooks KML / GeoTIFF exports Proba-V MEP Presentation of Proba-V Contribution of VisioTerra Automatic detection of fires and burnt areas The fire rivers VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 2

3 VisioTerra in few numbers Founded in May collaborators / 7 engineers Turnover 2016: 407 K Customers 2016: TOTAL 50% ESA 42% UNEP 6% Cité des Sciences 2% 14 rue Albert Einstein Cité Descartes Champs-sur-Marne France VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 3

4 EO engineering and education January 1990 March 2004 GAEL Consultant 1. Software development 2. Quality control 3. Cartographic production May 2004 VisioTerra March 1993 Science consulting for Earth observation 1. Software development Virtual globes, access to EO data 2. Cartographic production geometry, radiometry, statistics 3. Studies - EO expert support, technical studies, audit 4. Training Remote sensing, Image processing, Geodesy 5. Communication Web, scientific document editing University Paris-Est Marne-la-Vallée Gaspard Monge Institute Professor 1. Image processing 2. Remote sensing 3. Trainees following ENSG (IGN school) University Paris 7 World univ. (Algeria, Morocco, Palestine, Douala, Kinshasa...) VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 4

5 From satellite to end users satellite End-users telemetry Spatial agencies ESA, NASA, CNES, NASDA Agriculture Hazard monitoring Environment JRC, CNASEA, ONIC JRC (Ispra) AESN Oil industry TOTAL, CGG,BEICIP, GDF data segment format archive Ground segment ALOS, SPOT, Landsat, ERS, Envisat processor quality control Distributors, added-value resellers Eurimage SPOT IMAGE Telespazio GEOSYS Communication RAI 1, France 2 Sierra Productions orthorectified products space maps cartographic quality control mosaics classifications data fusion multi-format, multi-media decoding Change detection Bathymetry Culture / Education Museum Cité des Sciences Universities UPEMLV ENSG, UPMC Science Consulting for Earth Observation Conference Training VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 5

6 Orbit propagation and acquisition geometry Orbit propagators SGP4 Nominal Vt Satellite Tracker Acquisition geometry Optical / Radar Mission / Instrument / Mode Vt Aoi Catcher VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 6

7 Modification of the Sentinel-1 tie-points grid S1A_IW_GRDH_1SDV_ T031601_ T031626_002747_003156_9DF0 hyperlook KML VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 7

8 VtWeb From high-level requirements up to design High-level requirements Design concepts VtWeb features Better exploit EO data Bring users to data Extract information from big data Share this information Hide the complexity of data access, representation, processing levels, projection Enable user to only check Enable users to focus on his/her core business / skill Provide a wide range of data types and time-series Enable users to interactively browse / transform / merge data Cross / aggregate products Enable users to download the processed AOI only: - for a view - for their GIS Dataset modules Near real-time access Immediate access Worldwide free data 2D / 3D display in their classical Web navigators without any installation Processing on-the-fly (POF) Get associated data Change tracker Layer stack of mixed data Smart dissemination: - hyperlook - KML script - GeoTIFF VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 8

9 VtWeb principles Copernicus services météo., climat VisioTerra Collections global / free data data retrieval / data mining Sentinels, Envisat satellites / meteo / ECV / altimetry models / maps Near Real-Time access automated processing for citizen - default style - predefined styles for scientists - parameter tuning - toward a P.O.F. toolbox collaborative infrastructure(s) project management 2D webmapping / 3D virtual globe on your area of interest archives to analyse changes value-added services, recurring monitoring, alarms Landsat, ASTER NASA MODIS NOAA océano. Maps GeoTIFF G.I.S. KML KMZ VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 9

10 Data Processing Relay (DPR) VtWeb infrastructure 400 TB available 50 TB ASAR and ERS 150 TB MERIS 100 TB/year S1A 1 Gb/s symmetric fibre DPR as a solution for Africa VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 10

11 VtWeb Generic platform for customized platforms An advanced one-stop-shop model A showcase capitalising VisioTerra know-how VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 11

12 Paradigm change More access for less downloads LTA / NRT interactive multi-scale inspection blind download I check for spill, fire, change yes present? no yes expert? no no download download report VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 12

13 Sentinel-1 Last of the day VtWeb? VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 13

14 Proba-V MEP Mission Exploitation Platform Consortium of 9 institutes / companies VisioTerra in charge of: enhanced visualisation automatic detection of: fires burnt areas use of contemporaneous data: meteorological (winds) precipitations Service hosted in VITO infrastructure VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 14

15 Proba-V MEP VisioTerra service VtProbaV producer direct access to NRT S1 TOC 100m compute difference image(s) compute change score update rolling statistics VtWeb server enabling to get: Proba-V catalogue and data ECMWF / GPM catalogue & data rolling statistics images change images change scores VtWeb client enabling users to: browse the change scores / time display: - Proba-V images - change images & statistics - contemporaneous meteo / precipitations data VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 15

16 Proba-V MEP Presentation of Proba-V Reference (v2.2 03/08/2017) Proba-V products: S1 TOA 100m swath 507 km S1 TOA 300m Swath 2200 km S1 TOC 100m NRT S1 TOC 300m S5 Proba-V SPOT VGT1 SPOT VGT2 VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 16

17 Proba-V MEP Fire detection algorithm Study on 4 zones (10 x10 tiles) Algorithms Fire index Classification computed from training parcels Use of scikit-learn(machine learning in Python) to generate decision trees VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 17

18 Proba-V MEP Strange commissions: the fire rivers 2D views: layer stack tile true fire fire rivers VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 18

19 Proba-V MEP Checking with contemporaneous data 2D animation Proba-V SWIR,NIR,B Sentinel-2 11,8,2 Landsat-7 5,4, ??:??:?? :06: :11:06 SWIR nm NIR nm Blue nm SWIR nm NIR nm Blue nm SWIR nm NIR nm Blue nm VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 19

20 Proba-V MEP Checking spectral responses..\..\a001_visioterra_reference_documents\proba-v\proba-v_srf_+s2+l7.xls Blue Red NIR SWIR VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 20

21 Proba-V MEP Retrieving the acquisition times from TLE Proba-V_VGT-P 100m_ T _ T kmz ESA BR-310 Sun-synchronous polar orbit, 820 km altitude, crossing the equator every morning between 10:30 and 11:30 local time -15 (W) GMT-1 VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 21

22 Proba-V MEP Retrieving the acquisition times from TLE Proba-V_VGT-P 100m T kmz VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 22

23 Towards on-the-fly (cross) calibration Cross calibration assessment Retrieving collocated / contemporaneous observations (optical, radar, atmosphere chemistry, meteo ) Checking spectral responses Regression analysis Difference / residual image On-the-fly atmospheric correction Use of contemporaneous data (molecules, aerosol, ozone, water vapour column, surface albedo, relief, soil moisture, land cover, ECV ) from other mission / instruments or collections Choice of atmospheric correction models (Sen2cor, MACCS-ATCOR, SMAC ) Choice / tuning of on-the-fly parameters On-the-fly image of difference between two models or parameter variations On-the-fly processor From the same raw product No need to reprocess huge amount of data Versioning the hyperlooks users could access / compare different IP(F) versions Keeping hyperlooks on calibration sites for training / comparisons Interactive parameters tuning for cloud masking Data analytics: statistics on user-defined areas, interactive cross-correlation VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 23

24 Merci de votre attention. Thank you for your attention. Questions? Serge RIAZANOFF Director VT-A003-SLD-062-E IDEAS+ Cal/Val workshop#5 ESRIN, 12 December 2017 page 24