Development of Pre-operational Services for Highly Innovative Maritime Surveillance Capabilities ASI Workshop - 7 th Framework Program Rome, June 27 th, 2012 Maria Angelucci, e-geos 1
Figures Start date: June 1st, 2011 Project Duration: 30 months Consortium: 20 partners Total Cost: 7 MEuro EC contribution: 3,9 Meuro Project Coordinator: Paola Nicolosi (e-geos) R&D activities start: 1st September 2011 FP7 Call Ref.: SPA.2010.1.1-05 Contributing to the S in GMES Developing pre-operational service capabilities for Maritime Surveillance 2
EDI IT The Consortium EUSC KSAT FFI QQ STP TNO DLR OWS CLS TASF EGEOS SSI TAS-I AS UNINA UNIROMA1 SPH 3
DOLPHIN aim and impacts Main aim of DOLPHIN is to fill the current technological gaps, identifying and developing new tools providing effective improvements of the state-of-the-art capabilities in Maritime Surveillance with respect to Users real needs. Improve Maritime Surveillance Awareness inside an integrated picture for maritime surveillance services: - Prevention and management of illegal activities at sea (Border Surveillance) - Prevention and management of collision, grounding in sea areas (Traffic Safety) - Control of illegal fisheries (Fisheries Control) DOLPHIN Project will respond to through the development of Decision Support Modules (DSM), providing actual and effective added values to Users decisions making processes. DSMs will be based on the integration of innovative Software Tools, aiming at filling specific Technological Gaps, stressing technological solutions beyond the current state-of-the-art. 4
DOLPHIN Technological Lines (1/2) Five Technological Lines are being developed in DOLPHIN: 1. Advanced Single Channel SAR Processing: better detection of small and fast targets better characterization of the vessel s motion parameters better identification of targets wrt the sea background 2. Polarimetry and Multi-channel SAR Processing: better detection of small vessels improved ship target detection and possibly classification. 3. Feature Extraction and Recognition: better detection of small vessels recognition of essentially man-made features in ocean imagery detection of irregularly shaped wakes produced by manoeuvring vessels enhancement of ocean imagery ship classification based on silhouettes generated from a 3D image 5
DOLPHIN Technological Lines (2/2) 4. Multi-sensor Data Fusion: fuse data from multiple sources to accurately predict the time evolution of vessel tracks, icebergs, and shipwrecks fusion of heterogeneous data performing accurate geolocation of SAR images in which the positions of the objects of interest such as icebergs, and ship wrecks are detected 5. Sea State Modelling and Algorithm Inversion: extraction of sea state and meteorological parameters from high resolution SAR images to better understand distortion in the ship imaging and to determine the length of the wake visibility to be expected 25 Software Tools are under development! 6
Operational scenario campaigns Q4 2012 Q1 2013 Q2 2013 Q3 2013 Q4 2013 Drugs traffic- small/fast Atlantic area between Morocco and Portugal Illegal traffic- High dynamics/data fusion North Sea and Baltic area Drugs traffic-big ships near small/ anomalous behav. Azores-Portugal Illegal immigration Libya and Lampedusa Bay of Biscay Early warning for crossings Plus 3 Joint Scenarios campaigns English Channel Early warning for grounding North East Passage Norway/ Russia - Ice conditions 1. South West Approaches Europe/English channel 2. Navarea-XIX Barents Sea, Norway 3. Marocco/Portugal and Portugal/Azores Central/Southern Med Bluefin Tuna and Swordfish Adriatic sea transfer of catches Croatia and Italy 7
MARISS: the starting point in operational maritime surveillance MARISS (MARItime Security Services), on going project funded by ESA in the Maritime Security field. Start in 2006, end in 2013 (as DOLPHIN). Threats around EU waters The key is the creation of a MARISS Service Network, a network formed by the major European Service Providers in the maritime surveillance field. MARISS already involve EMSA, Frontex, NATO, EFCA, Customs, National Coast Guards, Navy. The DOLPHIN development will then feed the operational MARISS services, creating a synergy between the two projects. V A 8
DOLPHIN benefits The Border Surveillance DSM will support users by offering: helping for intelligence information for illegal activity prevention, reduction of in-situ inspections for border European areas monitoring, improvement in ship detection probability, size, classification, recognition, automatic forecast and backward tracking of ships routes, better data fusion capability and complete picture on suspect behavior, automatic alarm generation, e.g. for specific classes of ships crossing borders. The Traffic Surveillance DSM will support users by offering: knowing better the position of ships in advance, as an early warning mechanism, detection of collision risks in near real time and detection of risks inherent to the ship itself (hazardous material or blacklisted ships). The Fisheries Control DSM will support users by offering: ship localisation with an improved accuracy, to detect fishing boats in protected areas, detection of abnormal behaviours, such as those where trawling is forbidden, geo-fencing alerts generated when vessels are detected in areas where fishing is banned. 9
DOLPHIN improvements leading to new services in Border Surveillance in the EUROSUR framework Before DOLPHIN: small boats detected with low probability to detect very small and fast boats (indicatively less than 8 meters in length and travelling at more than 20 knots) such as those used for illegal immigration or drug smuggling. Before DOLPHIN: tracking of medium-large vessels, classification no accurate enough to track boats in near real time (indicatively with an approximate refresh interval of less than 30 minutes, exploiting both EO and cooperative systems). Before DOLPHIN: back-tracking of only medium-large vessels the capability, following a ship detection, to track back a ship route, for determining the departure points of smugglers, violation of no transit areas. i.e. only EO tracking boats 10
DOLPHIN improvements leading to new services in Border Surveillance in the EUROSUR framework Before DOLPHIN: no capacity to well discriminate small and large boats close each other and no elements for supporting the detection of suspicious behaviour to discriminate between small and large boats, especially in remote areas, and to identify rendezvous points for smugglers, suspect behavior around sensitive assets, i.e. latest position of vessels which have disappeared because of piracy attack. 11
DOLPHIN improvements leading to new services in Border Surveillance in the EUROSUR framework Before DOLPHIN: no operational recognition and classification from SAR images Ship models from 3D CAD models. Recognition and classification of vessel using high resolution SAR data. Before DOLPHIN: no automatic ship classification to enhance automatic ships classification with almost continuous monitoring over small/medium size areas, such as near ports or other coastal assets. Before DOLPHIN: no validation of AIS integrity to enhance ship localisation accuracy (ship reporting systems) in order to validate data provided by declarative systems, such as AIS. Before DOLPHIN: no discrimination between ships and icebergs. to detect and classify objects other than ships. 12
MARISS & BlueMassMed - Example of integration: the Italian Interministerial node Ship Detection Data Details on BMM webgis e-geos/selex collaboration 13
Validation approach Any proposed innovative capability, to be actually pre-operational, has to be fully validated in an operational context. Three levels of validation: 1. Software tool calibration, to be performed by Software Tool developers in order to assess the fulfilment of the Operational Requirements 2. DSM integration testing, to be performed by the DSM integrators in order to verify that Software Tools are correctly integrated 3. DSM performance assessment by means of Operational Scenarios, to be performed by the DSM. The definition of Operational Scenario refers to the description of the environment in which the tests will be performed: real-world, significant and representative of the complexity of the requirements and the expected performance levels. 14
User involvement Users play an important role in the consolidation of the operational scenarios, to ensure that they are representative of the complexity of the requirements. The rationale behind the definition of scenarios is widely agreed and shared with the Users, according to relevant policy areas responding to their mandates. On the other hand, users will be strongly involved in the validation and verification of the Operational Scenarios, when their actual effectiveness will be measured on the basis of the given definition. The Users will thus have access to improved services and products and will provide feedbacks on relevant utility and perspective of integration into their operational environment. European Agencies involved: EMSA, FRONTEX, EFCA, JRC, ASI. USERS COUNTRY Ministere de l'ecologie, de l'energie - Affairs Maritimes FR Italian Coast Guard IT Italian Navy IT CO.AN.AN IT UNIMAR IT Spanish Navy ES Puerto de Gijon ES Bundespolizei D Hellenic Rescue Team GR Norwegian Coastal Administ NO NOR NJHQ NO 15
Thank you for your attention! For more information please contact: paola.nicolosi@e-geos.it 16