Open science services for Research and Education communities

Transcription

1 Open science services for Research and Education communities Stakeholders' view on EOSC Service Portfolio Management Kostas Koumantaros European and Regional e-infrastructure manager GRNET The VI-SEEM project initiative is co-funded by the European Commission under the H2020 Research Infrastructures contract no

2 VI-SEEM In Brief VI-SEEM: Virtual Research Environment for regional interdisciplinary communities in Southeast Europe and the Eastern Mediterranean Particip Participant organisation name Part. short Country ant no. name 1 (Coord) GREEK RESEARCH AND TECHNOLOGY NETWORK S.A. GRNET Greece 2 THE CYPRUS INSTITUTE CyI Cyprus 3 INSTITUTE OF INFORMATION AND COMMUNICATION TECHNOLOGIES BULGARIAN ACADEMY OF SCIENCES IICT-BAS Bulgaria Start date 01/10/2015 Duration 36 months Total funded effort: 715 PMs EC contribution: 3.3m euro H2020-EINFRA : e-infrastructures for virtual research environments (VRE): EINFRA , RIA, contract No INSTITUTE OF PHYSICS BELGRADE IPB Serbia 5 NATIONAL INFORMATION INFRASTRUCTURE DEVELOPMENT INSTITUTE NIIF Hungary 6 WEST UNIVERSITY OF TIMISOARA UVT Romania 7 POLYTECHNIC UNIVERSITY OF TIRANA UPT Albania 8 UNIVERSITY OF BANJA LUKA UNI BL Bosnia and Herzegovina 9 SS CYRIL AND METHODIUS UNIVERSITY OF SKOPJE UKIM FYR of Macedonia 10 UNIVERSITY OF MONTENEGRO UOM Montenegro RESEARCH AND EDUCATIONAL NETWORKING ASSOCIATION OF MOLDOVA INSTITUTE FOR INFORMATICS AND AUTOMATION PROBLEMS OF THE NATIONAL ACADEMY OF SCIENCES OF THE REPUBLIC OF ARMENIA GEORGIAN RESEARCH AND EDUCATIONAL NETWORKING ASSOCIATION BIBLIOTHECA ALEXANDRINA RENAM IIAP-NAS-RA GRENA BA Moldova Armenia Georgia Egypt 15 INTER UNIVERSITY COMPUTATION CENTER IUCC Israel 16 SYNCHROTRON-LIGHT FOR EXPERIMENTAL SCIENCE AND APPLICATIONS IN THE MIDDLE EAST SESAME Jordan <Event Name> 2

3 VRE for regional interdisciplinary e-infrastructure built over last decade Merging of SEE and EM regions SEE: network SEEREN1-2, Grid SEE-GRID-1/2/SCI, HPC HP-SEE EM: HPC LinkSCEEM1-2 communities in SEE and EM Particip Participant organisation name Part. short Country ant no. name 1 (Coord) GREEK RESEARCH AND TECHNOLOGY NETWORK S.A. GRNET Greece 2 THE CYPRUS INSTITUTE CyI Cyprus 3 INSTITUTE OF INFORMATION AND COMMUNICATION TECHNOLOGIES BULGARIAN ACADEMY OF SCIENCES IICT-BAS Bulgaria 4 INSTITUTE OF PHYSICS BELGRADE IPB Serbia 5 NATIONAL INFORMATION INFRASTRUCTURE DEVELOPMENT INSTITUTE NIIF Hungary 6 WEST UNIVERSITY OF TIMISOARA UVT Romania 7 POLYTECHNIC UNIVERSITY OF TIRANA UPT Albania 8 UNIVERSITY OF BANJA LUKA UNI BL Bosnia and Herzegovina 9 SS CYRIL AND METHODIUS UNIVERSITY OF SKOPJE UKIM FYR of Macedonia 10 UNIVERSITY OF MONTENEGRO UOM Montenegro 11 RESEARCH AND EDUCATIONAL NETWORKING ASSOCIATION OF MOLDOVA RENAM Moldova 12 INSTITUTE FOR INFORMATICS AND AUTOMATION PROBLEMS OF THE NATIONAL ACADEMY OF SCIENCES OF THE REPUBLIC OF ARMENIA IIAP-NAS-RA Armenia 13 GEORGIAN RESEARCH AND EDUCATIONAL NETWORKING ASSOCIATION GRENA Georgia 14 BIBLIOTHECA ALEXANDRINA BA Egypt 15 INTER UNIVERSITY COMPUTATION CENTER IUCC Israel 16 SYNCHROTRON-LIGHT FOR EXPERIMENTAL SCIENCE AND APPLICATIONS IN THE MIDDLE EAST SESAME Jordan Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/2017 3

4 Technologies for open science Provide user-friendly integrated e-infrastructure platform for Scientific Communities in Climatology, Life Sciences, and Digital Cultural Heritage for the SEEM region; by linking compute, data, and visualization resources, as well as services, software and tools. Diverse computing technologies Advent of big data Service orientation Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/2017 4

5 Detailed objectives Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/2017 5

6 3 Pillars + Supporting services. WP1 Project administrative and technical management WP2 Communication, marketing, training and innovation WP3 WP4 WP5 e-infrastructure services Data management lifecycle Domain-specific services and standard components Service Registry and Service Level Definitions Implementation of resource and service provisioning Data services design Data access, preservation and re-use Refinement of service requirements and technical assessment for integration Data management plans Operations and resource management of the e- Infrastructure for Scientific Communities Data collection and provisioning Development of VRE platform Overall integration of services Authentication, authorization and access management Data analysis Scientific support WP6 Capacity building, open calls and sustainability Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/2017 6

7 Access to VRE Through 3 distinct calls Pre-selected candidates M12 Open calls M18 and M28 Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/2017 7

8 Sharing value added services: the service catalogue 1. e-infrastructure services: HPC, Grid, Cloud, Code repository 2. Data management services 3. Generic services, models and tools 4. Domain specific services, models and tools 5. Scientific applications and data sets Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/2017 8

9 Access to services - Service catalogue provides service discovery and contains all project services Common services and resources operated by WP3 Storage/data services operated by WP4 Application-level services provided by WP5 Designed to be compatible with the FitSM standards 19 services grouped in 5 categories the service catalogue (WP3) Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/2017 9

10 VI-SEEM Stakeholders Industrial users, SMEs and NGOs : They represent innovative organizations that require services beyond what is offered by commercial providers. State of the art research services are what drives their innovating and would potentially benefit by paying for services. e - Infrastructure providers: Students : They are providing the basic infrastructure to the VRE, but also run the services, have expertise and provide training. They are the future researchers or e - Infrastructure providers. They are interested in training and usage of the services and will play an important role in the medium to long term progress of the infrastructure. Researchers: Research institutions, groups or individuals that act on a national or international level conducting research. They are the potential users of the VRE but they can also act as customers buying services. National governments : Provide funding and cater for the needs of national research institutions and groups. Act as potential customers of the VRE services on behalf of national research communities. European Commission (EC): Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/

11 VI-SEEM Funding Models Funding model 1 : Public funding ( EC and national funding ) The main assumption for this first funding model is that public funding will be accessible by the VI - SEEM members through competitive calls of the R&D work-programmes from EC, national /local governments, or a combination of them. Funding model 2 : Community contributions The main assumption for this second business model is that the VI - SEEM assets will be sustained beyond the project end through user community contributions (in kind, fees or a combination of them ). The VRE or its partners can participate in the EOSC (European Open Science Cloud) service offering or operate in a similar way independently of or in collaboration with the EOSC (as a broker) where communities fund the provision and usage of services via their funding sources including EC project funds. Funding model 3 : Private funding The main assumption for this third business model is that the VI - SEEM assets will be sustained beyond the project end through private funding (usage based, adding special features). Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/

12 We cherish our community! Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/

13 Lessons for EOSC IF you build it they will come #NOT EOSC needs to build Trust That the user will not do something harmful and make good use of the resources. That the Service Provider will provide what is promised That the rest of the stakeholders work for the same goal Transparency Use Open Calls / Peer Reviews Use Clear Processes Be inclusive not exclusive Sustainability Stakeholders' view on EOSC Service Portfolio Management - Brussels 28-29/11/

14 Conclusion A case study for open science sharing value-added services for R&E communities VI-SEEM provides a Virtual Research Environment to be provided to the scientific user communities in Climatology, Life Sciences, and Cultural Heritage VI-SEEM unifies networking, computing and data management Support the full lifecycle of scientific research Services will be provided through a service catalogue It takes time to build TRUST <Event Name> 14

15 Thanks! VI-SEEM <Event Name> 15

16 23 project applications, 21 accepted 11 in Climatology 5 in Digital Cultural Heritage 5 in Life Sciences 10 different countries of the region 14 of the applications required HPC services 6 required Grid and Cloud services 12 required storage services 8 required application specific services 1 st Open call (WP6) Per-country distribution: Bosnia and Herzegovina: 1, Bulgaria: 6, Cyprus: 3, FYR of Macedonia: 2, Georgia: 1, Greece: 4, Montenegro: 1, Israel: 1, Romania: 1, Serbia: 1. 14M CPU core hours, 3.4M GPU core hours, 1M Phi core hours provided <Event Name> 16

17 2 nd Open call (WP6) Call Opened in May 2017 with deadline June Services made available to users In total 15 million CPU core hours, 370 million GPU core hours and 15 million Phi core hours are available Targeted research fields 5 areas in Life Sciences 3 areas in Climate Research 3 areas in Digital Cultural Heritage 18 applications have been received 7 in Life Sciences 5 in Climate Research 6 in Digital Cultural Heritage <Event Name> 17

18 e-infrastructure services Resource Type Number of countries contributing Number of sites Total amount of resources Total amount of resources dedicated for the project HPC x86 Compute 8 11 ~21500 cores ~17.5 Million core hours per year HPC GPU 3 3 ~ GP-GPU cores ~ GPU cores HPC Intel Phi ~18500 co-processor ~8Μ co processor core 1 1 Accelerators cores hours per year Grid Compute ~ 2900 cores 10-15% of the resources Cloud Compute 8 9 ~ VM cores 5% of VM cores HPC Test/Train Cluster 3 4 ~300 cores ~50000 cores hours per year Storage (Disk) PB 515 TB Storage (Tape) PB 550 TB <Event Name> 18

19 e-infrastructure services: Grid At end of SEE-GRID projects series: 55 sites in production <Event Name> 19

20 e-infrastructure services: HPC 3 top 500 supercomputers in June 2015 (Bulgaria, Greece, Hungary) Heterogeneous infrastructure - Blue Gene/P SCs, large HPC clusters with advanced interconnects. Advantage to users To support a substantial number of libraries, toolkits, codes and application software <Event Name> 20

21 Data management services Functions allowing for data management for selected Scientific Communities, engage the full data management lifecycle: Simple data sharing Data repositories Long-term data archiving Working/scratch area Data search and catalogue Data analytics <Event Name> 21

22 Generic and Domain-specific services, models and tools Generic services, models and tools Application environment (optimized applications, codes, libraries), preinstalled in compute resources or provided as VM images. (Climate models, production programs for Life Sciences applications, data management tools for Digital Culture Heritage). Workflow, pipeline and software tools repository Regional community datasets Domain specific services, models and tools ChemBioServer: a web-based pipeline for filtering, clustering and visualization of chemical compounds used in drug discovery, Live Access Server: a web server providing flexible access to geo-referenced scientific data, offering visualization & post-processing capabilities for climate data, Clowder: a Digital Culture Heritage repository which also offers integrated interactive visualization tools. <Event Name> 22

23 Scientific applications Climate Life Sciences Cultural Heritage Regional Climate Modelling Global Climate Modelling Weather Forecasting Air Pollution/Quality Model Development Visualization, Datasets, etc. Modeling and Molecular Dynamics (MD) study of important drug targets Computer-aided drug design Analysis of Next Generation DNA sequencing data and RNA profiling data Data mining to identify prevalent diseases/mutations in the SEEM region Image processing for biological applications Computational simulation of DNA and RNA Digital Libraries Interactive Visualization Tools Semantic Referencing Image Classification Modelling of Built Environments and Advanced Representation Techniques Scientific simulation of materiality and systems' properties Other Synchrotron data analysis Geo-referencing Tools Other Bioarchaeology <Event Name> 23

24 Data sets: climate Simulation and observation data; global and local sets Source Description URL Earth System Grid Federation Data portal for downloading CORDEX and other data (i.e. CMIP5) Climatic Research Unit (CRU) gridded observations of surface meteorological data and climatic indices E-OBS gridded observations of surface meteorological parameters for Europe ECA&D meteorological station observations for Europe and part of MENA APHRODITE Gridded precipitation data for Asia and Middle East Global Precipitation Climatology Centre (GPCC) European Centre of Medium-Range Weather Forecasts Data Portal (ECMWF) Gridded global precipitation observations Mainly for downloading reanalysis products such as the ERA-Interim ftp://ftpanon.dwd.de/pub/data/gpcc/html/gpcc_normals_download. html AERONET federation of ground-based remote sensing aerosol networks MODIS MODIS (or Moderate Resolution Imaging Spectroradiometer) is a key instrument aboard the Terra (EOS AM) and Aqua (EOS PM) satellites ISA-MEIDA collection and archiving of Israeli Earth Science data sets index that detects the presence of uv-absorbing aerosols such as dust and TOMS aerosol index soot Source Description TAU, Israel Meteorological and hydrological data for Israel, environmental data, such as PM10 and PM2.5 measurements in various locations in Israel METEO-RO, Romania a gridded dataset from observations consisting of 9 essential climate variables with daily values ( ) on a spatial resolution of 10 km for the Romanian territory (ROCADA) IEG, Moldova data recorded by meteorological stations and posts of the State Hydro-meteorological Service NCEP Global Analysis Data with 1º resolution, available since 2000 NIGGG, Bulgaria TNO high resolution emission inventory for Europe Data of the pollution levels, measured by the Bulgarian National Network for Air Quality Control, available since 2000 IGEWE, Albania data collected from the Hydrological, Meteorological and Seismological networks (such as water flow, temperature, humidity, precipitation etc., and a range of seismic data) <Event Name> 24

25 Data sets: life sciences Simulation and observation data; global and local sets Country Available data Access Policy (Private, Regional, Public) Greece Virtual screening results Data that is published is public and can be shared Serbia SNP database of variations in genes involved in Cystic Fibrosis, Thrombosis, Alpha-1- Antitripsine deficiency, Colorectal cancer, Thyroid cancer, Lung cancer, Endometrium. The database contains data on Serbian population. Data that is published is public and can be shared Moldova Investigation Analytics, Research Results, Pathologies case studies Investigation Analytics and Research Results are shared information. Pathologies case studies (no personal patient info) available for research community by creating agreement with institution. <Event Name> 25

26 Data sets: cultural heritage Source Description URL Ancient Cypriot Literature Digital Corpus (AKGDC) STARC repository Electronic Corpus of Karamanlidika The digital collection of Bibliotheca Alexandrina Searchable digital library of Ancient Cypriot Literature. Covers the ancient Cypriot literary production from 7th century BC to 5th-6th century AD and examines it through its wide range of literary genres. Repository for digital CH objects created over the last 5 years at CyI. Including novel interactive methods for accessing and exploring information. Digitalization and transcription into Latin characters of a corpus of Karamanlidika printed material from different periods and genres with access to graphic, phonetic and morphemic varieties search. As a library of the 21st Century, the Bibliotheca Alexandrina (BA), along with its affiliated academic and cultural centres, is committed to digitization as a means of preserving, managing, and disseminating information and knowledge. The BA sets out to share them with a worldwide audience via the internet, thus promoting greater understanding and tolerance between cultures. To achieve this goal, the BA has formed partnerships with various cultural, academic, governmental, and corporate organizations for the creation of many significant and compelling digital projects. These projects cover a wide array of cultural and educational themes. Not public yet. y/starcrepo/ Not public yet. rg/libraries/presenta tion/static/12600.asp x?d=0 <Event Name> 26