Sourcing in Scientific Computing BAT Nr. 25 Fertigungstiefe Juni 28, 2013 Dr. Michele De Lorenzi, CSCS, Lugano
Agenda Short portrait CSCS Swiss National Supercomputing Centre Why supercomputing? Special infrastructure requirements for supercomputers The new CSCS building The challenge Our approach: Co-Design CSCS 2013 2
CSCS in a nutshell An autonomous unit of the Swiss Federal Institute of Technology in Zurich (ETH Zurich) founded in 1991 in Manno relocated to Lugano in 2012 Develops and promotes technical and scientific services for the Swiss research community in the field of high-performance computing Enables world-class scientific research by pioneering, operating and supporting leading-edge supercomputing technologies CSCS 2013 3
The users of CSCS Scientific users can access CSCS computing resources for free They have to submit project requests that are assessed by international experts 325 million computing hours have been allocated in 2012 80 projects, 842 users CSCS operates third party systems for paying customers MeteoSwiss to compute the numerical weather forecasts The physicists of the Swiss universities to analyse the data from the LHC experiment at CERN CSCS 2013 4
Users by scientific field CSCS 2013 5
Users by organisation CSCS 2013 6
Why supercomputing? CSCS 2013 7
Why supercomputing? Simulation of processes that it would be too expensive or impossible to study in a laboratory Astrophysics: Birth of galaxies, stars and planets, Biology: Study of the interactions between cells, viruses, bacteria,... Chemistry: Interactions between molecules, development of drugs, Physics: Superconductivity, development of new materials, Fluid dynamics: Combustion, optimisation of turbines and wings, Analysis of large scientific experiments Data from the Large Hadron Collider (LHC) at CERN in Geneva Databases with genomic information Observations from radio telescopes CSCS 2013 8
How do computational scientists work? Mathematical description/ physical laws Algorithms and programs Graphs / Visualisations Input data Simulation on supercomputers Results CSCS 2013 10
Simulation of a zebra fish larva, ETH Zurich CSCS 2013 11
Formation of tectonic plates, ETH Zurich CSCS 2013 12
Simulation of the birth of a galaxy, UZH CSCS 2013 13
Special infrastructure requirements for supercomputers CSCS 2013 14
ENIAC, USA, 1946 Electronic Numerical Integrator And Computer Ballistic Calculations Size 27 t 2.4 m 0.9 m 30 m 150 kw Cost: $5 900 000 CSCS 2013 15
Earth Simulator, Japan, 2002 Run global climate models Size Interconnect 14 m x 13 m Computer 41 m x 40 m 6.4 MW Cost $400,000,000 35.86 TFLOPS CSCS 2013 16
Cray XC30 Piz Daint, Switzerland, 2013 User Lab for Swiss Scientists 36 096 cores - 72 TB of RAM 1PB TB local disks Size 23 t 47 m 2 650 kw 750 TFlops CSCS 2013 17
The CSCS building CSCS 2013 19
The office building Office building 5 floors 2 600 m 2 Standard Minergie Offices for 55 people Two conference rooms CSCS 2013 20
The computer building Computer building Connected by a bridge and a tunnel to the office building 3 floors CSCS 2013 21
The computer building: resource deck Resource deck Transformers from 16 000 to 400 Volt Batteries Preparation of cold water CSCS 2013 22
The computer building: distribution deck Distribution deck Electrical distribution Preparation of cold water Network and interconnect CSCS 2013 23
The computer building: machine room Machine room 2 000 m 2 No pillars 4 000kg per m 2 Up to 11 MW (upgradable to 20 MW) CSCS 2013 24
The challenges CSCS 2013 25
Short life cycle of about 3 years 1991 NEC SX3 5.5 GF Adula 1996 NEC SX4 10 GF Gottardo 1999 NEC SX5 64 GF Prometeo 2002 IBM SP4 1.3 TF Venus 2005 Cray XT3 5.8 TF Palu 2006 IBM P5 4.5 TF Blanc 2009-12 Cray XE6 402 TF Monte Rosa 2013 Cray XC30 750 TF Piz Daint 26
Efficiency Have supercomputer efficiently solve the problems of the scientists How high is the CPU load when computing a numerical weather forecast? About 4% CSCS 2013 27
Our approach: Co-Design CSCS 2013 28
CSCS 2013 29
The High Performance and High Productivity Computing Platform 2009-13 Scientific Problem Simulations + Theory + Experiment Swiss Universities / Federal Institutes of Technology (presently 12 domain science projects in HP2C Platform) Domain science projects lead by research groups at Swiss universities Supercomputer Interdisciplinary teams consisting of: > model & method development > application software design / engineering > system software (everything between apps & hardware) > numerical libraries / programming environments > mapping methods onto computer hardware/ systems > hardware design / engineering CSCS & University della Svizzera italiana (collaboration with computer industry: e.g. Cray, IBM, Mellanox, SCS) IT manufacturers system integrators CSCS 2013 30
Domain Science Networks Co-design Projects 2013-16 GeoScale A framework for multi-scale seismic modelling and inversion. CSCS 2013 31
CSCS 2013 32
Life Cycle Organization ETH Zurich Director Thomas Schulthess User Reference Group Staff Unit Michele De Lorenzi Sci. Community Engagement Michele De Lorenzi Future Systems Sadaf Alam Technology Integration Thomas Schoenemeyer Computing Services Thomas Schulthess Business Services Ladina Gilly User Support Maria Grazia Giuffreda Facilities Tiziano Belotti National Systems Colin McMurtrie IT Services Ladina Gilly CSCS 2013 HPC Solutions Luc Corbeil Administrative Services Ladina Gilly
Thanks for your attention. CSCS 2013 34