Supercomputers and Superintelligence
Horst Simon (Lawrence Berkeley National Laboratory, USA)
In recent years the idea of emerging superintelligence has been discussed widely by popular media, and many experts voiced grave warnings about its possible consequences. This talk will use an analysis of progress in supercomputer performance to examine the gap between current technology and reaching the capabilities of the human brain. In spite of good progress in high performance computing (HPC) and techniques such as machine learning, this gap is still very large. The presentation will then explore two related topics through a discussion of recent examples: what can we learn from the brain and apply to HPC, e.g., through recent efforts in neuromorphic computing? And how much progress have we made in modeling brain function? The talk will be concluded with a perspective on the true dangers of superintelligence, and on our ability to ever build self-aware or sentient computers.
Horst Simon is an internationally recognized expert in the development of parallel computational methods for the solution of scientific problems of scale. His research interests are in the development of sparse matrix algorithms, algorithms for large-scale eigenvalue problems, and domain decomposition algorithms. His recursive spectral bisection algorithm is a breakthrough in parallel algorithms. Honored twice with the prestigious Gordon Bell Prize, most recently in 2009 for the development of innovative techniques that produce new levels of performance on a real application (in collaboration with IBM researchers) and in 1988 in recognition of superior effort in parallel processing research (with others from Cray and Boeing).
Horst Simon is Deputy Laboratory Director and Chief Research Officer (CRO) of Berkeley Labs. The Deputy Director is responsible for the overall integration of the scientific goals and objectives, consistent with the Laboratory's mission. Simon has been with Berkeley Lab since 1996, having served previously as Associate Laboratory Director for Computing Sciences, and Director of NERSC. His career includes positions at Stony Brook University, Boeing, NASA, and SGI. He received his Ph.D. in Mathematics from UC Berkeley, and a Diplom (M.A.) from TU Berlin, Germany. Simon is a SIAM Fellow and member of SIAM, ACM, and IEEE Computer Society.
Towards Quantum High Performance Computing
Matthias Troyer (Microsoft Research, USA)
A century after the development of quantum mechanics we have now reached an exciting time where computational devices that make use of quantum effects can be built. Quantum random number generators, analog quantum simulators and quantum annealers are already commercially available and work on quantum computers is accelerating. First demonstration quantum computers exist today and devices with computational powers beyond that of any imaginable classical computers seem just over the horizon and feasible within the next few years. Following an introduction to the exceptional computational power of quantum computers using analogies with classical high performance computing systems, I will discuss real-world application problems that can be tackled on medium scale quantum computers but not on post exa-scale classical computers. I will motivate hardware software co-design of quantum accelerators to classical supercomputers and the need for educating a new generation of quantum software engineers with knowledge both in quantum computing and in high performance computing.
Matthias Troyer is a Principal Researcher in the Quantum Architectures and Computation Group at Microsoft Research. He is a Fellow of the American Physical Society, a Trustee of the Aspen Center for Physics, and recipient of the Rahman Prize for Computational Physics of the American Physical Society. After receiving his PhD in 1994 from ETH Zurich he spent three years as postdoc at the University of Tokyo before returning to ETH Zurich. There he has been professor of Computational Physics until taking leave of absence to join Microsoft’s quantum computing program at the beginning of this year.
Unlocking the Mysteries of the Universe with Supercomputers
Katrin Heitmann (University of Chicago, USA)
Cosmology is in a scientifically very exciting phase. Two decades of surveying the sky have culminated in the celebrated Cosmological Standard Model. Yet, two of its key pillars, dark matter and dark energy, remain mysterious. Deep fundamental questions demand answers; to address these burning questions, survey capabilities are being exponentially improved. The new observations will pose tremendous challenges on many fronts -- from the sheer size of the data that will be collected to its modeling and interpretation. The interpretation of the data requires sophisticated simulations on the world's largest supercomputers. In this talk I will introduce HACC, the Hardware/Hybrid Accelerated Cosmology Code, which is being developed to combat the tremendous computational challenge to simulate our Universe.
Katrin Heitmann received her Dr. rer. nat. in physics from the Technical University of Dortmund in 2000. From 2000 - 2003 she was a Postdoctoral Fellow at Los Alamos National Laboratory in the Theoretical Division. In 2004 she became a staff member at Los Alamos and in 2011 moved to Argonne National Laboratory for a joint appointment in the High Energy Physics and Mathematics and Computer Science Divisions. Heitmann is a Senior Member of the Computation Institute at the University of Chicago and the Kavli Institute for Physical Cosmology.
Efforts on Scaling and Optimizing Climate and Weather Forecasting Programs on Sunway TaihuLight
Haohuan Fu (Tsinghua University, China)
The Sunway TaihuLight supercomputer is the world's first system with a peak performance greater than 100 PFlops, and a parallel scale of over 10 million cores. In contrast with other existing heterogeneous supercomputers, which include both CPU processors and PCIe-connected many-core accelerators (NVIDIA GPU or Intel MIC), the computing power of TaihuLight is provided by a homegrown many-core SW26010 CPU that includes both the management processing elements (MPEs) and computing processing elements (CPEs) in one chip. This talk reports our efforts on refactoring and optimizing the climate and weather forecasting programs on Sunway TaihuLight. To map the large code base of CAM and WRF to the millions of cores on the Sunway system, we take OpenACC-based refactoring as the major approach, and apply source-to-source translator tools to exploit the most suitable parallelism for the CPE cluster, and to fit the intermediate variable into the limited on-chip fast buffer. For individual kernels, when comparing the original ported version using only MPEs and the refactored version using both the MPE and CPE clusters, we achieve up to 22x speedup for the compute-intensive kernels. For the 25km resolution CAM global model, we manage to scale to 24,000 MPEs, and 1,536,000 CPEs, and achieve a simulation speed of 2.81 model years per day.
Haohuan Fu is the deputy director of the National Supercomputing Center in Wuxi, and leads the research and development efforts on Sunway TaihuLight, the current fastest supercomputer in the world. He is also an associate professor in the Ministry of Education Key Laboratory for Earth System Modeling, and Department of Earth System Science in Tsinghua University, where he leads the research group of High Performance Geo-computing (HPGC). His research interests include design methodologies for highly efficient and highly scalable simulation applications that can take advantage of emerging multi-core, many-core, and reconfigurable architectures, and make full utilization of current Peta-Flops and future ExaFlops supercomputers; and intelligent data Management, analysis, and data Mining platforms that combine the statistic methods and machine learning technologies. Fu has a PhD in computing from Imperial College London. Since joining Tsinghua in 2011, Dr. Fu has been working towards the goal of providing both the most efficient simulation platforms and the most intelligent data management and analysis platforms for geoscience applications. His research has, for example, led to efficient designs of atmospheric dynamic solvers for both Tianhe-1A, Tianhe-2, Sunway TaihuLight supercomputers, and the reconfigurable computing platforms. The work based on reconfigurable technology can be both faster and more energy efficient than the Tianhe-1A and Tianhe-2 supercomputer, leading to a publication selected as one of the 27 most Significant Papers of the FPL conference in 25 years (27 out of 1765). The work based on the Sunway TaihuLight supercomputer manages to scale a fully-implicit solver to over 10 million cores, which won the Gordon Bell Prize of SC16.
Towards the Decoding of the Human Brain
Katrin Amunts (Forschungszentrum Jülich, Germany)
The human brain has a multi-level organisation and high complexity. New approaches are necessary to decode the brain with its 86 billion nerve cells, each with 10,000 connections. E.g., 3D Polarized Light Imaging elucidates the connectional architecture at the level of axons, while keeping the topography of the whole organ; it results in data sets of several petabytes per brain, which should be actively accessible while minimizing their transport. The Human Brain Project creates a cutting-edge HPC- and HPDA infrastructure to address such challenges including cloud-based collaboration and development platforms with databases, workflow systems, petabyte storage, and supercomputers.
Katrin Amunts did postdoctoral work in the C. & O. Vogt Institute for Brain Research at Duesseldorf University, Germany. In 1999, she moved to the Research Centre Juelich and set up a new research unit for Brain Mapping. In 2004, she became professor for Structural-Functional Brain Mapping at RWTH Aachen University, and in 2008 a full professor at the Department of Psychiatry, Psychotherapy and Psychosomatics at the RWTH Aachen University as well as director of the Institute of Neuroscience and Medicine (INM-1) at the Research Centre Juelich. In 2013, she became a full professor for Brain Research at the Heinrich-Heine University Duesseldorf, director of the C. and O. Vogt Institute for Brain Research, Heinrich-Heine University Duesseldorf and director of the Institute of Neuroscience and Medicine (INM-1), Research Centre Juelich.
Since 2007 Katrin Amunts is a member of the editorial board of Brain Structure and Function. She is member of the German Ethics Council since 2012, and since 2016 vice chair of the German Ethics Council. Katrin Amunts is the programme speaker for the programme Decoding the Human Brain of the Helmholtz Association, Germany as well as speaker of the Helmholtz Portfolio Theme Supercomputing and Modeling for the Human Brain (SMHB). Since 2013 Katrin Amunts is leading the Subproject 2 Human Brain Organization of the European Flagship Project, The Human Brain Project (HBP). She has been recently elected as the Chair of the Scientific and Infrastructure Board (SIB) of the HBP. In order to better understand the organizational principles of the human brain, she and her team aim to develop a multi-level and multi-scale brain atlas, and use methods of high-performance computing to generate ultra-high resolution human brain models.