SC20 BoF: Designing and Building Next-Generation Computer Systems for Deep Learning

Date: Tuesday, November 17
Time: 2:30–3:45 p.m. U.S. Eastern Time
Location: Virtual

Deep learning (DL) heavily relies on fast hardware and parallel algorithms to train complex neural networks. This BoF will bring together researchers and developers working on the design of next-generation computer systems for DL and parallel DL algorithms that can exploit the potential of these new systems. Research teams working on major deep learning systems deployed in the field will be invited to discuss latest hardware and software trends and to exchange views on the role Artificial Intelligence (AI) in general and DL in particular will play in the near future for big data analytics and HPC applications.

The BoF is co-organized by Volodymyr Kindratenko from NCSA, Yangang Wang from Computer Network Information Center (CNIC) of Chinese Academy of Sciences, and Morris Riedel from Forschungszentrum Juelich.

BoF Presenters

  • Erik Deumens, Director, UF Information Technology — Research Computing, University of Florida
  • Kunle Olukotun, Co-Founder and Chief Technologist, SambaNova Systems
  • Paola Buitrago, Director, AI and Big Data, Pittsburgh Supercomputing Center

Presenter Bios
Erik Deumens

Erik Deumens is the director of the Research Computing team in Information Technology at the University of Florida since 2011. He has a career in computational nuclear and chemical physics and quantum chemistry, in which he developed the theory and software for electron nuclear dynamics simulations and created the super instruction architecture for parallel processing of coupled cluster methods that scales to ten thousand cores.

Kunle Olukotun

Kunle Olukotun is Cadence Design Professor of Electrical Engineering and Computer Science at Stanford University. He founded Afara Websystems, acquired by Sun in 2002. He is a Pioneer of Chip Multiprocessor Designs, Director of the Stanford Pervasive Parallelism Lab, and Co-leader of the Data Analytics for What’s Next (DAWN) research program.

In 2017 Olukotun and Chris Ré founded SambaNova Systems. SambaNova Systems has developed a disruptive next-generation computing platform to power machine learning and data analytics.

Paola A. Buitrago

Paola A. Buitrago leads the Artificial Intelligence and Big Data group at the Pittsburgh Supercomputing Center (PSC), which is a joint effort of Carnegie Mellon University and the University of Pittsburgh. Her group is focused on advancing and supporting the convergence of high-performance computing, artificial intelligence (AI) and Big Data. Paola is the principal investigator (PI) for the upcoming NSF-funded ($5M) Neocortex, a specialized supercomputer that is designed to revolutionize national AI-enabled research by incorporating specialized AI-hardware (Cerebras CS-1). She is also PI for Open Compass, a new platform for AI research on emerging hardware and software technologies, enabling the development of advanced algorithms and modeling approaches, and co-PI for Bridges and Bridges-2, two large multipurpose supercomputers at PSC.

Paola's diverse background includes research in deep learning, large scale data, and workflow management for high energy physics experiments at the Fermi National Accelerator Laboratory. Paola's academic background includes a Bachelor's degree in Chemical Engineering and a Bachelor's in Systems and Computing Engineering. She holds a Master's from Universidad de los Andes in Bogotá, Colombia.