Data Analytics

Every night, the Vera C. Rubin Observatory will produce 20 terabytes of raw image data. And every day, the data will be processed in near-real-time, tracking unexpected events unfolding in the universe and creating a 500-petabyte archive for research. 

And that’s just one example of the advanced data analytics that have put us at the forefront of data-intensive research. From resource allocation services to database administration for large installations, we provide a number of essential services that enable discovery and expand scientific knowledge. Using traditional machine learning, deep learning, and software engineering expertise, we assist Industry Partner Program clients in making data-driven decisions. And, as part of the  C3.ai Digital Transformation Institute, we help scientists navigate the intersection of AI, machine learning, cloud computing, the internet of things, big data analytics, organizational behavior, public policy and ethics.

NCSA’s Data Analytics team works with researchers and scientists to help analyze their large datasets to make the most effective use of the resources we provide. Here’s a small sampling of the types of projects we can support:

Bioimaging Analysis

We specialize in working with biological and biomedical images, applying deep learning and software engineering techniques into problem-solving.

Spatial Data Science

NCSA has a long history of applying machine-learning and deep-learning techniques into remote sensing and satellite image data for classification, mapping and change detection purposes of the natural environment.

Machine Learning Software Development

We design and implement software libraries and apply them to simplify frequently encountered machine-learning problems.

HPC and Artificial Intelligence

We are involved in the operation, support and training of NCSA’s high-performance computing systems, such as HOLL-I and HAL, and leveraging them into artificial intelligence applications. We won second place in a prestigious AI competition on critical mineral assessment, co-sponsored by DARPA and the U.S. Geological Survey.

Data Analytics Consulting

NCSA works with faculty, students and industrial partners on research and industrial consulting projects providing data-related solutions such as data processing, analysis, visualization, HPC performance tuning and cloud computing.

Questions about NCSA’s data analytics expertise and services?

Xiaoxia Liao
Technical Program Manager xialiao@illinois.edu
217-244-7174

NCSA Spotlight

Matthew Krafczyk photo

Matthew Krafczyk
Research Scientist

Matt leverages experience in computational physics and machine learning to bring research closer to real-world application.


“Deep learning and computational physics have driven some of the most important technological advances of the past decade. Working in these domains provides interesting challenges on a daily basis!”


Programming code abstract technology background of software developer and Computer script

This python package for pre-processing and augmenting geospatial data for Tensorflow deep learning models is just one example of how we help make managing data easier.

Dusk shot of an industrial scene along the road from Port Arthur to Sabine Pass, Texas. Original image from Carol M. Highsmith’s America, Library of Congress collection. Digitally enhanced by rawpixel.

Using data mining, data engineering, and machine learning, the team has helped Phillips 66 explore time series and geospatial data and more.

Project Highlights

Funded by the U.S. National Science Foundation, DeltaAI has been designed from the ground up to maximize the output of Artificial Intelligence and Machine Learning (AI/ML) research.

Stylized image of the Delta supercomputer with a blue overlay

Delta offers a balanced mixture of CPU and GPU nodes and is the most performant GPU computing resource in the National Science Foundation’s portfolio.

A HIPAA-compliant secure system capable of data storage and powerful computation. Nightingale offers a new way to manage complex requirements surrounding sensitive data, taking the burden off the user so they can focus on their research.

News

An image of a spacecraft launching with a great number of rockets visible, blasting off fire.

It is Rocket Science

Using a new algorithm and NCSA’s DeltaAI, a team of researchers reduced the energy cost of simulations by over 500% to help design safer and more efficient spacecraft.
A digital picture of a brain over a circuitboard.

Breaking Barriers – Delta Helps Reveal the Brain’s Gatekeeper

Researchers from Cornell University use Delta to explore how a protein in the blood-brain barrier could be the key to better deliver treatments to the brain.
A neon map abstract graphic

University of Illinois Receives $25 Million Contract from NGA

NCSA strengthened its longstanding partnership with the National Geospatial-Intelligence Agency through a new agreement.
A digital representation of a heart, with and EKG line in the background, and computer circuitry as well. Meant to convey the merging of research computing and health sciences.

Protecting Your Beating Heart

NCSA resources assist a researcher from Ohio State University in studying atrial fibrillation in order to create better treatments for this deadly condition.
NCSA | National Center for Supercomputing Applications
1205 W. Clark St.
Urbana, IL 61801
217-244-0710