sponsored byACMIEEE The International Conference for High Performance 
Computing, Networking, Storage and Analysis
FacebookTwitterGoogle PlusLinkedInYouTubeFlickr

SCHEDULE: NOV 15-20, 2015

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

Large-Scale Compute-Intensive Analysis via a Combined In-Situ and Co-Scheduling Workflow Approach

SESSION: In-Situ (Simulation Time) Analysis


EVENT TAG(S): Applications, Analytics, Scientific Computing, Simulation

TIME: 3:30PM - 4:00PM


AUTHOR(S):Christopher Sewell, Katrin Heitmann, Hal Finkel, George Zagaris, Suzanne T. Parete-Koon, Patricia K. Fasel, Adrian Pope, Nicholas Frontiere, Li-ta Lo, Bronson Messer, Salman Habib, James Ahrens



Large-scale simulations can produce tens of terabytes of data per analysis cycle, complicating and limiting the efficiency of workflows. Traditionally, outputs are stored on the file system and analyzed in post-processing. With the rapidly increasing size and complexity of simulations, this approach faces an uncertain future. Trending techniques consist of performing the analysis in situ, utilizing the same resources as the simulation, and/or off-loading subsets of the data to a compute-intensive analysis system. We introduce an analysis framework developed for HACC, a cosmological N-body code, that uses both in situ and co-scheduling approaches for handling petabyte-size outputs. We compare different analysis set-ups ranging from purely off-line, to purely in situ to in situ/co-scheduling. The analysis routines are implemented using the PISTON/VTK-m framework, allowing a single implementation of an algorithm that simultaneously targets a variety of GPU, multi-core, and many-core architectures.

Chair/Author Details:

Suren Byna (Chair) - Lawrence Berkeley National Laboratory|

Christopher Sewell - Los Alamos National Laboratory

Katrin Heitmann - Argonne National Laboratory

Hal Finkel - Argonne National Laboratory

George Zagaris - Lawrence Livermore National Laboratory

Suzanne T. Parete-Koon - Oak Ridge National Laboratory

Patricia K. Fasel - Los Alamos National Laboratory

Adrian Pope - Argonne National Laboratory

Nicholas Frontiere - University of Chicago

Li-ta Lo - Los Alamos National Laboratory

Bronson Messer - Oak Ridge National Laboratory

Salman Habib - Argonne National Laboratory

James Ahrens - Los Alamos National Laboratory

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

Paper provided by the ACM Digital Library

Paper also available from IEEE Computer Society