SCHEDULE: NOV 15-20, 2015

When viewing the Technical Program schedule, on the far righthand side is a column labeled "PLANNER." Use this planner to build your own schedule. Once you select an event and want to add it to your personal schedule, just click on the calendar icon of your choice (outlook calendar, ical calendar or google calendar) and that event will be stored there. As you select events in this manner, you will have your own schedule to guide you through the week.

An Elegant Sufficiency: Load-Aware Differentiated Scheduling of Data Transfers

SESSION: Data Transfers and Data Intensive Applications

EVENT TYPE: Papers

EVENT TAG(S): Clouds and Distributed Computing

TIME: 2:30PM - 3:00PM

SESSION CHAIR(S): Rosa M. Badia

AUTHOR(S):Rajkumar Kettimuthu, Gayane Vardoyan, Gagan Agrawal, P. Sadayappan, Ian Foster

ROOM:19AB

ABSTRACT:

We investigate the file transfer scheduling problem, where transfers among different endpoints must be scheduled to maximize pertinent metrics. We propose two new algorithms. The first, SEAL, uses runtime information and data-driven models to adapt transfer schedules and concurrency to maximize performance. We implement this algorithm using GridFTP as transfer protocol and evaluate it using real logs in a production WAN environment. Results show that SEAL can improve average slowdowns and turnaround times by up to 25% and worst-case slowdown and turnaround times by up to 50%, compared with the best-performing baseline scheme. Our second algorithm, STEAL, further leverages user-supplied categorization of transfers as either “interactive” (requiring immediate processing) or “batch” (less time-critical). Results show that STEAL reduces the average slowdown of interactive transfers by 63% compared to the best-performing baseline and by 21% compared to SEAL, while allowing batch tasks to use a large portion of the excess bandwidth.

Chair/Author Details:

Rosa M. Badia (Chair) - Barcelona Supercomputing Center|

Rajkumar Kettimuthu - Argonne National Laboratory

Gayane Vardoyan - University of Massachusetts

Gagan Agrawal - Ohio State University

P. Sadayappan - Ohio State University

Ian Foster - Argonne National Laboratory

  Click here to download .ics calendar file

  Click here to download .vcs calendar file

  Click here to add event to your Google Calendar

Paper provided by the ACM Digital Library

Paper also available from IEEE Computer Society