XSEDE 2012 Tutorial

shantenujha edited this page Jul 16, 2012 · 25 revisions

Introduction

The SAGA-based Pilot-Job, known as BigJob, provides the unique capability to use Pilot-Jobs on the highest-performing machines as well as collectively on distributed cyberinfrastructure. It supports very large-scale parallel jobs, as well as high throughput of many smaller jobs. In addition to the number and range of job sizes that it supports, what makes BigJob unique among all Pilot-Jobs is its ability to be programmatically extended to support a range of "simple workflows," provide application-level control of both the Pilots and the tasks assigned to the Pilot-Job, and its interoperability over all XSEDE and OSG platforms.

This half-day tutorial will bring together SAGA team members, XSEDE staff, and XSEDE end users (scientists using BigJob) to deliver: The basic concepts behind Pilot-Jobs, several science exemplars that routinely use BigJob on XSEDE for extreme-scale science, introduction on how to use BigJob, how to use BigJob on XSEDE and OSG, how to program and customize BigJob for your needs, building frameworks using BigJob, and advanced concepts and application-level scheduling using BigJob.

Date and Time

Monday, July 16, 2012. 8am-12noon (Half-Day).

Agenda

Getting Started

This tutorial is meant to be run on XSEDE machines. BigJob can be installed to your local clusters by following the wiki. Required capabilities for this tutorial include: (1) a laptop, (2) ssh client [terminal in Mac/Lin, ux, PuTTy in Windows], (3) an XSEDE account [note: if you do not have one, we can provide training accounts].

About the Team

SAGA and BigJob were created and are maintained by the RADICAL group at Rutgers University. For more information, please visit our website: http:://radical.rutgers.edu