Concepts Overview

Launch configuration embodies the following concepts.

Tasks

Tasks are the smallest unit of computation. There are different types of tasks, that a user can define. The next section covers a variety of tasks that can be executed on different resources and platform.

Stages

Launch configuration groups tasks in stages. Each stage will execute the tasks sequentially. Currently all the stages will execute sequentially.

Resources

Resources are services or environments where the tasks are executed. Currently supported resources are Remote servers, AWS S3 and AWS EMR. These resources are specified in a separate resource file.

Every Resource, must have the attribute alias is an identifier.

‚Äč