Following are the attributes for a S3 resource.
alias: An identifier that can be used to reference while defining the tasks
profile (Optional): The aws IAM profile, that will be used to connect to S3. This is an optional attributed, and the default value is "default"
- s3:alias: s3-liveprofile: data-sandbox
Following are the attributes for an EMR resource.
alias: An identifier that can be used to reference while defining the tasks.
keyFile: The private key file that's associated to the key pair, which is used to login to the master node. For more details about EC2 key pair, refer the aws document.
clusterId: This is the job flow id created, once the EMR is launched. Refer the AWS EMR document.
- emr:alias: test-clusterkeyFile: /path/to/key-pair.pemclusterId: J-xxxxxxxxxxxx
Once you're done, link the resources definition in the launch configuration.
project: Demoresources: /path/to/resources.yml