Introduction to Teraflow

Launcher is a configuration driven, cross platform data pipeline deployment tool.

It leverages yaml format for defining the steps that needs to be executed as part of the deployment. Follow the steps below to create a "Hello world" launch configuration.

  1. Create a yaml configuration to define the steps and save it with file name as demo.launch.yml

demo.flow.yml
project: Demo Project
stages:
- Welcome:
- cmd:
value: sleep 5
- exec:
script:
value: echo "Welcome back from the sleep"

2. Launch the pipeline, with the above configuration.

run.sh
teraflow demo

Have a look at the below screen cast to get the complete overview.

asciicast