cionitoiu / simple_yarn_app_skeleton

Simple YARN App Skeleton, including a YARN Client, Application Master and Container.

Simple YARN Application Skeleton

This repo contains a barebones implementation of a YARN app, including:

• A YARN Client.
• An Application Master.
• A Container.
• A Utils class needed for configurations.

Behavior:

• This application launches the YARN Client,
• which in turn launches the Application Master,
• which in turn launches 3 Containers,
• which in turn print "Hello World!".

Launch Script (./launch.sh):

The simple script included builds the required YARNAPP.jar that contain the four java classes, puts the jar in HDFS under /apps/YARNAPP.jar, executes the application in hadoop and then outputs its entire log from all components. Feel free to modify it to fit your needs.

Example Log Output:

Client: Initializing
Client: Submitting application_1426756669209_0005
Client: Finished application_1426756669209_0005 with state FINISHED

AppMaster: Initializing
AppMaster: Registered
AppMaster: Requesting 3 Containers
AppMaster: Unregistered

Container: Initializing
Hello World!
Container: Finalizing

Container: Initializing
Hello World!
Container: Finalizing

Container: Initializing
Hello World!
Container: Finalizing

Simple YARN Application Skeleton
(C) 2015 George Piskas, Philémon Favrod