Datastage Job Execution | The Orchestra

 

·         Conductor - initial Framework process

Score Composer

– Creates Section Leader processes (one/node)

Consolidates massages, to DataStage log

Manages orderly shutdown

·          Section Leader (one per Node)

– Forks Players processes (one/Stage)

Manages up/down communication

·         Players

– The actual processes associated with Stages

– Combined players: one process only

Sends stderr, stdout to Section Leader

Establish connections to other players for data flow

– Clean up upon completion

• Default Communication:

SMP: Shared Memory

MPP: Shared Memory (within hardware node) and TCP (across hardware nodes)


Post a Comment

Previous Post Next Post

Contact Form