com.twitter.heron.scheduler.slurm

Class SlurmLauncher

java.lang.Object

com.twitter.heron.scheduler.slurm.SlurmLauncher

All Implemented Interfaces:

ILauncher, java.lang.AutoCloseable

public class SlurmLauncher
extends java.lang.Object
implements ILauncher

Launches the Slurm Scheduler. The launcher assumes a shared directory between the nodes. It first copies the heron distribution to the shared location every node can access. Then it launches the scheduler. The scheduler runs the heron-executor on each of the allocated nodes to start the topology components. The scheduler uses a node as a container.

Constructor Summary

Constructors

Constructor and Description
SlurmLauncher()

Method Summary

Modifier and Type	Method and Description
void	close() This is to for disposing or cleaning up any internal state accumulated by the ILauncher
void	initialize(Config mConfig, Config mRuntime) Initialize Launcher with Config, Uploader and topology.
boolean	launch(PackingPlan packing) Starts scheduler.
protected boolean	setupWorkingDirectory() setup the working directory mainly it downloads and extracts the heron-core-release and topology package to the working directory

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SlurmLauncher

public SlurmLauncher()

Method Detail

initialize

public void initialize(Config mConfig,
                       Config mRuntime)

Description copied from interface: ILauncher

Initialize Launcher with Config, Uploader and topology. These object will be passed from submitter main. Config will contain information that launcher may use to setup scheduler and other parameters required by launcher to contact services which will launch scheduler.

Specified by:

initialize in interface ILauncher

close

public void close()

Description copied from interface: ILauncher

This is to for disposing or cleaning up any internal state accumulated by the ILauncher

Closes this stream and releases any system resources associated with it. If the stream is already closed then invoking this method has no effect.

Specified by:

close in interface ILauncher

Specified by:

close in interface java.lang.AutoCloseable

launch

public boolean launch(PackingPlan packing)

Description copied from interface: ILauncher

Starts scheduler. Once this function returns successfully, heron-cli will terminate and the launch process succeeded.

Specified by:

launch in interface ILauncher

Parameters:

packing - Initial mapping suggested by running packing algorithm. container_id->List of instance_id to be launched on this container.

Returns:

true if topology launched successfully, false otherwise.

setupWorkingDirectory

protected boolean setupWorkingDirectory()

setup the working directory mainly it downloads and extracts the heron-core-release and topology package to the working directory

Returns:

false if setup fails