org.apache.spark

Interface ExecutorAllocationClient

All Known Implementing Classes:

CoarseGrainedSchedulerBackend, CoarseMesosSchedulerBackend, SimrSchedulerBackend, SparkContext, SparkDeploySchedulerBackend, YarnSchedulerBackend

public interface ExecutorAllocationClient

A client that communicates with the cluster manager to request or kill executors. This is currently supported only in YARN mode.

Method Summary

Methods

Modifier and Type	Method and Description
boolean	killExecutor(String executorId) Request that the cluster manager kill the specified executor.
boolean	killExecutors(scala.collection.Seq<String> executorIds) Request that the cluster manager kill the specified executors.
boolean	requestExecutors(int numAdditionalExecutors) Request an additional number of executors from the cluster manager.
boolean	requestTotalExecutors(int numExecutors) Express a preference to the cluster manager for a given total number of executors.

Method Detail

requestTotalExecutors

boolean requestTotalExecutors(int numExecutors)

Express a preference to the cluster manager for a given total number of executors. This can result in canceling pending requests or filing additional requests.

Returns:

whether the request is acknowledged by the cluster manager.

requestExecutors

boolean requestExecutors(int numAdditionalExecutors)

Request an additional number of executors from the cluster manager.

Returns:

whether the request is acknowledged by the cluster manager.

killExecutors

boolean killExecutors(scala.collection.Seq<String> executorIds)

Request that the cluster manager kill the specified executors.

Returns:

whether the request is acknowledged by the cluster manager.

killExecutor

boolean killExecutor(String executorId)

Request that the cluster manager kill the specified executor.

Returns:

whether the request is acknowledged by the cluster manager.