org.apache.spark.util

Class MetadataCleaner

Object

org.apache.spark.util.MetadataCleaner

All Implemented Interfaces:

Logging

public class MetadataCleaner
extends Object
implements Logging

Runs a timer task to periodically clean up metadata (e.g. old files or hashtable entries)

Constructor Summary

Constructors

Constructor and Description
MetadataCleaner(scala.Enumeration.Value cleanerType, scala.Function1<Object,scala.runtime.BoxedUnit> cleanupFunc, SparkConf conf)

Method Summary

Methods

Modifier and Type	Method and Description
void	cancel()
static int	getDelaySeconds(SparkConf conf)
static int	getDelaySeconds(SparkConf conf, scala.Enumeration.Value cleanerType)
String	name()
static void	setDelaySeconds(SparkConf conf, scala.Enumeration.Value cleanerType, int delay)
static void	setDelaySeconds(SparkConf conf, int delay, boolean resetAll) Set the default delay time (in seconds).

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.Logging

initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

MetadataCleaner

public MetadataCleaner(scala.Enumeration.Value cleanerType,
               scala.Function1<Object,scala.runtime.BoxedUnit> cleanupFunc,
               SparkConf conf)

Method Detail

getDelaySeconds

public static int getDelaySeconds(SparkConf conf)

getDelaySeconds

public static int getDelaySeconds(SparkConf conf,
                  scala.Enumeration.Value cleanerType)

setDelaySeconds

public static void setDelaySeconds(SparkConf conf,
                   scala.Enumeration.Value cleanerType,
                   int delay)

setDelaySeconds

public static void setDelaySeconds(SparkConf conf,
                   int delay,
                   boolean resetAll)

Set the default delay time (in seconds).

Parameters:

conf - SparkConf instance

delay - default delay time to set

resetAll - whether to reset all to default

name

public String name()

cancel

public void cancel()