org.apache.spark.streaming

Class CheckpointReader

java.lang.Object

org.apache.spark.streaming.CheckpointReader

public class CheckpointReader
extends java.lang.Object

Constructor Summary

Constructors

Constructor and Description
CheckpointReader()

Method Summary

Methods

Modifier and Type	Method and Description
protected static void	initializeLogIfNecessary(boolean isInterpreter)
protected static boolean	isTraceEnabled()
protected static org.slf4j.Logger	log()
protected static void	logDebug(scala.Function0<java.lang.String> msg)
protected static void	logDebug(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void	logError(scala.Function0<java.lang.String> msg)
protected static void	logError(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void	logInfo(scala.Function0<java.lang.String> msg)
protected static void	logInfo(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static java.lang.String	logName()
protected static void	logTrace(scala.Function0<java.lang.String> msg)
protected static void	logTrace(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
protected static void	logWarning(scala.Function0<java.lang.String> msg)
protected static void	logWarning(scala.Function0<java.lang.String> msg, java.lang.Throwable throwable)
static scala.Option<org.apache.spark.streaming.Checkpoint>	read(java.lang.String checkpointDir) Read checkpoint files present in the given checkpoint directory.
static scala.Option<org.apache.spark.streaming.Checkpoint>	read(java.lang.String checkpointDir, SparkConf conf, org.apache.hadoop.conf.Configuration hadoopConf, boolean ignoreReadError) Read checkpoint files present in the given checkpoint directory.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CheckpointReader

public CheckpointReader()

Method Detail

read

public static scala.Option<org.apache.spark.streaming.Checkpoint> read(java.lang.String checkpointDir)

Read checkpoint files present in the given checkpoint directory. If there are no checkpoint files, then return None, else try to return the latest valid checkpoint object. If no checkpoint files could be read correctly, then return None.

Parameters:

checkpointDir - (undocumented)

Returns:

(undocumented)

read

public static scala.Option<org.apache.spark.streaming.Checkpoint> read(java.lang.String checkpointDir,
                                                       SparkConf conf,
                                                       org.apache.hadoop.conf.Configuration hadoopConf,
                                                       boolean ignoreReadError)

Read checkpoint files present in the given checkpoint directory. If there are no checkpoint files, then return None, else try to return the latest valid checkpoint object. If no checkpoint files could be read correctly, then return None (if ignoreReadError = true), or throw exception (if ignoreReadError = false).

Parameters:

checkpointDir - (undocumented)

conf - (undocumented)

hadoopConf - (undocumented)

ignoreReadError - (undocumented)

Returns:

(undocumented)

logName

protected static java.lang.String logName()

log

protected static org.slf4j.Logger log()

logInfo

protected static void logInfo(scala.Function0<java.lang.String> msg)

logDebug

protected static void logDebug(scala.Function0<java.lang.String> msg)

logTrace

protected static void logTrace(scala.Function0<java.lang.String> msg)

logWarning

protected static void logWarning(scala.Function0<java.lang.String> msg)

logError

protected static void logError(scala.Function0<java.lang.String> msg)

logInfo

protected static void logInfo(scala.Function0<java.lang.String> msg,
           java.lang.Throwable throwable)

logDebug

protected static void logDebug(scala.Function0<java.lang.String> msg,
            java.lang.Throwable throwable)

logTrace

protected static void logTrace(scala.Function0<java.lang.String> msg,
            java.lang.Throwable throwable)

logWarning

protected static void logWarning(scala.Function0<java.lang.String> msg,
              java.lang.Throwable throwable)

logError

protected static void logError(scala.Function0<java.lang.String> msg,
            java.lang.Throwable throwable)

isTraceEnabled

protected static boolean isTraceEnabled()

initializeLogIfNecessary

protected static void initializeLogIfNecessary(boolean isInterpreter)