org.apache.spark.serializer

Class KryoSerializer

Object

org.apache.spark.serializer.Serializer

org.apache.spark.serializer.KryoSerializer

All Implemented Interfaces:

java.io.Serializable, org.apache.spark.internal.Logging

public class KryoSerializer
extends Serializer
implements org.apache.spark.internal.Logging, java.io.Serializable

A Spark serializer that uses the Kryo serialization library.

See Also:

Serialized Form

Note:

This serializer is not guaranteed to be wire-compatible across different versions of Spark. It is intended to be used to serialize/de-serialize data within a single Spark application.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.spark.internal.Logging

org.apache.spark.internal.Logging.SparkShellLoggingFilter

Constructor Summary

Constructors

Constructor and Description
KryoSerializer(SparkConf conf)

Method Summary

Modifier and Type	Method and Description
int	maxBufferSizeMb()
SerializerInstance	newInstance() Creates a new SerializerInstance.
com.esotericsoftware.kryo.Kryo	newKryo()
com.esotericsoftware.kryo.io.Output	newKryoOutput()
com.esotericsoftware.kryo.pool.KryoPool	pool()
Serializer	setDefaultClassLoader(ClassLoader classLoader) Sets a class loader for the serializer to use in deserialization.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.internal.Logging

$init$, initializeForcefully, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, initLock, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, org$apache$spark$internal$Logging$$log__$eq, org$apache$spark$internal$Logging$$log_, uninitialize

Constructor Detail

KryoSerializer

public KryoSerializer(SparkConf conf)

Method Detail

maxBufferSizeMb

public int maxBufferSizeMb()

newKryoOutput

public com.esotericsoftware.kryo.io.Output newKryoOutput()

pool

public com.esotericsoftware.kryo.pool.KryoPool pool()

newKryo

public com.esotericsoftware.kryo.Kryo newKryo()

setDefaultClassLoader

public Serializer setDefaultClassLoader(ClassLoader classLoader)

Description copied from class: Serializer

Sets a class loader for the serializer to use in deserialization.

Overrides:

setDefaultClassLoader in class Serializer

Parameters:

classLoader - (undocumented)

Returns:

this Serializer object

newInstance

public SerializerInstance newInstance()

Description copied from class: Serializer

Creates a new SerializerInstance.

Specified by:

newInstance in class Serializer