Developer API

org.apache.spark.io

Class LZ4CompressionCodec

Object

org.apache.spark.io.LZ4CompressionCodec

All Implemented Interfaces:

CompressionCodec

public class LZ4CompressionCodec
extends Object
implements CompressionCodec

LZ4 implementation of CompressionCodec. Block size can be configured by spark.io.compression.lz4.blockSize.

Note:

The wire protocol for this codec is not guaranteed to be compatible across versions of Spark. This is intended for use as an internal compression utility within a single Spark application.

Constructor Summary

Constructors

Constructor and Description
LZ4CompressionCodec(SparkConf conf)

Method Summary

Modifier and Type	Method and Description
java.io.InputStream	compressedInputStream(java.io.InputStream s)
java.io.OutputStream	compressedOutputStream(java.io.OutputStream s)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LZ4CompressionCodec

public LZ4CompressionCodec(SparkConf conf)

Method Detail

compressedOutputStream

public java.io.OutputStream compressedOutputStream(java.io.OutputStream s)

Specified by:

compressedOutputStream in interface CompressionCodec

compressedInputStream

public java.io.InputStream compressedInputStream(java.io.InputStream s)

Specified by:

compressedInputStream in interface CompressionCodec