org.apache.hadoop.hbase.wal

Class IOTestProvider

java.lang.Object

org.apache.hadoop.hbase.wal.IOTestProvider

All Implemented Interfaces:

WALProvider

@InterfaceAudience.Private
public class IOTestProvider
extends Object
implements WALProvider

A WAL Provider that returns a single thread safe WAL that optionally can skip parts of our normal interactions with HDFS.

This implementation picks a directory in HDFS based on the same mechanisms as the FSHLogProvider. Users can configure how much interaction we have with HDFS with the configuration property "hbase.wal.iotestprovider.operations". The value should be a comma separated list of allowed operations:

• append : edits will be written to the underlying filesystem
• sync : wal syncs will result in hflush calls
• fileroll : roll requests will result in creating a new file on the underlying filesystem.

Additionally, the special cases "all" and "none" are recognized. If ommited, the value defaults to "all." Behavior is undefined if "all" or "none" are paired with additional values. Behavior is also undefined if values not listed above are included.

Only those operations listed will occur between the returned WAL and HDFS. All others will be no-ops.

Note that in the case of allowing "append" operations but not allowing "fileroll", the returned WAL will just keep writing to the same file. This won't avoid all costs associated with file management over time, becaue the data set size may result in additional HDFS block allocations.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.wal.WALProvider

WALProvider.AsyncWriter, WALProvider.Writer, WALProvider.WriterBase

Field Summary

Fields

Modifier and Type	Field and Description
protected AtomicBoolean	initialized

Constructor Summary

Constructors

Constructor and Description
IOTestProvider()

Method Summary

Modifier and Type	Method and Description
void	addWALActionsListener(WALActionsListener listener)
void	close()
long	getLogFileSize()
long	getNumLogFiles()
WAL	getWAL(RegionInfo region)
List<WAL>	getWALs()
void	init(WALFactory factory, org.apache.hadoop.conf.Configuration conf, String providerId)
void	shutdown()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.wal.WALProvider

getWALFileLengthProvider

Field Detail

initialized

protected AtomicBoolean initialized

Constructor Detail

IOTestProvider

public IOTestProvider()

Method Detail

init

public void init(WALFactory factory,
                 org.apache.hadoop.conf.Configuration conf,
                 String providerId)
          throws IOException

Specified by:

init in interface WALProvider

Parameters:

factory - factory that made us, identity used for FS layout. may not be null

conf - may not be null

providerId - differentiate between providers from one facotry, used for FS layout. may be null

Throws:

IOException

getWALs

public List<WAL> getWALs()

Specified by:

getWALs in interface WALProvider

getWAL

public WAL getWAL(RegionInfo region)
           throws IOException

Specified by:

getWAL in interface WALProvider

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface WALProvider

Throws:

IOException

shutdown

public void shutdown()
              throws IOException

Specified by:

shutdown in interface WALProvider

Throws:

IOException

getNumLogFiles

public long getNumLogFiles()

Specified by:

getNumLogFiles in interface WALProvider

getLogFileSize

public long getLogFileSize()

Specified by:

getLogFileSize in interface WALProvider

addWALActionsListener

public void addWALActionsListener(WALActionsListener listener)

Specified by:

addWALActionsListener in interface WALProvider