org.apache.hadoop.hbase.regionserver

Class TestHRegionReplayEvents

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents

public class TestHRegionReplayEvents
extends Object

Tests of HRegion methods for replaying flush, compaction, region open, etc events for secondary region replicas

Field Summary

Fields

Modifier and Type	Field and Description
static HBaseClassTestRule	CLASS_RULE
static org.apache.hadoop.conf.Configuration	CONF
protected byte[]	cq
protected String	method
org.junit.rules.TestName	name
protected byte[]	row
protected byte[]	row2
protected byte[]	tableName

Constructor Summary

Constructors

Constructor and Description
TestHRegionReplayEvents()

Method Summary

Modifier and Type	Method and Description
void	setUp()
static void	setUpBeforeClass()
void	tearDown()
static void	tearDownAfterClass()
void	testBatchReplayWithMultipleNonces()
void	testOnlyReplayingFlushStartDoesNotHoldUpRegionClose() Tests a case where we replay only a flush start marker, then the region is closed.
void	testRefresStoreFiles()
void	testRegionReadsEnabledFlag() Tests the reads enabled flag for the region.
void	testRegionReplicaSecondaryCannotFlush()
void	testReplayBulkLoadEvent() Tests replaying region open markers from primary region.
void	testReplayFlushCommitMarkerLargerThanFlushStartMarker() Tests the case where we prepare a flush with some seqId and we receive a flush commit marker larger than the previous flush start marker.
void	testReplayFlushCommitMarkerSmallerThanFlushStartMarker() Tests the case where we prepare a flush with some seqId and we receive a flush commit marker less than the previous flush start marker.
void	testReplayFlushCommitMarkerWithoutFlushStartMarker(boolean droppableMemstore) Tests the case where we receive a flush commit before receiving any flush prepare markers
void	testReplayFlushCommitMarkerWithoutFlushStartMarkerDroppableMemstore() Tests the case where we receive a flush commit before receiving any flush prepare markers.
void	testReplayFlushCommitMarkerWithoutFlushStartMarkerNonDroppableMemstore() Tests the case where we receive a flush commit before receiving any flush prepare markers.
void	testReplayFlushesAndCompactions()
void	testReplayFlushSeqIds()
void	testReplayFlushStartMarkers() Tests cases where we prepare a flush with some seqId and we receive other flush start markers equal to, greater or less than the previous flush start marker.
void	testReplayingBulkLoadEventWithFileAlreadyDeleted()
void	testReplayingCompactionWithFileAlreadyDeleted()
void	testReplayingFlushCommitWithFileAlreadyDeleted()
void	testReplayingFlushRequestRestoresReadsEnabledState() Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region.
void	testReplayingFlushRestoresReadsEnabledState() Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region.
void	testReplayingFlushWithEmptyMemstoreRestoresReadsEnabledState() Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region.
void	testReplayingRegionOpenEventRestoresReadsEnabledState() Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region.
void	testReplayingRegionOpenEventWithFileAlreadyDeleted()
void	testReplayRegionOpenEvent() Tests replaying region open markers from primary region.
void	testReplayRegionOpenEventAfterFlushStart() Tests the case where we replay a region open event after a flush start but before receiving flush commit
void	testSecondaryRegionDoesNotWriteRegionEventsToWAL() Tests that a region opened in secondary mode would not write region open / close events to its WAL.
void	testSeqIdsFromReplay()
void	testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent() Tests whether edits coming in for replay are skipped which have smaller seq id than the seqId of the last replayed region open event.
void	testWriteFlushRequestMarker() Tests the case where a request for flush cache is sent to the region, but region cannot flush.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

name

public org.junit.rules.TestName name

CONF

public static org.apache.hadoop.conf.Configuration CONF

tableName

protected byte[] tableName

method

protected String method

row

protected final byte[] row

row2

protected final byte[] row2

cq

protected byte[] cq

Constructor Detail

TestHRegionReplayEvents

public TestHRegionReplayEvents()

Method Detail

setUpBeforeClass

public static void setUpBeforeClass()
                             throws Exception

Throws:

Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws Exception

Throws:

Exception

setUp

public void setUp()
           throws Exception

Throws:

Exception

tearDown

public void tearDown()
              throws Exception

Throws:

Exception

testRegionReplicaSecondaryCannotFlush

public void testRegionReplicaSecondaryCannotFlush()
                                           throws IOException

Throws:

IOException

testOnlyReplayingFlushStartDoesNotHoldUpRegionClose

public void testOnlyReplayingFlushStartDoesNotHoldUpRegionClose()
                                                         throws IOException

Tests a case where we replay only a flush start marker, then the region is closed. This region should not block indefinitely

Throws:

IOException

testBatchReplayWithMultipleNonces

public void testBatchReplayWithMultipleNonces()
                                       throws IOException

Throws:

IOException

testReplayFlushesAndCompactions

public void testReplayFlushesAndCompactions()
                                     throws IOException

Throws:

IOException

testReplayFlushStartMarkers

public void testReplayFlushStartMarkers()
                                 throws IOException

Tests cases where we prepare a flush with some seqId and we receive other flush start markers equal to, greater or less than the previous flush start marker.

Throws:

IOException

testReplayFlushCommitMarkerSmallerThanFlushStartMarker

public void testReplayFlushCommitMarkerSmallerThanFlushStartMarker()
                                                            throws IOException

Tests the case where we prepare a flush with some seqId and we receive a flush commit marker less than the previous flush start marker.

Throws:

IOException

testReplayFlushCommitMarkerLargerThanFlushStartMarker

public void testReplayFlushCommitMarkerLargerThanFlushStartMarker()
                                                           throws IOException

Tests the case where we prepare a flush with some seqId and we receive a flush commit marker larger than the previous flush start marker.

Throws:

IOException

testReplayFlushCommitMarkerWithoutFlushStartMarkerDroppableMemstore

public void testReplayFlushCommitMarkerWithoutFlushStartMarkerDroppableMemstore()
                                                                         throws IOException

Tests the case where we receive a flush commit before receiving any flush prepare markers. The memstore edits should be dropped after the flush commit replay since they should be in flushed files

Throws:

IOException

testReplayFlushCommitMarkerWithoutFlushStartMarkerNonDroppableMemstore

public void testReplayFlushCommitMarkerWithoutFlushStartMarkerNonDroppableMemstore()
                                                                            throws IOException

Tests the case where we receive a flush commit before receiving any flush prepare markers. The memstore edits should be not dropped after the flush commit replay since not every edit will be in flushed files (based on seqId)

Throws:

IOException

testReplayFlushCommitMarkerWithoutFlushStartMarker

public void testReplayFlushCommitMarkerWithoutFlushStartMarker(boolean droppableMemstore)
                                                        throws IOException

Tests the case where we receive a flush commit before receiving any flush prepare markers

Throws:

IOException

testReplayRegionOpenEvent

public void testReplayRegionOpenEvent()
                               throws IOException

Tests replaying region open markers from primary region. Checks whether the files are picked up

Throws:

IOException

testReplayRegionOpenEventAfterFlushStart

public void testReplayRegionOpenEventAfterFlushStart()
                                              throws IOException

Tests the case where we replay a region open event after a flush start but before receiving flush commit

Throws:

IOException

testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent

public void testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent()
                                                           throws IOException

Tests whether edits coming in for replay are skipped which have smaller seq id than the seqId of the last replayed region open event.

Throws:

IOException

testReplayFlushSeqIds

public void testReplayFlushSeqIds()
                           throws IOException

Throws:

IOException

testSeqIdsFromReplay

public void testSeqIdsFromReplay()
                          throws IOException

Throws:

IOException

testSecondaryRegionDoesNotWriteRegionEventsToWAL

public void testSecondaryRegionDoesNotWriteRegionEventsToWAL()
                                                      throws IOException

Tests that a region opened in secondary mode would not write region open / close events to its WAL.

Throws:

IOException

testRegionReadsEnabledFlag

public void testRegionReadsEnabledFlag()
                                throws IOException

Tests the reads enabled flag for the region. When unset all reads should be rejected

Throws:

IOException

testWriteFlushRequestMarker

public void testWriteFlushRequestMarker()
                                 throws IOException

Tests the case where a request for flush cache is sent to the region, but region cannot flush. It should write the flush request marker instead.

Throws:

IOException

testReplayingFlushRequestRestoresReadsEnabledState

public void testReplayingFlushRequestRestoresReadsEnabledState()
                                                        throws IOException

Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region. Replaying CANNOT_FLUSH flush marker entry should restore the reads enabled status in the region and allow the reads to continue.

Throws:

IOException

testReplayingFlushRestoresReadsEnabledState

public void testReplayingFlushRestoresReadsEnabledState()
                                                 throws IOException

Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region. Replaying flush start and commit entries should restore the reads enabled status in the region and allow the reads to continue.

Throws:

IOException

testReplayingFlushWithEmptyMemstoreRestoresReadsEnabledState

public void testReplayingFlushWithEmptyMemstoreRestoresReadsEnabledState()
                                                                  throws IOException

Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region. Replaying flush start and commit entries should restore the reads enabled status in the region and allow the reads to continue.

Throws:

IOException

testReplayingRegionOpenEventRestoresReadsEnabledState

public void testReplayingRegionOpenEventRestoresReadsEnabledState()
                                                           throws IOException

Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region. Replaying region open event entry from primary should restore the reads enabled status in the region and allow the reads to continue.

Throws:

IOException

testRefresStoreFiles

public void testRefresStoreFiles()
                          throws IOException

Throws:

IOException

testReplayBulkLoadEvent

public void testReplayBulkLoadEvent()
                             throws IOException

Tests replaying region open markers from primary region. Checks whether the files are picked up

Throws:

IOException

testReplayingFlushCommitWithFileAlreadyDeleted

public void testReplayingFlushCommitWithFileAlreadyDeleted()
                                                    throws IOException

Throws:

IOException

testReplayingCompactionWithFileAlreadyDeleted

public void testReplayingCompactionWithFileAlreadyDeleted()
                                                   throws IOException

Throws:

IOException

testReplayingRegionOpenEventWithFileAlreadyDeleted

public void testReplayingRegionOpenEventWithFileAlreadyDeleted()
                                                        throws IOException

Throws:

IOException

testReplayingBulkLoadEventWithFileAlreadyDeleted

public void testReplayingBulkLoadEventWithFileAlreadyDeleted()
                                                      throws IOException

Throws:

IOException