com.twitter.summingbird.batch

state

package state

Visibility
  1. Public
  2. All

Type Members

  1. trait CheckpointState[T] extends WaitingState[Interval[Timestamp]]

    State machine for checkpoint states.

  2. trait CheckpointStore[T] extends AnyRef

    To create an implemetation of CheckpointState you need first define a class of CheckpointStore see com.twitter.summingbird.batch.state.HDFSCheckpointStore for an example

  3. class HDFSCheckpointStore extends CheckpointStore[Iterable[BatchID]]

  4. class HDFSState extends CheckpointState[Iterable[BatchID]]

Value Members

  1. object HDFSState

    State implementation that uses an HDFS folder as a crude key-value store that tracks the batches currently processed.

Ungrouped