com.twitter.summingbird.batch

CalendarBatcher

final case class CalendarBatcher(unitCount: Int, calField: CalField) extends Batcher with Product with Serializable

This batcher numbers batches based on a Calendar, not just milliseconds. Many offline HDFS sources at Twitter are batched in this way based on hour or day in the UTC calendar

Source
CalendarBatcher.scala
Linear Supertypes
Serializable, Product, Equals, Batcher, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. CalendarBatcher
  2. Serializable
  3. Product
  4. Equals
  5. Batcher
  6. Serializable
  7. AnyRef
  8. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CalendarBatcher(unitCount: Int, calField: CalField)

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. final def batchOf(t: Timestamp): BatchID

    Returns the batch into which the supplied Date is bucketed.

    Returns the batch into which the supplied Date is bucketed.

    Definition Classes
    CalendarBatcherBatcher
  8. def batchesCoveredBy(interval: Interval[Timestamp]): Interval[BatchID]

    Definition Classes
    Batcher
  9. val calField: CalField

  10. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. def cover(interval: Interval[Timestamp]): Interval[BatchID]

    What batches are needed to cover the given interval or: for all t in interval, batchOf(t) is in the result

    What batches are needed to cover the given interval or: for all t in interval, batchOf(t) is in the result

    Definition Classes
    Batcher
  12. def currentBatch: BatchID

    Returns the current BatchID.

    Returns the current BatchID.

    Definition Classes
    Batcher
  13. final def earliestTimeOf(batch: BatchID): Timestamp

    Returns the (inclusive) earliest time of the supplied batch.

    Returns the (inclusive) earliest time of the supplied batch.

    Definition Classes
    CalendarBatcherBatcher
  14. def enclosedBy(extremities: (BatchID, BatchID), other: Batcher): Iterable[BatchID]

    Definition Classes
    Batcher
  15. def enclosedBy(batchID: BatchID, other: Batcher): Iterable[BatchID]

    Returns the sequence of BatchIDs that the supplied other batcher would need to fetch to fully enclose the supplied batchID.

    Returns the sequence of BatchIDs that the supplied other batcher would need to fetch to fully enclose the supplied batchID.

    Definition Classes
    Batcher
  16. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  17. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  18. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  19. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  20. def isLowerBatchEdge(ts: Timestamp): Boolean

    Returns true if the supplied timestamp sits at the floor of the supplied batch.

    Returns true if the supplied timestamp sits at the floor of the supplied batch.

    Definition Classes
    Batcher
  21. def latestTimeOf(batch: BatchID): Timestamp

    Returns the latest time in the given batch

    Returns the latest time in the given batch

    Definition Classes
    Batcher
  22. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  23. final def notify(): Unit

    Definition Classes
    AnyRef
  24. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  25. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  26. def toInterval(b: BatchID): Interval[Timestamp]

    Definition Classes
    Batcher
  27. def toTimestamp(b: Interval[BatchID]): Interval[Timestamp]

    Definition Classes
    Batcher
  28. val unitCount: Int

  29. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from Batcher

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped