PartitionSchemed

abstract def fields: Fields

abstract def partitionConverter: TupleConverter[P]

abstract def partitionSetter: TupleSetter[P]

abstract def path: String

abstract def template: String

abstract def valueConverter: TupleConverter[T]

abstract def valueSetter: TupleSetter[T]

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

def andThen[U](fn: ((P, T)) ⇒ U): TypedSource[U]

Transform this TypedSource into another by mapping after.

final def asInstanceOf[T0]: T0

def checkFlowDefNotNull()(implicit flowDef: FlowDef, mode: Mode): Unit

def clone(): AnyRef

def contraMap[U](fn: (U) ⇒ (P, T)): TypedSink[U]

Transform this sink into another type by applying a function first

def converter[U >: (P, T)]: TupleConverter[U]

Combine both the partition and value converter to extract the data from a flat cascading tuple into a pair of P and T.

def createHfsTap(scheme: Scheme[JobConf, RecordReader[_, _], OutputCollector[_, _], _, _], path: String, sinkMode: SinkMode): Hfs

def createTap(readOrWrite: AccessMode)(implicit mode: Mode): Tap[_, _, _]

Creates the taps for local and hdfs mode.

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def finalize(): Unit

final def flatMapTo[U](out: Fields)(mf: ((P, T)) ⇒ TraversableOnce[U])(implicit flowDef: FlowDef, mode: Mode, setter: TupleSetter[U]): Pipe

If you want to filter, you should use this and output a 0 or 1 length Iterable.

final def getClass(): Class[_]

def hashCode(): Int

def hdfsScheme: Scheme[JobConf, RecordReader[_, _], OutputCollector[_, _], _, _]

The scheme to use if the source is on hdfs.

final def isInstanceOf[T0]: Boolean

def localScheme: Scheme[Properties, InputStream, OutputStream, _, _]

The scheme to use if the source is local.

final def mapTo[U](out: Fields)(mf: ((P, T)) ⇒ U)(implicit flowDef: FlowDef, mode: Mode, setter: TupleSetter[U]): Pipe

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def partitionFields: Fields

def read(implicit flowDef: FlowDef, mode: Mode): Pipe

def setter[U <: (P, T)]: TupleSetter[U]

Flatten a pair of P and T into a cascading tuple.

def sinkFields: Fields

val sinkMode: SinkMode

def sourceFields: Fields

def sourceId: String

This is a name the refers to this exact instance of the source (put another way, if s1.sourceId == s2.sourceId, the job should work the same if one is replaced with the other

final def synchronized[T0](arg0: ⇒ T0): T0

def toIterator(implicit config: Config, mode: Mode): Iterator[(P, T)]

Allows you to read a Tap on the submit node NOT FOR USE IN THE MAPPERS OR REDUCERS.

def toString(): String

def transformForRead(pipe: Pipe): Pipe

def transformForWrite(pipe: Pipe): Pipe

def transformInTest: Boolean

The mock passed in to scalding.JobTest may be considered as a mock of the Tap or the Source.

def validateTaps(mode: Mode): Unit

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

def writeFrom(pipe: Pipe)(implicit flowDef: FlowDef, mode: Mode): Pipe

write the pipe but return the input so it can be chained into the next operation

def readAtSubmitter[T](implicit mode: Mode, conv: TupleConverter[T]): Stream[T]