Package

com.twitter.scalding

source

Permalink

package source

Content Hierarchy
Visibility
  1. Public
  2. All

Type Members

  1. trait CheckedInversion[T, U] extends Serializable

    Permalink

    Handles the error checking for Injection inversion if check fails, it will throw an unrecoverable exception stopping the job TODO: probably belongs in Bijection

  2. class CodecSource[T] extends FileSource with Mappable[T] with LocalTapSource

    Permalink
  3. abstract class DailyPrefixSuffixMostRecentSource extends MostRecentGoodSource

    Permalink
  4. abstract class DailyPrefixSuffixSource extends TimePathedSource

    Permalink
  5. class DailySuffixCsv extends DailySuffixSource with DelimitedScheme

    Permalink
  6. class DailySuffixMostRecentCsv extends DailySuffixMostRecentSource with DelimitedScheme

    Permalink
  7. abstract class DailySuffixMostRecentSource extends MostRecentGoodSource

    Permalink
  8. abstract class DailySuffixSource extends TimePathedSource

    Permalink
  9. class DailySuffixTsv extends DailySuffixSource with DelimitedScheme

    Permalink
  10. class DailySuffixTypedTsv[T] extends DailySuffixSource with TypedDelimited[T]

    Permalink
  11. class FixedTypedText[T] extends FixedPathSource with TypedTextDelimited[T]

    Permalink
  12. class HourlySuffixCsv extends HourlySuffixSource with DelimitedScheme

    Permalink
  13. abstract class HourlySuffixMostRecentSource extends MostRecentGoodSource

    Permalink
  14. abstract class HourlySuffixSource extends TimePathedSource

    Permalink
  15. class HourlySuffixTsv extends HourlySuffixSource with DelimitedScheme

    Permalink
  16. class HourlySuffixTypedTsv[T] extends HourlySuffixSource with TypedDelimited[T]

    Permalink
  17. class MaxFailuresCheck[T, U] extends CheckedInversion[T, U]

    Permalink
  18. class MostRecentTypedText[T] extends MostRecentGoodSource with TypedTextDelimited[T]

    Permalink
  19. class TimePathTypedText[T] extends TimePathedSource with TypedTextDelimited[T]

    Permalink
  20. final case class TypedSep(str: String) extends AnyVal with Product with Serializable

    Permalink

    This object gives you easy access to text formats (possibly LZO compressed) by using a case class to describe the field names and types.

  21. class TypedSequenceFile[T] extends SequenceFile with Mappable[T] with TypedSink[T]

    Permalink

    SequenceFile with explicit types.

    SequenceFile with explicit types. Useful for debugging flows using the Typed API. Not to be used for permanent storage: uses Kryo serialization which may not be consistent across JVM instances. Use Thrift sources instead.

  22. trait TypedTextDelimited[T] extends SchemedSource with Mappable[T] with typed.TypedSink[T]

    Permalink

Value Members

  1. object BytesWritableCodec

    Permalink

    Source used to write some type T into a WritableSequenceFile using a codec on T for serialization.

  2. object CodecSource extends Serializable

    Permalink
  3. object DailySuffixCsv extends Serializable

    Permalink
  4. object DailySuffixMostRecentCsv extends Serializable

    Permalink
  5. object DailySuffixTsv extends Serializable

    Permalink
  6. object DailySuffixTypedTsv extends Serializable

    Permalink
  7. object HourlySuffixCsv extends Serializable

    Permalink
  8. object HourlySuffixTsv extends Serializable

    Permalink
  9. object HourlySuffixTypedTsv extends Serializable

    Permalink
  10. object NullSink extends Source with BaseNullSource with typed.TypedSink[Any]

    Permalink

    This can be used to cause cascading to run a flow, but discard the output.

    This can be used to cause cascading to run a flow, but discard the output. The only place this is likely of use is to do some (non-recommended, but sometimes the most expediant way to accomplish some task).

  11. object TypedSequenceFile extends Serializable

    Permalink
  12. object TypedText

    Permalink

Ungrouped