Trait/Object

com.twitter.scalding

TupleConverter

Related Docs: object TupleConverter | package scalding

Permalink

trait TupleConverter[T] extends Serializable with TupleArity

Typeclass to represent converting from cascading TupleEntry to some type T. The most common application is to convert to scala Tuple objects for use with the Fields API. The typed API internally manually handles its mapping to cascading Tuples, so the implicit resolution mechanism is not used.

WARNING: if you are seeing issues with the singleConverter being found when you expect something else, you may have an issue where the enclosing scope needs to take an implicit TupleConverter of the correct type.

Unfortunately, the semantics we want (prefer to flatten tuples, but otherwise put everything into one postition in the tuple) are somewhat difficlut to encode in scala.

Self Type
TupleConverter[T]
Source
TupleConverter.scala
Linear Supertypes
TupleArity, Serializable, AnyRef, Any
Known Subclasses
Type Hierarchy
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. TupleConverter
  2. TupleArity
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def apply(te: TupleEntry): T

    Permalink
  2. abstract def arity: Int

    Permalink

    Return the arity of product types, should probably only be used implicitly The use case here is to see how many fake field names we need in Cascading to hold an intermediate value for mapReduceMap

    Return the arity of product types, should probably only be used implicitly The use case here is to see how many fake field names we need in Cascading to hold an intermediate value for mapReduceMap

    Definition Classes
    TupleArity

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. def andThen[U](fn: (T) ⇒ U): TupleConverter[U]

    Permalink
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. def assertArityMatches(f: Fields): Unit

    Permalink

    assert that the arity of this setter matches the fields given.

    assert that the arity of this setter matches the fields given. if arity == -1, we can't check, and if Fields is not a definite size, (such as Fields.ALL), we also cannot check, so this should only be considered a weak check.

    Definition Classes
    TupleArity
  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  12. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  16. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  18. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  19. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from TupleArity

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped