Package

com.twitter.scalding

serialization

Permalink

package serialization

Content Hierarchy
Visibility
  1. Public
  2. All

Type Members

  1. class ArgsSerializer extends Serializer[Args]

    Permalink
  2. class BinaryDeserializer[T] extends Deserializer[T]

    Permalink
  3. class BinarySerializer[T] extends Serializer[T]

    Permalink
  4. class CascadingBinaryComparator[T] extends Comparator[T] with StreamComparator[InputStream] with cascading.tuple.Hasher[T] with Serializable

    Permalink

    This is the type that should be fed to cascading to enable binary comparators

  5. class DateRangeSerializer extends Serializer[DateRange]

    Permalink
  6. class Externalizer[T] extends chill.Externalizer[T]

    Permalink
    Annotations
    @DefaultSerializer()
  7. class IntFieldSerializer extends Serializer[IntField[_]]

    Permalink
  8. class KryoHadoop extends KryoInstantiator

    Permalink
  9. trait RequiredBinaryComparators extends Job with RequiredBinaryComparatorsConfig

    Permalink

    RequiredBinaryComparators provide comparators (or Ordering in Scala) that are capable of comparing keys in their serialized form reducing the amount of time spent in serialization/deserialization.

    RequiredBinaryComparators provide comparators (or Ordering in Scala) that are capable of comparing keys in their serialized form reducing the amount of time spent in serialization/deserialization. These comparators are implemented using Scala macros, and currently provide binary comparators for primitives, strings, Options, tuples, collections, case classes and Scrooge objects.

  10. trait RequiredBinaryComparatorsConfig extends Job

    Permalink
  11. trait RequiredBinaryComparatorsExecutionApp extends ExecutionApp

    Permalink

    Use this for an ExecutionApp.

  12. class RichDateSerializer extends Serializer[RichDate]

    Permalink

    * Below are some serializers for objects in the scalding project.

  13. class StringFieldSerializer extends Serializer[StringField[_]]

    Permalink
  14. class ThrowingSerializer[T] extends Serializer[T]

    Permalink

    This is a runtime check for types we should never be serializing

  15. class WrappedSerialization[T] extends org.apache.hadoop.io.serializer.Serialization[T] with Configurable

    Permalink

    WrappedSerialization wraps a value in a wrapper class that has an associated Binary that is used to deserialize items wrapped in the wrapper

Value Members

  1. object CascadingBinaryComparator extends Serializable

    Permalink
  2. object Externalizer extends Serializable

    Permalink

    We need to control the Kryo created

  3. object RequiredBinaryComparators extends Serializable

    Permalink
  4. object WrappedSerialization

    Permalink

Ungrouped