mathematics

Type Members

1. class BigToSmall extends MatrixJoiner

   

2. class BlockMatrix[RowT, GroupT, ColT, ValT] extends AnyRef

   

   BlockMatrix is 3 dimensional matrix where the rows are grouped It is useful for when we want to multiply groups of vectors only between themselves.

   BlockMatrix is 3 dimensional matrix where the rows are grouped It is useful for when we want to multiply groups of vectors only between themselves. For example, grouping users by countries and calculating products only between users from the same country

3. class ColVector[RowT, ValT] extends Serializable with WrappedPipe

   

4. class DefaultMatrixJoiner extends MatrixJoiner2

   

   This uses standard join if the matrices are comparable size and large, otherwise, if one is much smaller than the other, we use a hash join

5. sealed trait Degree extends AnyRef

   

6. class DiagonalMatrix[IdxT, ValT] extends WrappedPipe with Serializable

   

7. class DimsumInCosine[N] extends TypedSimilarity[N, (Weight, L2Norm), Double]

   

8. class DiscoInCosine[N] extends TypedSimilarity[N, InDegree, Double]

   

   Params: minCos: the minimum cosine similarity you care about accuracy for delta: the error on the approximated cosine (e.g.

   Params: minCos: the minimum cosine similarity you care about accuracy for delta: the error on the approximated cosine (e.g. 0.05 = 5%) boundedProb: the probability we have larger than delta error see: http://arxiv.org/pdf/1206.2082v2.pdf for more details

9. case class Edge[+N, +E](from: N, to: N, data: E) extends scala.Product with Serializable

   

   Represents an Edge in a graph with some edge data

10. class ExactInCosine[N] extends TypedSimilarity[N, InDegree, Double]

    

    This algothm is just matrix multiplication done by hand to make it clearer when we do the sampling implementation

11. case class FiniteHint(rows: BigInt = 1L, cols: BigInt = 1L) extends SizeHint with scala.Product with Serializable

    

12. case class HadamardProduct[R, C, V](left: Matrix2[R, C, V], right: Matrix2[R, C, V], ring: Ring[V]) extends Matrix2[R, C, V] with scala.Product with Serializable

    

13. class Histogram extends AnyRef

    

14. case class InDegree(degree: Int) extends Degree with scala.Product with Serializable

    

15. case class L2Norm(norm: Double) extends scala.Product with Serializable

    

16. class LiteralScalar[ValT] extends Serializable

    

17. class Matrix[RowT, ColT, ValT] extends WrappedPipe with Serializable

    

18. sealed trait Matrix2[R, C, V] extends Serializable

    

    This is the future Matrix API.

    This is the future Matrix API. The old one will be removed in scalding 0.10.0 (or 1.0.0).

    Create Matrix2 instances with methods in the Matrix2 object. Note that this code optimizes the order in which it evaluates matrices, and replaces equivalent terms to avoid recomputation. Also, this code puts the parenthesis in the optimal place in terms of size according to the sizeHints. For instance: (A*B)*C == A*(B*C) but if B is a 10 x 10^{6 matrix, and C is 10}6 x 100, it is better to do the B*C product first in order to avoid storing as much intermediate output.

    NOTE THIS REQUIREMENT: for each formula, you can only have one Ring[V] in scope. If you evaluate part of the formula with one Ring, and another part with another, you must go through a TypedPipe (call toTypedPipe) or the result may not be correct.

19. abstract class MatrixCrosser extends Serializable

    

20. abstract class MatrixJoiner extends Serializable

    

    Abstracts the approach taken to join the two matrices

21. trait MatrixJoiner2 extends Serializable

    

    This trait allows users to plug in join algorithms where they are needed to improve products and propagations.

    This trait allows users to plug in join algorithms where they are needed to improve products and propagations. The default works well in most cases, but highly skewed matrices may need some special handling

22. case class MatrixLiteral[R, C, V](toTypedPipe: TypedPipe[(R, C, V)], sizeHint: SizeHint)(implicit rowOrd: Ordering[R], colOrd: Ordering[C]) extends Matrix2[R, C, V] with scala.Product with Serializable

    

23. class MatrixMappableExtensions[T] extends AnyRef

    

    This is the enrichment pattern on Mappable[T] for converting to Matrix types

24. class MatrixPipeExtensions extends AnyRef

    

    Matrix class - represents an infinite (hopefully sparse) matrix.

    Matrix class - represents an infinite (hopefully sparse) matrix. any elements without a row are interpretted to be zero. the pipe hold ('rowIdx, 'colIdx, 'val) where in principle each row/col/value type is generic, with the constraint that ValT is a Ring[T] In practice, RowT and ColT are going to be Strings, Integers or Longs in the usual case.

    WARNING: It is NOT OKAY to use the same instance of Matrix/Row/Col with DIFFERENT Monoids/Rings/Fields. If you want to change, midstream, the Monoid on your ValT, you have to construct a new Matrix. This is due to caching of internal computation graphs.

    RowVector - handles matrices of row dimension one. It is the result of some of the matrix methods and has methods that return ColVector and diagonal matrix

    ColVector - handles matrices of col dimension one. It is the result of some of the matrix methods and has methods that return RowVector and diagonal matrix

25. trait MatrixProduct[Left, Right, Result] extends Serializable

    

26. case class OneC[R, V]()(implicit rowOrd: Ordering[R]) extends Matrix2[R, Unit, V] with scala.Product with Serializable

    

    Infinite column vector - only for intermediate computations

27. case class OneR[C, V]()(implicit colOrd: Ordering[C]) extends Matrix2[Unit, C, V] with scala.Product with Serializable

    

    Infinite row vector - only for intermediate computations

28. case class OutDegree(degree: Int) extends Degree with scala.Product with Serializable

    

29. class Poisson extends AnyRef

    

    Generating Poisson-distributed random variables according to Donald Knuth's algorithm as shown on Wikipedia's Poisson Distribution page

30. case class Product[R, C, C2, V](left: Matrix2[R, C, V], right: Matrix2[C, C2, V], ring: Ring[V], expressions: Option[Map[Matrix2[R, C2, V], TypedPipe[(R, C2, V)]]] = None)(implicit joiner: MatrixJoiner2) extends Matrix2[R, C2, V] with scala.Product with Serializable

    

    Class representing a matrix product

    Class representing a matrix product

    left

    multiplicand

    right

    multiplier

    expressions

    a HashMap of common subtrees; None if possibly not optimal (did not go through optimize), Some(...) with a HashMap that was created in optimize

31. class RowVector[ColT, ValT] extends Serializable with WrappedPipe

    

32. class Scalar[ValT] extends WrappedPipe with Serializable

    

33. trait Scalar2[V] extends Serializable

    

    A representation of a scalar value that can be used with Matrices

34. case class SetSimilarity(intersection: Int, sizeLeft: Int, sizeRight: Int) extends scala.Product with Serializable

    

35. sealed abstract class SizeHint extends AnyRef

    

36. class SmallToBig extends MatrixJoiner

    

37. case class SparseHint(sparsity: Double, rows: BigInt, cols: BigInt) extends SizeHint with scala.Product with Serializable

    

38. case class Sum[R, C, V](left: Matrix2[R, C, V], right: Matrix2[R, C, V], mon: Monoid[V]) extends Matrix2[R, C, V] with scala.Product with Serializable

    

39. trait TypedSimilarity[N, E, S] extends Serializable

    

40. case class ValuePipeScalar[V](value: typed.ValuePipe[V]) extends Scalar2[V] with scala.Product with Serializable

    

41. case class Weight(weight: Double) extends scala.Product with Serializable

    

42. trait WrappedPipe extends AnyRef