This is a special node that ensures that the first argument is planned, but produces values equivalent to the result.
Producers are Directed Acyclic Graphs by the fact that they are immutable.
Any environment data an AbstractJob may need.
This has the methods on Key-Value streams.
Represents filters and maps which may be optimized differently Note that "option-mapping" is closed under composition and hence useful to call out
Platform capable of planning and executing at most 2 underlying platforms in parallel.
Base trait for summingbird compilers.
Platform capable of planning and executing two underlying platforms in parallel.
A Producer is a node in our tree, able to generate new items and have operations applied to it.
Wraps the sources of the given Platform
Only TailProducers can be planned.
This cannot be a subclass of function and use the pattern of implicit dependencies, since then you get an implicit function.
I tried to make Unzip2 an object with an apply method that took all three type parameters, but ran into issues:
Base class for all Summingbird jobs; all summingbird jobs should extend AbstractJob.
Aliases for types and objects commonly used in Summingbird jobs.
Helpful functions and test graphs designed to flex Summingbird planners.
TimeExtractor is really just a function, but we've used a specialized type for implicit resolution and serializability.
The "example" package contains all of the code and configuration necessary to run a basic Summingbird job locally that consumes Tweets from the public streaming API and generates counts of the number of times each word appears per tweet.
Collection of graph algorithms
Package containing the Summingbird Storm platform.