Package com.twitter.common.text.combiner

Class Summary
DotContractedTokenCombiner Combines contracted word followed by dot/period (e.g., Mr.
EmoticonTokenCombiner Combines an emoticon (e.g., :) :-P ) back to a single token.
ExtractorBasedTokenCombiner Combines multiple tokens into a single one if they define an entity identified by an extractor TokenStream.
HashtagTokenCombiner Combines multiple tokens denoting a hashtag back into a single token.
LookAheadTokenCombiner Combiner that looks ahead to the next token and combines it with the current token based on specified conditions.
PossessiveContractionTokenCombiner Combines multiple tokens denoting a possessive form (e.g., Twitter's) or a contraction form (e.g., isn't) back into a single token.
PunctuationExceptionCombiner  
PunctuationExceptionCombiner.Builder  
StockTokenCombiner Combines multiple tokens denoting a stock symbol (e.g., $YHOO) back into a single token.
URLTokenCombiner Combines multiple tokens denoting a URL back into a single token.
UserNameTokenCombiner Combines multiple tokens denoting a username (e.g., @keita_f) back into a single token.