com.twitter.common.text.combiner
Class URLTokenCombiner

java.lang.Object
  extended by org.apache.lucene.util.AttributeSource
      extended by com.twitter.common.text.token.TokenStream
          extended by com.twitter.common.text.token.TokenProcessor
              extended by com.twitter.common.text.combiner.ExtractorBasedTokenCombiner
                  extended by com.twitter.common.text.combiner.URLTokenCombiner

public class URLTokenCombiner
extends ExtractorBasedTokenCombiner

Combines multiple tokens denoting a URL back into a single token.


Nested Class Summary
 
Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource
org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State
 
Constructor Summary
URLTokenCombiner(TokenStream inputStream)
           
 
Method Summary
 
Methods inherited from class com.twitter.common.text.combiner.ExtractorBasedTokenCombiner
incrementToken, reset, setExtractor, setType
 
Methods inherited from class com.twitter.common.text.token.TokenProcessor
getInputStream, getInstanceOf
 
Methods inherited from class com.twitter.common.text.token.TokenStream
toStringList
 
Methods inherited from class org.apache.lucene.util.AttributeSource
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString
 
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
 

Constructor Detail

URLTokenCombiner

public URLTokenCombiner(TokenStream inputStream)