ListBasedTokenStream(AttributeSource attributeSource,List<AttributeSource> tokens){
  super(attributeSource.getAttributeFactory());
  this.tokens=tokens;
  addAttributes(attributeSource);
}

ListBasedTokenStream ( AttributeSource attributeSource , List < AttributeSource > tokens ) { super ( attributeSource . getAttributeFactory ( ) ) ; this . tokens = tokens ; addAttributes ( attributeSource ) ; }
creates a new listbasedtokenstream which uses the given tokens as its token source .
