ListBasedTokenStream(List<AttributeSource> tokens){
  this.tokens=tokens;
  tokenIterator=tokens.iterator();
}

ListBasedTokenStream ( List < AttributeSource > tokens ) { this . tokens = tokens ; tokenIterator = tokens . iterator ( ) ; }
creates a new listbasedtokenstream which uses the given tokens as its token source .
