software/test/performance/src/org/LexGrid/LexBIG/example/ScoreTerm.java
/**
	 * Return the words comprising the given string, in order
	 * ignoring duplicates, common separators and punctuation.
	 * @param s
	 * @return SortedSet
	 */
Return the words comprising the given string, in order
ignoring duplicates, common separators and punctuation.
@param s
@return SortedSet
Return the words comprising the given string in order ignoring duplicates common separators and punctuation . @param s @return SortedSet
@SuppressWarnings("unchecked")
	protected SortedSet<String> toWords(String s) {
		SortedSet<String> words = new TreeSet<String>();
		StringTokenizer st = new StringTokenizer(s, " \t\n\r\f,:+-;");
		while (st.hasMoreTokens())
			words.add(st.nextToken().toLowerCase());
		return words;
	}
@ SuppressWarnings ( "unchecked" ) protected SortedSet < String > toWords ( String s ) { SortedSet < String > words = new TreeSet < String > ( ) ; StringTokenizer st = new StringTokenizer ( s , " \t\n\r\f,:+-;" ) ; while ( st . hasMoreTokens ( ) ) words . add ( st . nextToken ( ) . toLowerCase ( ) ) ; return words ; }
Return the words comprising the given string, in order
 ignoring duplicates, common separators and punctuation.
Return the words comprising the given string in order ignoring duplicates common separators and punctuation .