org.freecompany.util.text
public class TokenizerState extends State
Field Summary | |
---|---|
protected boolean | trim |
Method Summary | |
---|---|
void | trim(boolean trim)
Sets this tokenizers handling of whitespace. |
boolean | trim() |
true
, whitespace is searched
for and removed from returned tokens. If false
tokens are returned as is.