Package com.datumbox.framework.core.common.text.tokenizers

Class Summary

Class	Description
AbstractTokenizer	This abstract class should be implemented by classes that are responsible to get a string as input and separate it into tokens/keywords.
WhitespaceTokenizer	The white space tokenizer separates the keywords of a string using the white space.