smile.nlp.normalizer

Class SimpleNormalizer

java.lang.Object

smile.nlp.normalizer.SimpleNormalizer

All Implemented Interfaces:

Normalizer

public class SimpleNormalizer
extends java.lang.Object
implements Normalizer

A baseline normalizer for processing Unicode text:

• Apply Unicode normalization form NFKC.
• Strip, trim, normalize, and compress whitespace.
• Remove control and formatting characters.
• Normalize dash, double and single quotes.

Method Summary

Modifier and Type	Method and Description
static SimpleNormalizer	getInstance() Returns the singleton instance.
java.lang.String	normalize(java.lang.String text) Normalize the given string.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getInstance

public static SimpleNormalizer getInstance()

Returns the singleton instance.

normalize

public java.lang.String normalize(java.lang.String text)

Description copied from interface: Normalizer

Normalize the given string.

Specified by:

normalize in interface Normalizer