Reference

Plucene::Analysis::WhitespaceTokenizer(3pm)

white space tokenizer

NAME

Plucene::Analysis::WhitespaceTokenizer - white space tokenizer

SYNOPSIS

        # isa Plucene::Analysis::CharTokenizer

DESCRIPTION

A WhitespaceTokenizer is a tokenizer that divides text at whitespace. Adjacent sequences of non-Whitespace characters form tokens.

METHODS

History