---
name: "Plucene::Analysis::WhitespaceTokenizer"
section: "3pm"
platform: "linux"
package: "libplucene-perl"
version: "1.25-5"
release: "Debian 13 (Trixie)"
platforms: ["linux"]
url: "https://new.carta.tech/Plucene::Analysis::WhitespaceTokenizer"
---

# Plucene::Analysis::WhitespaceTokenizer(3pm)

white space tokenizer

## NAME

Plucene::Analysis::WhitespaceTokenizer - white space tokenizer

## SYNOPSIS

```
        # isa Plucene::Analysis::CharTokenizer
```

## DESCRIPTION

A WhitespaceTokenizer is a tokenizer that divides text at whitespace.  Adjacent sequences of non-Whitespace characters form tokens.

## METHODS