---
name: "Plucene::Analysis::LetterTokenizer"
section: "3pm"
platform: "linux"
package: "libplucene-perl"
version: "1.25-5"
release: "Debian 13 (Trixie)"
platforms: ["linux"]
url: "https://new.carta.tech/Plucene::Analysis::LetterTokenizer"
---

# Plucene::Analysis::LetterTokenizer(3pm)

Letter tokenizer

## NAME

Plucene::Analysis::LetterTokenizer - Letter tokenizer

## SYNOPSIS

```
        # isa Plucene::Analysis::CharTokenizer
```

## DESCRIPTION

This is the letter tokenizer class, which divides text at non-letters.

Note: this does a decent job for most European languages, but does a  terrible job for some Asian languages, where words are not separated  by spaces