Package org.egothor.stemmer

Class StemmerDictionaryParser

java.lang.Object

org.egothor.stemmer.StemmerDictionaryParser

public final class StemmerDictionaryParser
extends Object

Parser of line-oriented stemmer dictionary files.

Each non-empty logical line consists of a stem followed by zero or more known word variants separated by whitespace. The first token is interpreted as the canonical stem, and every following token on the same line is interpreted as a variant belonging to that stem.

Input lines are normalized to lower case using Locale.ROOT. Leading and trailing whitespace is ignored.

The parser supports line remarks and trailing remarks. The remark markers # and // terminate the logical content of the line, and the remainder of that line is ignored.

This class is intentionally stateless and allocation-light so it can be used both by runtime loading and by offline compilation tooling.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static interface	StemmerDictionaryParser.EntryHandler	Callback receiving one parsed dictionary line.
static final record	StemmerDictionaryParser.ParseStatistics	Immutable parsing statistics.

Method Summary

Modifier and Type	Method	Description
static StemmerDictionaryParser.ParseStatistics	parse(Reader reader, String sourceDescription, StemmerDictionaryParser.EntryHandler entryHandler)	Parses a dictionary from a reader.
static StemmerDictionaryParser.ParseStatistics	parse(String fileName, StemmerDictionaryParser.EntryHandler entryHandler)	Parses a dictionary file from a path string.
static StemmerDictionaryParser.ParseStatistics	parse(Path path, StemmerDictionaryParser.EntryHandler entryHandler)	Parses a dictionary file from a filesystem path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

parse

public static StemmerDictionaryParser.ParseStatistics parse(Path path,
 StemmerDictionaryParser.EntryHandler entryHandler)
                                                     throws IOException

Parses a dictionary file from a filesystem path.

Parameters:

path - dictionary file path

entryHandler - handler receiving parsed entries

Returns:

parsing statistics

Throws:

NullPointerException - if any argument is null

IOException - if reading fails

parse

public static StemmerDictionaryParser.ParseStatistics parse(String fileName,
 StemmerDictionaryParser.EntryHandler entryHandler)
                                                     throws IOException

Parses a dictionary file from a path string.

Parameters:

fileName - dictionary file name or path string

entryHandler - handler receiving parsed entries

Returns:

parsing statistics

Throws:

NullPointerException - if any argument is null

IOException - if reading fails

parse

public static StemmerDictionaryParser.ParseStatistics parse(Reader reader,
 String sourceDescription,
 StemmerDictionaryParser.EntryHandler entryHandler)
                                                     throws IOException

Parses a dictionary from a reader.

Parameters:

reader - source reader

sourceDescription - logical source description for diagnostics

entryHandler - handler receiving parsed entries

Returns:

parsing statistics

Throws:

NullPointerException - if any argument is null

IOException - if reading or handler processing fails