# Package opennlp.tools.cmdline.tokenizer

- Class Summary
  Class | Description
  --- | ---
  DetokenEvaluationErrorListener | A default implementation of `EvaluationMonitor` that prints to an output stream.
  DictionaryDetokenizerTool |
  SimpleTokenizerTool |
  TokenEvaluationErrorListener | A default implementation of `EvaluationMonitor` that prints to an output stream.
  TokenizerConverterTool |
  TokenizerCrossValidatorTool |
  TokenizerMEEvaluatorTool |
  TokenizerMETool |
  TokenizerModelLoader | Loads a Tokenizer Model for the command line tools.
  TokenizerTrainerTool |

Copyright © 2026 The Apache Software Foundation. All rights reserved.