Uses of Class
opennlp.tools.tokenize.TokenizerModel
Packages that use TokenizerModel
Package
Description
Experimental package related to the corpus format used by the "brat rapid annotation tool" (brat).
Contains classes related to finding token or words in a string.
-
Uses of TokenizerModel in opennlp.tools.cmdline.tokenizer
Methods in opennlp.tools.cmdline.tokenizer that return TokenizerModelModifier and TypeMethodDescriptionprotected TokenizerModel
TokenizerModelLoader.loadModel
(InputStream modelIn) -
Uses of TokenizerModel in opennlp.tools.formats.brat
Constructors in opennlp.tools.formats.brat with parameters of type TokenizerModelModifierConstructorDescriptionBratNameSampleStream
(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples) Creates a newBratNameSampleStream
.BratNameSampleStream
(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples, Set<String> nameTypes) Creates a newBratNameSampleStream
. -
Uses of TokenizerModel in opennlp.tools.tokenize
Methods in opennlp.tools.tokenize that return TokenizerModelModifier and TypeMethodDescriptionstatic TokenizerModel
TokenizerME.train
(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams) Trains a model for theTokenizerME
.Constructors in opennlp.tools.tokenize with parameters of type TokenizerModelModifierConstructorDescriptionTokenizerME
(TokenizerModel model) Instantiates aTokenizerME
with an existingTokenizerModel
.