public class TokenizerStream extends Object implements ObjectStream<TokenSample>
TokenizerStream
uses a tokenizer to tokenize the
input string and output TokenSample
s.Constructor and Description |
---|
TokenizerStream(Tokenizer tokenizer,
ObjectStream<String> input) |
Modifier and Type | Method and Description |
---|---|
void |
close()
Closes the
ObjectStream and releases all allocated
resources. |
TokenSample |
read()
Returns the next object.
|
void |
reset()
Repositions the stream at the beginning and the previously seen object sequence
will be repeated exactly.
|
public TokenizerStream(Tokenizer tokenizer, ObjectStream<String> input)
public TokenSample read() throws IOException
ObjectStream
read
in interface ObjectStream<TokenSample>
IOException
public void close() throws IOException
ObjectStream
ObjectStream
and releases all allocated
resources. After close was called its not allowed to call
read or reset.close
in interface ObjectStream<TokenSample>
IOException
public void reset() throws IOException, UnsupportedOperationException
ObjectStream
reset
in interface ObjectStream<TokenSample>
IOException
UnsupportedOperationException
Copyright © 2016 The Apache Software Foundation. All rights reserved.