|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.basex.util.ft.FTIterator
org.basex.util.ft.Tokenizer
org.basex.util.ft.WesternTokenizer
public final class WesternTokenizer
Full-text tokenizer.
Field Summary |
---|
Fields inherited from class org.basex.util.ft.Tokenizer |
---|
IMPL |
Constructor Summary | |
---|---|
WesternTokenizer(FTOpt f)
Constructor. |
Method Summary | |
---|---|
int |
compareTo(org.basex.util.ft.LanguageImpl o)
|
boolean |
equals(java.lang.Object o)
|
int |
hashCode()
|
boolean |
hasNext()
|
WesternTokenizer |
init(byte[] txt)
Initializes the iterator. |
FTSpan |
next()
|
byte[] |
nextToken()
Returns the next token. |
protected byte |
prec()
Returns the precedence of the processor. |
boolean |
supports(Language ln)
Checks if the specified language is supported. |
java.lang.String |
toString()
|
Methods inherited from class org.basex.util.ft.Tokenizer |
---|
supportFor |
Methods inherited from class org.basex.util.ft.FTIterator |
---|
remove |
Methods inherited from class java.lang.Object |
---|
clone, finalize, getClass, notify, notifyAll, wait, wait, wait |
Constructor Detail |
---|
public WesternTokenizer(FTOpt f)
f
- full-text optionsMethod Detail |
---|
public WesternTokenizer init(byte[] txt)
FTIterator
init
in class FTIterator
txt
- text
public boolean hasNext()
public FTSpan next()
public byte[] nextToken()
FTIterator
Iterator.next()
to avoid the creation of new FTSpan
instances.
nextToken
in class FTIterator
protected byte prec()
public java.lang.String toString()
toString
in class java.lang.Object
public boolean supports(Language ln)
ln
- language
public final boolean equals(java.lang.Object o)
equals
in class java.lang.Object
public final int compareTo(org.basex.util.ft.LanguageImpl o)
compareTo
in interface java.lang.Comparable<org.basex.util.ft.LanguageImpl>
public int hashCode()
hashCode
in class java.lang.Object
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |