|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.basex.util.ft.FTIterator
org.basex.util.ft.Tokenizer
org.basex.util.ft.JapaneseTokenizer
public class JapaneseTokenizer
Japanese lexer using igo (http://igo.sourceforge.jp/).
Field Summary |
---|
Fields inherited from class org.basex.util.ft.Tokenizer |
---|
IMPL |
Constructor Summary | |
---|---|
JapaneseTokenizer(FTOpt fto)
Constructor. |
Method Summary | |
---|---|
int |
compareTo(org.basex.util.ft.LanguageImpl o)
|
boolean |
equals(java.lang.Object o)
|
int |
hashCode()
|
boolean |
hasNext()
|
JapaneseTokenizer |
init(byte[] txt)
Initializes the iterator. |
FTSpan |
next()
|
byte[] |
nextToken()
Returns the next token. |
protected byte |
prec()
Returns the precedence of the processor. |
boolean |
supports(Language ln)
Checks if the specified language is supported. |
Methods inherited from class org.basex.util.ft.Tokenizer |
---|
supportFor |
Methods inherited from class org.basex.util.ft.FTIterator |
---|
remove |
Methods inherited from class java.lang.Object |
---|
clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public JapaneseTokenizer(FTOpt fto)
fto
- (optional) full-text optionsMethod Detail |
---|
public JapaneseTokenizer init(byte[] txt)
FTIterator
init
in class FTIterator
txt
- text
public boolean hasNext()
public FTSpan next()
public byte[] nextToken()
FTIterator
Iterator.next()
to avoid the creation of new FTSpan
instances.
nextToken
in class FTIterator
protected byte prec()
public boolean supports(Language ln)
ln
- language
public final boolean equals(java.lang.Object o)
equals
in class java.lang.Object
public final int compareTo(org.basex.util.ft.LanguageImpl o)
compareTo
in interface java.lang.Comparable<org.basex.util.ft.LanguageImpl>
public int hashCode()
hashCode
in class java.lang.Object
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |