monad.mmseg

Class Seg

java.lang.Object

monad.mmseg.Seg

Direct Known Subclasses:

ComplexSeg, SimpleSeg

public abstract class Seg
extends Object

分词抽象类.

Author:

chenlb 2009-3-16 下午09:15:30

Field Summary

Fields

Modifier and Type	Field and Description
protected Dictionary	dic

Constructor Summary

Constructors

Constructor and Description
Seg(Dictionary dic)

Method Summary

Methods

Modifier and Type	Method and Description
protected boolean	isUnit(int codePoint)
protected int	maxMatch(CharNode[] cns, int cnIdx, char[] chs, int offset) 最大匹配 从 chs[offset] 开始匹配, 同时把 chs[offset] 的字符结点保存在 cns[cnIdx]
protected void	maxMatch(CharNode[] cns, int cnIdx, char[] chs, int offset, ArrayList<Integer>[] tailLens, int tailLensIdx) 匹配,同时找出长度.
protected void	printChunk(List<Chunk> chunks) 输出 chunks, 调试用.
protected int	search(char[] chs, int offset, int tailLen) 查找chs[offset]后面的 tailLen个char是否为词.
protected int	search(CharNode cn, char[] chs, int offset, int tailLen) 没有数组的复制.
abstract Chunk	seg(Sentence sen) 对句子 sen 进行分词.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

dic

protected Dictionary dic

Constructor Detail

Seg

public Seg(Dictionary dic)

Method Detail

printChunk

protected void printChunk(List<Chunk> chunks)

输出 chunks, 调试用.

isUnit

protected boolean isUnit(int codePoint)

See Also:

Dictionary.isUnit(Character)

search

protected int search(char[] chs,
         int offset,
         int tailLen)

查找chs[offset]后面的 tailLen个char是否为词.

Returns:

返回chs[offset]字符结点下的词尾索引号, 没找到返回 -1.

search

protected int search(CharNode cn,
         char[] chs,
         int offset,
         int tailLen)

没有数组的复制.

maxMatch

protected int maxMatch(CharNode[] cns,
           int cnIdx,
           char[] chs,
           int offset)

最大匹配
从 chs[offset] 开始匹配, 同时把 chs[offset] 的字符结点保存在 cns[cnIdx]

Returns:

最大匹配到的词尾长, > 0 找到

maxMatch

protected void maxMatch(CharNode[] cns,
            int cnIdx,
            char[] chs,
            int offset,
            ArrayList<Integer>[] tailLens,
            int tailLensIdx)

匹配,同时找出长度.
从 chs[offset] 开始找所有匹配的词, 找到的放到 tailLens[tailLensIdx] 中.
同时把 chs[offset] 的字符结点保存在 cns[cnIdx].

seg

public abstract Chunk seg(Sentence sen)

对句子 sen 进行分词.

Returns:

不返回 null.