Chinese segmenter evaluation

Some time ago, DataparkSearch has took evaluation using В«Chinese Word Segmentation Evaluation ToolkitВ». It got not an excelent results, but a bit better than S-MSRSeg from Microsoft Research Asia (look comparison table at bottom of evaluation toolkit page).

The same algorithm is also using in DataparkSearch to segment phrases in traditional Korean and Thai writing.

Leave a Reply

Your email address will not be published. Required fields are marked *