Authors
Mathias Creutz, Krista Lagus
Publication date
2002/5/21
Journal
arXiv preprint cs/0205057
Description
We present two methods for unsupervised segmentation of words into morpheme-like units. The model utilized is especially suited for languages with a rich morphology, such as Finnish. The first method is based on the Minimum Description Length (MDL) principle and works online. In the second method, Maximum Likelihood (ML) optimization is used. The quality of the segmentations is measured using an evaluation method that compares the segmentations produced to an existing morphological analysis. Experiments on both Finnish and English corpora show that the presented methods perform well compared to a current state-of-the-art system.
Total citations
2003200420052006200720082009201020112012201320142015201620172018201920202021202220232024814182222132725151620241635263420363924169
Scholar articles
M Creutz, K Lagus - arXiv preprint cs/0205057, 2002