Unsupervised learning of word segmentation rules with genetic algorithms and inductive logic program

Author:Kazakov, D; Manandhar, S

Article Title:Unsupervised learning of word segmentation rules with genetic algorithms and inductive logic programming

Abstract:
This article presents a combination of unsupervised and supervised learning techniques for the generation of word segmentation rules from a raw list of words. First, a language bias for word se mentation is introduced and a simple genetic algorithm is used in the search for a segmentation that corresponds to the best bias value. In the second phase, the words segmented by the genetic algorithm are used as an input for the first order decision list learner CLOG. The result is a set of first order rules which can be used for segmentation of unseen words. When applied on either the training data or unseen data, these rules produce segmentations which are linguistically meaningful, and to a large degree conforming to the annotation provided.

Keywords:  unsupervised machine learning; inductive logic programming; natural language; word segmentation

DOI: 10.1023/A:1007629103294

Source:MACHINE LEARNING

Welcome to correct the error, please contact email: humanisticspider@gmail.com