关键词: 深度学习, 神经网络, 双向长短时记忆, 中文分词

Abstract: Chinese word segmentation is one of the fundamental technologies of Chinese natural language processing.At present,most conventional Chinese word segmentation methods rely on feature engineering,which requires intensive labor to verify the effectiveness.With the rapid development of deep learning,it becomes realistic to learn features automatically by using neural network.In this paper,on the basis of bidirectional long short-term memory ( BLSTM) model,a novel Chinese word segmentation method is proposed.In this method,Chinese characters are represented into embedding vectors from a large-scale corpus,and then the vectors are applied to BLSTM model for segmentation.It is found from the experiments without feature engineering that the proposed method is of high performance in Chinese word segmentation on simplified Chinese datasets ( PKU,MSRA and CTB) and traditional Chinese dataset ( HKCityU) .

Key words: deep leaning, neural network, long-short term memory, Chinese word segmentation