Oblon, McClelland, Maier & Neustadt, L.L.P.
Text sequence segmentation method, apparatus and device, and storage medium thereof
The present disclosure, belonging to the technical field of natural language processing, provides a text sequence segmentation method. The method can include acquiring n segmentation sub-results of the text sequence, the n segmentation sub-results being acquired by segmenting the text sequence by n segmentation models, and processing the n segmentation sub-results by a probability determination model branch in a result combination model to acquire a segmentation probability of the each segmentation position. The method can further include processing the segmentation probability of the each segmentation position by an activation function in the result combination model to acquire a segmentation result of the text sequence. According to the present disclosure, using each segmentation position in the text sequence as a unit, segmentation results of a plurality of segmentation models are combined, such that the accuracy of segmentation of a new text can be improved.
BEIJING XIAOMI INTELLIGENT TECHNOLOGY CO., LTD.
G G
G06F G06F
inventional inventional
Qun Liang Shuo Erli Yupeng Bin
Guo Shi Wang Meng Chen Wang