Cantor Colburn LLP
Method of selecting training text for language model, and method of training language model using the training text, and computer and computer program for executing the methods
Method of selecting training text for language model, and method of training language model using the training text, and computer and computer program for executing the methods. The present invention provides for selecting training text for a language model that includes: generating a template for selecting training text from a corpus in a first domain according to generation techniques of: (i) replacing one or more words in a word string selected from the corpus in the first domain with a special symbol representing any word or word string, and adopting the word string after replacement as a template for selecting the training text; and/or (ii) adopting the word string selected from the corpus in the first domain as the template for selecting the training text; and selecting text covered by the template as the training text from a corpus in a second domain different from the first domain.
INTERNATIONAL BUSINESS MACHINES CORPORATION
G G G G G
G10L G10L G10L G10L G10L
inventional inventional inventional additional inventional
Gakuto Masafumi Nobuyasu
Kurata Nishimura Itoh