Oblon, McClelland, Maier & Neustadt, L.L.P.
Model learning device, method and recording medium for learning neural network model
A model learning device comprises: an initial value setting part that uses a parameter of a learned first model including a neural network to set a parameter of a second model including a neural network having a same network structure as the first model; a first output probability distribution calculating part that calculates a first output probability distribution including a distribution of an output probability of each unit on an output layer, using learning features and the first model; a second output probability distribution calculating part that calculates a second output probability distribution including a distribution of an output probability of each unit on the output layer, using learning features and the second model; and a modified model update part that obtains a weighted sum of a second loss function calculated from correct information and from the second output probability distribution, and a cross entropy between the first output probability distribution and the second output probability distribution, and updates the parameter of the second model so as to reduce the weighted sum.
NIPPON TELEGRAPH AND TELEPHONE CORPORATION
G G G G G G G G G G G G G
G06N G10L G06N G06N G10L G06F G06F G06N G06N G10L G10L G10L G10L
inventional inventional inventional inventional additional inventional inventional inventional inventional inventional inventional inventional inventional
Ryo Taichi Takashi Hirokazu
Masumura Asami Nakamura Masataki