Amin, Turocy & Watson, LLP
Facilitating neural network efficiency
Techniques that facilitate improving an efficiency of a neural network are described. In one embodiment, a system is provided that comprises a memory that stores computer-executable components and a processor that executes computer-executable components stored in the memory. In one implementation, the computer-executable components comprise an initialization component that selects an initial value of an output limit, wherein the output limit indicates a range for an output of an activation function of a neural network. The computer-executable components further comprise a training component that modifies the initial value of the output limit during training to a second value of the output limit, the second value of the output limit being provided as a parameter to the activation function. The computer-executable components further comprise an activation function component that determines the output of the activation function based on the second value of the output limit as the parameter.
INTERNATIONAL BUSINESS MACHINES CORPORATION
G G G G
G06N G06N G06N G06N
inventional inventional additional inventional
Charbel Jungwook Swagath Zhuo Kailash
Sakr Choi Venkataramani Wang Gopalakrishnan