Scully, Scott, Murphy & Presser, P.C.
Dynamically resizing minibatch in neural network execution
A minibatch in a neural network execution may be dynamically resized based on on-chip memory. For example, a size of the minibatch is configured such that the minibatch fits within on-chip memory. The size of the minibatch may be resized for a sequence of layers in the neural network execution. A next layer's execution can commence responsive to the resized minibatch being completed in a previous layer without having to wait for all of the minibatch to be completed in the previous layer.
International Business Machines Corporation
G G G G G
G06N G06N G06N G06N G06N
additional inventional inventional additional inventional
Swagath Vijayalakshmi Jungwook
Venkataramani Srinivasan Choi