Garg Law Firm, PLLC
Hybrid floating point representation for deep learning acceleration
In an embodiment, a method includes configuring a specialized circuit for floating point computations using numbers represented by a hybrid format, wherein the hybrid format includes a first format and a second format. In the embodiment, the method includes operating the further configured specialized circuit to store an approximation of a numeric value in the first format during a forward pass for training a deep learning network. In the embodiment, the method includes operating the further configured specialized circuit to store an approximation of a second numeric value in the second format during a backward pass for training the deep learning network.
INTERNATIONAL BUSINESS MACHINES CORPORATION
G G G G
G06F G06N G06F G06N
inventional inventional additional inventional
Naigang Ankur Silvia Melitta Jungwook Kailash
Wang Agrawal Mueller Choi Gopalakrishnan