Compass IP Law, PC
Methods and systems for budgeted and simplified training of deep neural networks
Methods and systems for budgeted and simplified training of deep neural networks (DNNs) are disclosed. In one example, a trainer is to train a DNN using a plurality of training sub-images derived from a down-sampled training image. A tester is to test the trained DNN using a plurality of testing sub-images derived from a down-sampled testing image. In another example, in a recurrent deep Q-network (RDQN) having a local attention mechanism located between a convolutional neural network (CNN) and a long-short time memory (LSTM), a plurality of feature maps are generated by the CNN from an input image. Hard-attention is applied by the local attention mechanism to the generated plurality of feature maps by selecting a subset of the generated feature maps. Soft attention is applied by the local attention mechanism to the selected subset of generated feature maps by providing weights to the selected subset of generated feature maps in obtaining weighted feature maps. The weighted feature maps are stored in the LSTM. A Q value is calculated for different actions based on the weighted feature maps stored in the LSTM.
Intel Corporation
G G G G G G G G G G G G G G
G06N G06K G06V G06V G06V G06V G06N G06K G06N G06V G06N G06V G06K G06N
inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional
Lin Ping Yuqing Libin Dongqi Shandong Yurong Wenhua Anbang Yiwen
Xu Hu Hou Wang Cai Wang Chen Cheng Yao Guo