Marshall, Gerstein & Borun LLP
Model parallel processing method and apparatus based on multiple graphic processing units
A parallel data processing method based on multiple graphic processing units (GPUs) is provided, including: creating, in a central processing unit (CPU), a plurality of worker threads for controlling a plurality of worker groups respectively, the worker groups including a plurality of GPUs; binding each worker thread to a corresponding GPU; loading one batch of training data from a nonvolatile memory to a GPU video memory corresponding to one worker group; transmitting, between a plurality of GPUs corresponding to one worker group, data required by data processing performed by the GPUs through peer to peer; and controlling the plurality of GPUs to perform data processing in parallel through the worker threads.
TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
G G G
G06T G06T G06F
inventional additional inventional
Yi Zhimao Bo Yongqiang Bin Lei Wei Yong Xing
Li Guo Chen Zou Xiao Xiao Xue Li Jin