Loeb & Loeb, LLP
Hierarchical sparse tensor compression method in artificial intelligent devices
A hierarchical sparse tensor compression method based on artificial intelligence devices, in DRAM, not only saves the storage space of the neuron surface, but also adds a meta-surface to the mask block. When reading data, the mask is first read, then the size of the non-zero data is calculated, and only these non-zero data are read to save DRAM bandwidth. In the cache, only non-zero data is stored, so the required storage space is reduced. When processing data, only non-zero data is used. The method uses a bit mask to determine if the data is zero. There are three levels in the hierarchical compression scheme: tiles, lines, and points, reading bitmasks and non-zero data from DRAM, and saving bandwidth by not reading zero data. When processing data, if their bit mask is zero, the tile data may be easily removed.
Nanjing Iluvatar CoreX Technology Co., Ltd.
G H G G G G G G G H G H G G
G06N H03M G06N G06N G06F G06F G06F G06N G06F H03M G06N H03M G06F G06F
additional inventional inventional inventional additional inventional inventional inventional inventional inventional inventional inventional inventional inventional
Yongliu Jiejun Pingping
Wang Chen Shao