SV Patent Service
Method of bidirectional image-text retrieval based on multi-view joint embedding space
A bidirectional image-text retrieval method based on a multi-view joint embedding space includes: performing retrieval with reference to a semantic association relationship at a global level and a local level, obtaining the semantic association relationship at the global level and the local level in a frame-sentence view and a region-phrase view, and obtaining semantic association information in a global level subspace of frame and sentence in the frame-sentence view, obtaining semantic association information in a local level subspace of region and phrase in the region-phrase view, processing data by a dual-branch neural network in the two views to obtain an isomorphic feature and embedding the same in a common space, and using a constraint condition to reserve an original semantic relationship of the data during training, and merging the two semantic association relationships using multi-view merging and sorting to obtain a more accurate semantic similarity between data.
Peking University Shenzhen Graduate Sohool
G G G G G G G G G G G G G G G
G06N G06K G06K G06K G06F G06K G06V G06F G06V G06N G06V G06N G06K G06F G06V
inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional inventional
Lu Ge Ying Ronggang Hui Wen Shengfu Zhenyu Wenmin
Ran Li Li Wang Zhao Gao Dong Wang Wang