International IP Law Group, PLLC
Knowledge-guided structural attention processing
Systems and methods for determining knowledge-guided information for a recurrent neural networks (RNN) to guide the RNN in semantic tagging of an input phrase are presented. A knowledge encoding module of a Knowledge-Guided Structural Attention Process (K-SAP) receives an input phrase and, in conjunction with additional sub-components or cooperative components generates a knowledge-guided vector that is provided with the input phrase to the RNN for linguistic semantic tagging. Generating the knowledge-guided vector comprises at least parsing the input phrase and generating a corresponding hierarchical linguistic structure comprising one or more discrete sub-structures. The sub-structures may be encoded into vectors along with attention weighting identifying those sub-structures that have greater importance in determining the semantic meaning of the input phrase.
Microsoft Technology Licensing, LLC
G G G G
G10L G06F G10L G06F
additional inventional additional inventional
Dilek Z. Jianfeng Yun-Nung Vivian Gokhan Li Asli
Hakkani-Tur Gao Chen Tur Deng Celikyilmaz