Chamberlain, Hrdlicka, White, Williams & Aughtry
Method and system for tokenizing documents
A method for tokenizing documents. The method includes obtaining a document comprising text to be tokenized, isolating a first string of consecutive characters in the document, searching, in a token tree, for an expression that matches the first string, making a determination that a matching expression exists in the token tree and, based on the determination, storing the matching expression as an extracted token.
EMC IP Holding Company LLC
G G
G06F G06F
inventional inventional
Kunwu Hongtao Lei Chao Jingjing Ying
Huang Dai Zhang Chen Liu Teng