Edell, Shapiro & Finnan, LLC
Field level compression in parallel data flows
According to one embodiment of the present invention, a system selectively compresses data fields in a parallel data flow. The system identifies within an execution plan for the parallel data flow a first instance of a data field within a stage of the parallel data flow. The system traces the identified data field through stages of the parallel data flow and determines a score value for the identified data field based on operations performed on the identified data field during traversal of the stages. The system compresses the identified data field based on the score value indicating a performance gain with respect to the compressed data field. Embodiments of the present invention further include a method and computer program product for selectively compressing data fields in a parallel data flow in substantially the same manners described above.
International Business Machines Corporation
H H H H
H04L H04L H03M H04L
inventional inventional inventional inventional
Lawrence A. Eric A. Yong Xiaoyan
Greene Jacobson Li Pu