Fenwick & West LLP
High-capacity machine learning system
The present disclosure is directed to a high-capacity training and prediction machine learning platform that can support high-capacity parameter models (e.g., with 10 billion weights). The platform implements a generic feature transformation layer for joint updating and a distributed training framework utilizing shard servers to increase training speed for the high-capacity model size. The models generated by the platform can be utilized in conjunction with existing dense baseline models to predict compatibilities between different groupings of objects (e.g., a group of two objects, three objects, etc.).
Facebook, Inc.
G G
G06N G06N
inventional inventional
Dmytro Stuart Michael Ou
Dzhulgakov Bowers Jin