Nicholson De Vos Webster & Elliott LLP
Benchmarking machine learning models via performance feedback
Techniques for benchmarking a machine learning model/algorithm are described. For example, in some instances a method includes generating an execution plan for benchmarking of at least one task corresponding to a machine learning model based on an identified machine learning model, identified training data, and at least one objective for the benchmarking job; receiving execution statistics about the execution of the task as a part of the benchmarking job according to the execution plan; and updating the execution plan based at least in part on the received execution statistics of the task.
Amazon Technologies, Inc.
G G G G G
G06F G06F G06N G06F G06F
additional inventional inventional inventional inventional
Hagay Ruofei Jiajie Roshani Jonathan Yao Naveen Mysore Nagendra Vikram Sandeep
Lupesko Yu Chen Nagmote Esterhazy Wang Swamy Madan Krishnamurthy