Adaptive PID controller tuning via deep reinforcement learning
Systems and methods are provided for using a Deep Reinforcement Learning (DRL) agent to provide adaptive tuning of process controllers, such as Proportional-Integral-Derivative (PID) controllers. The agent can monitor process controller performance, and if unsatisfactory, can attempt to improve it by making incremental changes to the tuning parameters for the process controller. The effect of a tuning change can then be observed by the agent and used to update the agent's process controller tuning policy. It has been unexpectedly discovered that providing adaptive tuning based on incremental changes in tuning parameters, as opposed to making changes independent of current values of the tuning parameters, can provide enhanced or improved control over a controlled variable of a process.
ExxonMobil Research and Engineering Company
G G G G G G G G G
G05B G05B G06N G06N G06F G05B G05B G06N G06N
inventional inventional inventional inventional inventional inventional inventional inventional additional
Thomas A. Wei D. Niranjan A. Kuang-Hung Michael H.
Badgwell Liu Subrahmanya Liu Kovalski