Skip to content

Implementation of the Random Batch Method (RBM) in Linear Quadratic Optimal Control

Notifications You must be signed in to change notification settings

danielveldman/rbm_lq

Repository files navigation

The Random Batch Method in Linear Quadratic Optimal Control

A Matlab implementation of the Random Batch Method (RBM) in Linear Quadratic (LQ) optimal control problems, which can significantly reduce the computational cost to solve optimal control problems. The examples are the same as the ones as in this paper. More information can also be found in this post and in this post.

Main features

  • A gradient-based solver for optimal control problems constrained by Random Batch Dynamics.
  • Plotting of the obtained optimal controls and state trajectories.

Considered examples

  • Example 1: A heat equation on a 1-D spatial domain for which the proposed method does not reduce the computational cost.
  • Example 2: A heat equation on a 3-D spatial domain for which the proposed method reduces the computational cost significantly.
  • Example 3: A fractional heat equation for which the proposed method also reduces the computational cost significantly.

The code can be executed by running the files example1_heat1D, example2_heat3D, and example3_fractional3D. Figures 1, 2, and 3 show the typical results. Note that the specific plots depend on the randomly selected vector of indices \boldsymbol \omegaω, and that the specific solutions will be different every time than the files are executed.

example1_heat1D_control.jpg

Figure 1: RBM controls obtained by running example1_heat1D.

example2_heat3D_control.jpg

Figure 2: RBM controls obtained by running example2_heat3D.

example3_fractional1D_control1.jpg example3_fractional1D_control1.jpg

Figure 3: RBM controls obtained by running example3_fractional3D.

About

Implementation of the Random Batch Method (RBM) in Linear Quadratic Optimal Control

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages