We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Forward-Backward Rapidly-Exploring Random Trees for Stochastic Optimal Control

Abstract: We propose a numerical method for the computation of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. By the use of the Girsanov change of probability measures, it is demonstrated how a rapidly-exploring random tree (RRT) method can be utilized for the forward integration pass, as long as the controlled drift terms are appropriately compensated in the backward integration pass. Subsequently, a numerical approximation of the value function is proposed by solving a series of function approximation problems backwards in time along the edges of the constructed RRT. Moreover, a local entropy-weighted least squares Monte Carlo (LSMC) method is developed to concentrate function approximation accuracy in regions most likely to be visited by optimally controlled trajectories. The results of the proposed methodology are demonstrated on linear and nonlinear stochastic optimal control problems with non-quadratic running costs, which reveal significant convergence improvements over previous FBSDE-based numerical solution methods.
Subjects: Optimization and Control (math.OC); Robotics (cs.RO); Systems and Control (eess.SY)
Cite as: arXiv:2006.12444 [math.OC]
  (or arXiv:2006.12444v2 [math.OC] for this version)

Submission history

From: Kelsey Hawkins [view email]
[v1] Mon, 22 Jun 2020 17:24:40 GMT (1418kb,D)
[v2] Thu, 25 Mar 2021 23:51:12 GMT (1212kb,D)

Link back to: arXiv, form interface, contact.