Linear-quadratic optimal control under non-Markovian switching

ABSTRACT

We study a finite-dimensional continuous-time optimal control problem on finite horizon for a controlled diffusion driven by Brownian motion, in the linear-quadratic case. We admit stochastic coefficients, possibly depending on an underlying independent marked point process, so that our model is general enough to include controlled switching systems where the switching mechanism is not required to be Markovian. The problem is solved by means of a Riccati equation, which turned out to be a backward stochastic differential equation driven by the Brownian motion and by the random measure associated with the marked point process.

KEYWORDS:

• Linear-quadratic optimal control
• optimal control with stochastic coefficients
• Riccati backward stochastic differential equations (Riccati BSDE)

MATHEMATICS SUBJECT CLASSIFICATION:

• 93E20
• 60H10