Dynamic programming for semi-Markov modulated SDEs

We consider a stochastic optimal control problem with state variable dynamics described by a stochastic differential equation of diffusive type modulated by a semi-Markov process with a finite state space. The time horizon is both deterministic and finite. Within such setup, we provide a detailed pr...

ver descrição completa

Detalhes bibliográficos
Autor principal: Azevedo, Nuno (author)
Outros Autores: Pinheiro, D. (author), Pinheiro, S. (author)
Formato: article
Idioma:eng
Publicado em: 2022
Assuntos:
Texto completo:http://hdl.handle.net/11328/4110
País:Portugal
Oai:oai:repositorio.uportu.pt:11328/4110
Descrição
Resumo:We consider a stochastic optimal control problem with state variable dynamics described by a stochastic differential equation of diffusive type modulated by a semi-Markov process with a finite state space. The time horizon is both deterministic and finite. Within such setup, we provide a detailed proof of the dynamic programming principle and use it to characterize the value function as a viscosity solution of the corresponding Hamilton-Jacobi-Bellman equation. We illustrate our results with an application to Mathematical Finance: the generalization of Merton's optimal consumption-investment problem to financial markets with semi-Markov switching.