Robust path integral control on stochastic differential games

D. Vrushabh, P. Akshay, K. Sonam, S. Wagh, N. M. Singh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

This paper develops a robust path integral (RPI) model predictive control using the Monte Carlo (MC) sampling to address the optimal control (OC) problem for the stochastic differential game (SDG). The two-player zero-sum differential game has been extensively investigated, mostly as its outcome indicates the H optimality. The proposed path integral (PI) control framework provides an analytically sound method for building an algorithm of optimal control for this game based on stochastic trajectory sampling. This is achieved by using Feynman-Kac (F-K) lemma which transforms the value function of stochastic optimal control (SOC) problem into an expectation over all probable trajectories. This transformation makes it possible to solve SOC problems through MC sampling of stochastic processes. Finally, the RPI model predictive control using MC sampling is efficiently implemented for an inverted pendulum system. The RPI control has achieved good performance for changes in inverted pendulum weight and friction when the complete nonlinear swing-up is concerned while such environmental adjustments are not dealt with in a regular PI control.

Original languageEnglish
Title of host publication2020 28th Mediterranean Conference on Control and Automation, MED 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages665-670
Number of pages6
ISBN (Electronic)9781728157429
DOIs
StatePublished - Sep 2020
Externally publishedYes
Event28th Mediterranean Conference on Control and Automation, MED 2020 - Saint-Raphael, France
Duration: Sep 15 2020Sep 18 2020

Publication series

Name2020 28th Mediterranean Conference on Control and Automation, MED 2020

Conference

Conference28th Mediterranean Conference on Control and Automation, MED 2020
Country/TerritoryFrance
CitySaint-Raphael
Period09/15/2009/18/20

Keywords

  • Optimal control
  • Path integral
  • Robust control
  • Sampling
  • Stochastic differential games

Fingerprint

Dive into the research topics of 'Robust path integral control on stochastic differential games'. Together they form a unique fingerprint.

Cite this