Leveraging Proximal Optimization for Differentiating Optimal Control Solvers - INRIA - Institut National de Recherche en Informatique et en Automatique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Leveraging Proximal Optimization for Differentiating Optimal Control Solvers

Résumé

Over the past few years, differentiable optimization has gained in maturity and attractivity within both machine learning and robotics communities. It consists in computing the derivatives of a given optimization problem which can then be used by learning algorithms, and enables to generically plug computational blocks reflecting the solving of generic mathematical programming problems into a learning pipeline. Until now, dedicated approaches have been proposed to compute the derivatives of various types of optimization problems (LPs, QPs, SOCPs, etc.). However, these approaches assume the problems are well-posed (e.g., satisfaction of the linearly independent constraint qualifications), limiting de facto their application to ill-posed problems. In this work, we focus on the differentiation of optimal control solvers widely used in robotics. We notably introduce a differentiable proximal formulation for solving equality-constrained LQR problems that is effective in solving ill-posed and rank-deficient problems accurately. Importantly, we show that this proximal formulation allows us to compute accurate gradients even in the case of ill-posed problems which do not satisfy the classical constraints qualification. Because any optimal control problem can be casted as an equalityconstrained LQR problem in the vicinity of the optimal solution, ours robust LQR derivatives computation can then be exploited to obtain the derivatives of general optimal control problems. We demonstrate the effectiveness of our approach in dynamics learning and system parameters identification experiments in linear optimal control problems.
Fichier principal
Vignette du fichier
oumayma_cdc_vff.pdf (897.17 Ko) Télécharger le fichier
icra_vf_oumayma.pdf (595.01 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03786820 , version 1 (23-09-2022)

Identifiants

  • HAL Id : hal-03786820 , version 1

Citer

Oumayma Bounou, Jean Ponce, Justin Carpentier. Leveraging Proximal Optimization for Differentiating Optimal Control Solvers. IEEE 62nd Conference on Decision and Control (CDC), Dec 2023, Singapore, Singapore. ⟨hal-03786820⟩
209 Consultations
284 Téléchargements

Partager

Gmail Facebook X LinkedIn More