Current Research interests:
Safe Reinforcement Learning
Deep Learning based Prognostics
Health Aware Safe Control Learning

PhD Co-Direction (Present): 

Satya MARTHI (2024 - ): Design of a safe control system through reinforcement learning - Application to autonomous mobile systems.
Didier Theillol and Mayank Jha.
Funding: ANR (French National Project) SOS Project (Self-Organizing, Smart, and Safe Heterogeneous Robots Fleet by Collective Emergence),
Consortium: CRAN, CRISTAL (Lille), and Lynxdrone (SME)
Link: https://projet-sos.gitlabpages.univ-lille.fr/site-web/

Theo Rutschke (2023-...),  
Physics-driven identification of nonlinear systems for reinforcement learning ,
See Here. Funded by CRAN, Université de Lorraine.

PhD Co-direction (Past): 

Soha KANSO (Oct 2021- Dec 2024),
Safe Reinforcement Learning for dynamical systems under degradation "  See  Here .
Funded by CRAN, Université de Lorraine.
See associated papers here, here, here, here, here.

Martin Herve de Beaulieu (Nov 2020- Dec 2023)                                                                                                                 
Subject: "Identification and prognosis of state of health of non-linear systems through deep learning.
Application to predictive maintenance of business aircraft "
In collaboration with Dassault Aviation. 
PhD Thesis, Associated Papers: here, here, here. 

      

Post Doctoral Research Co-supervision
Julien Thuillier, (2021-2023), Subject: Health Aware Control Design of Liquid Propulsion Rocket Engine.
Funded by CNES. See papers here,here,here..

Industrial Projects (On-going)

1. Co-PI (Co-principle Investigator)  Research Projects with The French National Centre for Space Studies (CNES)
   (Kick-off, September 2023) Design of Learning approaches for Health aware control of Reusable liquid rocket engine.

Industrial Projects (Past)

1. Co-PI (Co-principle Investigator) , Research project and co-director of Doctoral thesis, in collaboration with Dassault Aviation.
   Subject: "Identification and prognosis of state of health of non-linear systems through deep learning. Application to predictive maintenance of business aircr
2. Co-PI (Co-principle Investigator)  Research Projects with The French National Centre for Space Studies (CNES)
   • (2021-2023), Subject: Health Aware Control Design of Liquid Propulsion Rocket Engine.
   • Master's Research Project Supervision
     • (2021) Remaining useful Life Estimation of Liquid Rocket Engine combustion chamber
     • (2020) Improvement of Remaining useful Life Estimation of Liquid Rocket Engine combustion chamber          

International Projects:
Our project proposal with Chili in collaboration with Prof. Hugues Garnier, has been selected by the ECOS-Sud Programme.
The collaboration starts in 2022 for 3 years. The goal is to develop deep learning-based methods for identifying continuous-time nonlinear systems.

National level Projects:
Leader of French national Level Action Project: Health Aware Control Design in Dynamic Systems is a GDR MACS action (see here)

Master Thesis Supervision (MSc)

Mohammad Chelouati, " Conception d’un système de loi de commande fondée sur l’état de santé du procédé consacrée aux propulseurs réutilisables ".
See the scientific paper here.
Soha Kanso, " Estimation de la durée de vie résiduelle d’une chambre de combustion LRE " . See the scientific paper here.
George Claudiu ANDREI, " Deep Reinforcement Learning for Dynamical Systems ". See Report and scientific paper.

 

Active Reviewer Scientific Journals:

 

• Elsevier: ISA Transactions 
• Elsevier: Mechanical systems and Signal Processing
• Journal of Systems and Control Engineering
• International Journal of Applied Mathematics and Computer Science
• Control Engineering Practice

 

Guest Editor of Special Issue on "Intelligent Systems for Fault Diagnosis and Prognosis", Sensors. See here.