Academy & Industry Research Collaboration Center (AIRCC)

Volume 9, Number 5, April 2019

A Learning Controller Design Approach for A 3-DOF Helicopter System with Online Optimal Control

  Authors

Guilherme B. Sousa1*, Janes V. R.Lima1, Patrícia H. M.Rêgo2, Alain G.Souza3 and João V. FonsecaNeto4,
1State University of Maranhão -UEMA, Brazil, 2State University of Maranhão -UEMA, Brazil, 3São José dos Campos, SP, Brazil and 4Federal University of Maranhão - UFMA, Brazil

  Abstract

This paper presents the design and investigation of performance of a 3-DOF Quanser helicopter system using a learning optimal control approach that is grounded on approximate dynamic programming paradigms, specifically action-dependent heuristic dynamic programming (ADHDP). This approach results in an algorithm that is embedded in the actor-critic reinforcement learning architecture, that characterizes this design as a model-free structure. The developed methodology aims at implementing an optimal controller that acts in real-time in the plant control, using only the input and output signals and states measured along the system trajectories. The feedback control design technique is capable of an online tuning of the controller parameters according to the plant dynamics, which is subject to the model uncertainties and external disturbances. The experimental results demonstrate the desired performance of the proposed controller implemented on the 3-DOF Quanser helicopter.

  Keywords

Action-Dependent Heuristic Dynamic Programming, Actor-Critic Reinforcement Learning, Real-Time Control, 3-DOF Helicopter