Adaptive Control of SE(3) Hamiltonian Dynamics with Learned Disturbance Features


Thai Duong
Nikolay Atanasov
Department of Electrical and Computer Engineering
University of California, San Diego
L-CSS, 2021.

[Paper]
[Code (TBD)]


Adaptive control is a critical component of reliable robot autonomy in rapidly changing operational conditions. Adaptive control designs benefit from a disturbance model, which is often unavailable in practice. This motivates the use of machine learning techniques to learn disturbance features from training data offline, which can subsequently be employed to compensate the disturbances online. This paper develops geometric adaptive control with a learned disturbance model for rigid-body systems, such as ground, aerial, and underwater vehicles, that satisfy Hamilton's equations of motion over the SE(3) manifold. Our design consists of an offline disturbance model identification stage, using a Hamiltonian-based neural ordinary differential equation (ODE) network trained from state-control trajectory data, and an online adaptive control stage, estimating and compensating the disturbances based on geometric tracking errors. We demonstrate our adaptive geometric controller in trajectory tracking simulations of fully-actuated pendulum and under-actuated quadrotor systems.


Paper

Thai Duong, Nikolay Atanasov

Adaptive Control of SE(3) Hamiltonian Dynamics with Learned Disturbance Features

In Submission, 2021.

[pdf]    

Overview and Results



Problem Settings



Given a training dataset from state-control tracjectories collected under different disturbance realizations, we want to learn an adaptive controller, consisting of a trajectory-tracking controller that compensates for the disturbances and an adaptation law that estimates the disturbances online.



The dynamics of many robots, including ground, aerial, and underwater vehicles, are described in terms of their SE(3) pose and generalized velocity, which evolves on the SE(3) manifold, and satisfy conservation of energy principles


Technical Approach


Our approach learns disturbance features by training an neural ODE model with the datasets.



The Hamiltonian structure is used to design a trajectory-tracking controller from and energy perspective while the disturbance model with parameter theta is used to develop the adaptaion law.


Results


For pendulum, we collect data by applying random control on a pendulum gym simulator. After learning the disturbance model from data, the proposed adaptive controller drives the pendulum toward the angle 3*pi/4 using the learned dynamics.



For quadrotors, we use a crazyflie drone simulator in Pybullet and collect training data from 9 flights under 8 disturbance realizations.



Experiment 1 (no adaptive control + spiral trajectory): the drone drifts due to external winds and defective rotors.

Experiment 1 (adaptive control + spiral trajectory): we can estimate the disturbance after a few seconds, compensate for it and successfully finish the tracking task.

Experiment 2 (no adaptive control + diamond-shaped trajectory): as the rotors suddenly become defective after 5s, The drone drifts and drops down to the ground due to disturbances.

Experiment 2 (adaptive control + diamond-shaped trajectory): the drone is able to recover and finishes tracking the trajectory.


Code (TBD)


 [github]




Acknowledgements

We gratefully acknowledge support from NSF RI IIS-2007141 and ARL DCIST CRA W911NF-17-2-0181.
This webpage template was borrowed from https://akanazawa.github.io/cmr/.