Residential College | false |
Status | 已發表Published |
Data-Driven Solutions to Mixed H-{2/H-infty Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach | |
Yang, Yongliang1; Mazouchi, Majid2; Modares, Hamidreza2 | |
2020-08-01 | |
Conference Name | 2020 IEEE Conference on Control Technology and Applications (CCTA) |
Source Publication | CCTA 2020 - 4th IEEE Conference on Control Technology and Applications |
Pages | 340-345 |
Conference Date | 24-26 Aug. 2020 |
Conference Place | Virtual, Montreal |
Abstract | Today's industrial systems have complex and possibly unknown dynamics, and are under the effect of unknown disturbances. This paper presents a model-free reinforcement learning (RL) algorithm for solving the mixed H_{2/H-Infty control design for industrial systems to respond favorably to both disturbance attenuation and performance requirement specifications, despite uncertainties in dynamics. The mixed H_{2/H-Infty performance optimization is first formulated as a non-zero sum game problem, which results in solving coupled Hamilton-Jacobi (HJ) equations. To solve these coupled HJ equations, a relaxed optimization framework based on a Hamiltonian-driven framework is presented that performs optimization subject to two Hamiltonian-inequalities corresponding to H_{2 and H-Infty performances. This allows Sum-of-Square (SOS) programs to be used to find efficient solutions to the problem. An SOS-based iterative algorithm is developed to solve the formulated optimization problem with the constraints represented by the Hamiltonian inequalities. The relation between the original and relaxed H_{2/H-Infty performance optimization is discussed in terms of performance comparison. To obviate the requirement of complete knowledge of the system dynamics, a data-driven reinforcement learning approach is proposed to solve the SOS optimization problem in real-time using only the information of the system trajectories measured during a time interval. Finally, a simulation example is provided to show the effectiveness of the proposed algorithm. |
Keyword | Coupled Hamilton-jacobi Equations Hamiltonian-driven Framework Mixed Performance Non-zero Sum Game Sum-of-square (Sos) Programs |
DOI | 10.1109/CCTA41146.2020.9206320 |
URL | View the original |
Language | 英語English |
Scopus ID | 2-s2.0-85094116832 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) |
Affiliation | 1.State Key Laboratory of IoTSC, University of Macau, Macao 2.Michigan State University, Department of Mechanical Engineering, East Lansing, 48824, United States |
First Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Yang, Yongliang,Mazouchi, Majid,Modares, Hamidreza. Data-Driven Solutions to Mixed H-{2/H-infty Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach[C], 2020, 340-345. |
APA | Yang, Yongliang., Mazouchi, Majid., & Modares, Hamidreza (2020). Data-Driven Solutions to Mixed H-{2/H-infty Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach. CCTA 2020 - 4th IEEE Conference on Control Technology and Applications, 340-345. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment