Residential Collegefalse
Status已發表Published
Data-Driven Solutions to Mixed H-{2/H-infty Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach
Yang, Yongliang1; Mazouchi, Majid2; Modares, Hamidreza2
2020-08-01
Conference Name2020 IEEE Conference on Control Technology and Applications (CCTA)
Source PublicationCCTA 2020 - 4th IEEE Conference on Control Technology and Applications
Pages340-345
Conference Date24-26 Aug. 2020
Conference PlaceVirtual, Montreal
Abstract

Today's industrial systems have complex and possibly unknown dynamics, and are under the effect of unknown disturbances. This paper presents a model-free reinforcement learning (RL) algorithm for solving the mixed H_{2/H-Infty control design for industrial systems to respond favorably to both disturbance attenuation and performance requirement specifications, despite uncertainties in dynamics. The mixed H_{2/H-Infty performance optimization is first formulated as a non-zero sum game problem, which results in solving coupled Hamilton-Jacobi (HJ) equations. To solve these coupled HJ equations, a relaxed optimization framework based on a Hamiltonian-driven framework is presented that performs optimization subject to two Hamiltonian-inequalities corresponding to H_{2 and H-Infty performances. This allows Sum-of-Square (SOS) programs to be used to find efficient solutions to the problem. An SOS-based iterative algorithm is developed to solve the formulated optimization problem with the constraints represented by the Hamiltonian inequalities. The relation between the original and relaxed H_{2/H-Infty performance optimization is discussed in terms of performance comparison. To obviate the requirement of complete knowledge of the system dynamics, a data-driven reinforcement learning approach is proposed to solve the SOS optimization problem in real-time using only the information of the system trajectories measured during a time interval. Finally, a simulation example is provided to show the effectiveness of the proposed algorithm.

KeywordCoupled Hamilton-jacobi Equations Hamiltonian-driven Framework Mixed Performance Non-zero Sum Game Sum-of-square (Sos) Programs
DOI10.1109/CCTA41146.2020.9206320
URLView the original
Language英語English
Scopus ID2-s2.0-85094116832
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionTHE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
Affiliation1.State Key Laboratory of IoTSC, University of Macau, Macao
2.Michigan State University, Department of Mechanical Engineering, East Lansing, 48824, United States
First Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Yang, Yongliang,Mazouchi, Majid,Modares, Hamidreza. Data-Driven Solutions to Mixed H-{2/H-infty Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach[C], 2020, 340-345.
APA Yang, Yongliang., Mazouchi, Majid., & Modares, Hamidreza (2020). Data-Driven Solutions to Mixed H-{2/H-infty Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach. CCTA 2020 - 4th IEEE Conference on Control Technology and Applications, 340-345.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yang, Yongliang]'s Articles
[Mazouchi, Majid]'s Articles
[Modares, Hamidreza]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yang, Yongliang]'s Articles
[Mazouchi, Majid]'s Articles
[Modares, Hamidreza]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yang, Yongliang]'s Articles
[Mazouchi, Majid]'s Articles
[Modares, Hamidreza]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.