Residential College | false |
Status | 已發表Published |
Risk-sensitive infinite-horizon discounted piecewise deterministic Markov decision processes | |
Huang, Yonghui1; Lian, Zhaotong2; Guo, Xianping1 | |
2022-11 | |
Source Publication | Operational Research |
ABS Journal Level | 1 |
ISSN | 1109-2858 |
Volume | 22Issue:5Pages:5791-5816 |
Abstract | This paper deals with risk-sensitive piecewise deterministic Markov decision processes, where the expected exponential utility of an infinite-horizon discounted cost is minimized. Both the transition rate and cost rate are allowed to be unbounded. Based on a dynamic programming observation, we introduce an auxiliary function with the time as an additional variable to analyze the problem, which is different from those with the risk-sensitive parameter as an additional variable in previous works. Under suitable assumptions, we derive the associated Feynman-Kac’s formula, and then establish the associated Hamilton–Jacobi–Bellman equation with the time as a differential variable, which leads to the existence of optimal policies depending on the time, explicitly showing that the risk-sensitive discounted optimal policies are not stationary. |
Keyword | Discounted Cost Hjb Equation Non-stationarity Piecewise Deterministic Markov Decision Processes Risk Sensitive |
DOI | 10.1007/s12351-022-00726-w |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Operations Research & Management Science |
WOS Subject | Operations Research & Management Science |
WOS ID | WOS:000825927700001 |
Scopus ID | 2-s2.0-85134356285 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Business Administration University of Macau |
Corresponding Author | Huang, Yonghui; Lian, Zhaotong; Guo, Xianping |
Affiliation | 1.School of Mathematics, Sun Yat-Sen University, Guangzhou, China 2.Faculty of Business Administration, University of Macau, Macao |
Corresponding Author Affilication | Faculty of Business Administration |
Recommended Citation GB/T 7714 | Huang, Yonghui,Lian, Zhaotong,Guo, Xianping. Risk-sensitive infinite-horizon discounted piecewise deterministic Markov decision processes[J]. Operational Research, 2022, 22(5), 5791-5816. |
APA | Huang, Yonghui., Lian, Zhaotong., & Guo, Xianping (2022). Risk-sensitive infinite-horizon discounted piecewise deterministic Markov decision processes. Operational Research, 22(5), 5791-5816. |
MLA | Huang, Yonghui,et al."Risk-sensitive infinite-horizon discounted piecewise deterministic Markov decision processes".Operational Research 22.5(2022):5791-5816. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment