UM  > Faculty of Business Administration
Residential Collegefalse
Status已發表Published
Risk-sensitive infinite-horizon discounted piecewise deterministic Markov decision processes
Huang, Yonghui1; Lian, Zhaotong2; Guo, Xianping1
2022-11
Source PublicationOperational Research
ABS Journal Level1
ISSN1109-2858
Volume22Issue:5Pages:5791-5816
Abstract

This paper deals with risk-sensitive piecewise deterministic Markov decision processes, where the expected exponential utility of an infinite-horizon discounted cost is minimized. Both the transition rate and cost rate are allowed to be unbounded. Based on a dynamic programming observation, we introduce an auxiliary function with the time as an additional variable to analyze the problem, which is different from those with the risk-sensitive parameter as an additional variable in previous works. Under suitable assumptions, we derive the associated Feynman-Kac’s formula, and then establish the associated Hamilton–Jacobi–Bellman equation with the time as a differential variable, which leads to the existence of optimal policies depending on the time, explicitly showing that the risk-sensitive discounted optimal policies are not stationary.

KeywordDiscounted Cost Hjb Equation Non-stationarity Piecewise Deterministic Markov Decision Processes Risk Sensitive
DOI10.1007/s12351-022-00726-w
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaOperations Research & Management Science
WOS SubjectOperations Research & Management Science
WOS IDWOS:000825927700001
Scopus ID2-s2.0-85134356285
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Business Administration
University of Macau
Corresponding AuthorHuang, Yonghui; Lian, Zhaotong; Guo, Xianping
Affiliation1.School of Mathematics, Sun Yat-Sen University, Guangzhou, China
2.Faculty of Business Administration, University of Macau, Macao
Corresponding Author AffilicationFaculty of Business Administration
Recommended Citation
GB/T 7714
Huang, Yonghui,Lian, Zhaotong,Guo, Xianping. Risk-sensitive infinite-horizon discounted piecewise deterministic Markov decision processes[J]. Operational Research, 2022, 22(5), 5791-5816.
APA Huang, Yonghui., Lian, Zhaotong., & Guo, Xianping (2022). Risk-sensitive infinite-horizon discounted piecewise deterministic Markov decision processes. Operational Research, 22(5), 5791-5816.
MLA Huang, Yonghui,et al."Risk-sensitive infinite-horizon discounted piecewise deterministic Markov decision processes".Operational Research 22.5(2022):5791-5816.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Huang, Yonghui]'s Articles
[Lian, Zhaotong]'s Articles
[Guo, Xianping]'s Articles
Baidu academic
Similar articles in Baidu academic
[Huang, Yonghui]'s Articles
[Lian, Zhaotong]'s Articles
[Guo, Xianping]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Huang, Yonghui]'s Articles
[Lian, Zhaotong]'s Articles
[Guo, Xianping]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.