Discounting in games across time scales

K. Chatterjee, R. Majumdar, in:, EPTCS, 2010, pp. 22–29.

Download
OA 74.60 KB

Conference Paper | Published | English
Author
;
Department
Series Title
EPTCS
Abstract
We introduce two-level discounted games played by two players on a perfect-information stochastic game graph. The upper level game is a discounted game and the lower level game is an undiscounted reachability game. Two-level games model hierarchical and sequential decision making under uncertainty across different time scales. We show the existence of pure memoryless optimal strategies for both players and an ordered field property for such games. We show that if there is only one player (Markov decision processes), then the values can be computed in polynomial time. It follows that whether the value of a player is equal to a given rational constant in two-level discounted games can be decided in NP intersected coNP. We also give an alternate strategy improvement algorithm to compute the value.
Publishing Year
Date Published
2010-06-08
Volume
25
Page
22 - 29
Conference
GandALF: Games, Automata, Logic, and Formal Verification
Conference Location
Minori, Italy
Conference Date
2010-06-17 – 2010-06-18
IST-REx-ID

Cite this

Chatterjee K, Majumdar R. Discounting in games across time scales. In: Vol 25. EPTCS; 2010:22-29. doi:10.4204/EPTCS.25.6
Chatterjee, K., & Majumdar, R. (2010). Discounting in games across time scales (Vol. 25, pp. 22–29). Presented at the GandALF: Games, Automata, Logic, and Formal Verification, Minori, Italy: EPTCS. https://doi.org/10.4204/EPTCS.25.6
Chatterjee, Krishnendu, and Ritankar Majumdar. “Discounting in Games across Time Scales,” 25:22–29. EPTCS, 2010. https://doi.org/10.4204/EPTCS.25.6.
K. Chatterjee and R. Majumdar, “Discounting in games across time scales,” presented at the GandALF: Games, Automata, Logic, and Formal Verification, Minori, Italy, 2010, vol. 25, pp. 22–29.
Chatterjee K, Majumdar R. 2010. Discounting in games across time scales. GandALF: Games, Automata, Logic, and Formal Verification, EPTCS, vol. 25. 22–29.
Chatterjee, Krishnendu, and Ritankar Majumdar. Discounting in Games across Time Scales. Vol. 25, EPTCS, 2010, pp. 22–29, doi:10.4204/EPTCS.25.6.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2018-12-12T10:12:19Z


Export

Marked Publications

Open Data IST Research Explorer

Sources

arXiv 1006.1403v1

Search this title in

Google Scholar