Bidding games on Markov decision processes

G. Avni, T.A. Henzinger, R. Ibsen-Jensen, P. Novotny, in:, Proceedings of the 13th International Conference of Reachability Problems, Springer, n.d.

Download
OA 436.63 KB
Conference Paper | Submitted | English
Department
Series Title
LNCS
Abstract
In two-player games on graphs, the players move a token through a graph to produce an infinite path, which determines the qualitative winner or quantitative payoff of the game. In bidding games, in each turn, we hold an auction between the two players to determine which player moves the token. Bidding games have largely been studied with concrete bidding mechanisms that are variants of a first-price auction: in each turn both players simultaneously submit bids, the higher bidder moves the token, and pays his bid to the lower bidder in Richman bidding, to the bank in poorman bidding, and in taxman bidding, the bid is split between the other player and the bank according to a predefined constant factor. Bidding games are deterministic games. They have an intriguing connection with a fragment of stochastic games called randomturn games. We study, for the first time, a combination of bidding games with probabilistic behavior; namely, we study bidding games that are played on Markov decision processes, where the players bid for the right to choose the next action, which determines the probability distribution according to which the next vertex is chosen. We study parity and meanpayoff bidding games on MDPs and extend results from the deterministic bidding setting to the probabilistic one.
Publishing Year
Date Published
2019-08-20
Proceedings Title
Proceedings of the 13th International Conference of Reachability Problems
Conference
RP: Reachability Problems
Conference Location
Brussels, Belgium
Conference Date
2019-09-11 – 2019-09-13
IST-REx-ID

Cite this

Avni G, Henzinger TA, Ibsen-Jensen R, Novotny P. Bidding games on Markov decision processes. In: Proceedings of the 13th International Conference of Reachability Problems. Springer.
Avni, G., Henzinger, T. A., Ibsen-Jensen, R., & Novotny, P. (n.d.). Bidding games on Markov decision processes. In Proceedings of the 13th International Conference of Reachability Problems. Brussels, Belgium: Springer.
Avni, Guy, Thomas A Henzinger, Rasmus Ibsen-Jensen, and Petr Novotny. “Bidding Games on Markov Decision Processes.” In Proceedings of the 13th International Conference of Reachability Problems. Springer, n.d.
G. Avni, T. A. Henzinger, R. Ibsen-Jensen, and P. Novotny, “Bidding games on Markov decision processes,” in Proceedings of the 13th International Conference of Reachability Problems, Brussels, Belgium.
Avni G, Henzinger TA, Ibsen-Jensen R, Novotny P. Bidding games on Markov decision processes. Proceedings of the 13th International Conference of Reachability Problems. RP: Reachability Problems, LNCS,
Avni, Guy, et al. “Bidding Games on Markov Decision Processes.” Proceedings of the 13th International Conference of Reachability Problems, Springer.
Main File(s)
File Name
436.63 KB
Access Level
OA Open Access
Last Uploaded
2019-08-19T07:56:40Z


Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar