Qualitative logics and equivalences for probabilistic systems

K. Chatterjee, L. De Alfaro, M. Faella, A. Legay, Logical Methods in Computer Science 5 (2009).

Download
No fulltext has been uploaded. References only!

Journal Article | Published
Author
; ; ;
Abstract
We investigate logics and equivalence relations that capture the qualitative behavior of Markov Decision Processes (MDPs). We present Qualitative Randomized CTL (QRCTL): formulas of this logic can express the fact that certain temporal properties hold over all paths, or with probability 0 or 1, but they do not distinguish among intermediate probability values. We present a symbolic, polynomial time model-checking algorithm for QRCTL on MDPs. The logic QRCTL induces an equivalence relation over states of an MDP that we call qualitative equivalence: informally, two states are qualitatively equivalent if the sets of formulas that hold with probability 0 or 1 at the two states are the same. We show that for finite alternating MDPs, where nondeterministic and probabilistic choices occur in different states, qualitative equivalence coincides with alternating bisimulation, and can thus be computed via efficient partition-refinement algorithms. On the other hand, in non-alternating MDPs the equivalence relations cannot be computed via partition-refinement algorithms, but rather, they require non-local computation. Finally, we consider QRCTL*, that extends QRCTL with nested temporal operators in the same manner in which CTL* extends CTL. We show that QRCTL and QRCTL* induce the same qualitative equivalence on alternating MDPs, while on non-alternating MDPs, the equivalence arising from QRCTL* can be strictly finer. We also provide a full characterization of the relation between qualitative equivalence, bisimulation, and alternating bisimulation, according to whether the MDPs are finite, and to whether their transition relations are finitely-branching.
Publishing Year
Date Published
2009-05-04
Journal Title
Logical Methods in Computer Science
Acknowledgement
A preliminary version of this paper appeared in the proceedings of the 4th International Conference on the Quantitative Evaluation of Systems (QEST 2007).
Volume
5
Issue
2
IST-REx-ID

Cite this

Chatterjee K, De Alfaro L, Faella M, Legay A. Qualitative logics and equivalences for probabilistic systems. Logical Methods in Computer Science. 2009;5(2). doi:10.2168/LMCS-5(2:7)2009
Chatterjee, K., De Alfaro, L., Faella, M., & Legay, A. (2009). Qualitative logics and equivalences for probabilistic systems. Logical Methods in Computer Science, 5(2). https://doi.org/10.2168/LMCS-5(2:7)2009
Chatterjee, Krishnendu, Luca De Alfaro, Marco Faella, and Axel Legay. “Qualitative Logics and Equivalences for Probabilistic Systems.” Logical Methods in Computer Science 5, no. 2 (2009). https://doi.org/10.2168/LMCS-5(2:7)2009.
K. Chatterjee, L. De Alfaro, M. Faella, and A. Legay, “Qualitative logics and equivalences for probabilistic systems,” Logical Methods in Computer Science, vol. 5, no. 2, 2009.
Chatterjee K, De Alfaro L, Faella M, Legay A. 2009. Qualitative logics and equivalences for probabilistic systems. Logical Methods in Computer Science. 5(2).
Chatterjee, Krishnendu, et al. “Qualitative Logics and Equivalences for Probabilistic Systems.” Logical Methods in Computer Science, vol. 5, no. 2, International Federation of Computational Logic, 2009, doi:10.2168/LMCS-5(2:7)2009.

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar