---
_id: '5392'
abstract:
- lang: eng
text: We consider probabilistic automata on infinite words with acceptance defined
by safety, reachability, Büchi, coBüchi and limit-average conditions. We consider
quantitative and qualitative decision problems. We present extensions and adaptations
of proofs of [GO09] and present a precise characterization of the decidability
and undecidability frontier of the quantitative and qualitative decision problems.
alternative_title:
- IST Austria Technical Report
author:
- first_name: Krishnendu
full_name: Chatterjee, Krishnendu
id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
last_name: Chatterjee
orcid: 0000-0002-4561-241X
citation:
ama: 'Chatterjee K. Probabilistic Automata on Infinite Words: Decidability and
Undecidability Results. IST Austria; 2009. doi:10.15479/AT:IST-2009-0004'
apa: 'Chatterjee, K. (2009). Probabilistic automata on infinite words: Decidability
and undecidability results. IST Austria. https://doi.org/10.15479/AT:IST-2009-0004'
chicago: 'Chatterjee, Krishnendu. Probabilistic Automata on Infinite Words: Decidability
and Undecidability Results. IST Austria, 2009. https://doi.org/10.15479/AT:IST-2009-0004.'
ieee: 'K. Chatterjee, Probabilistic automata on infinite words: Decidability
and undecidability results. IST Austria, 2009.'
ista: 'Chatterjee K. 2009. Probabilistic automata on infinite words: Decidability
and undecidability results, IST Austria, 17p.'
mla: 'Chatterjee, Krishnendu. Probabilistic Automata on Infinite Words: Decidability
and Undecidability Results. IST Austria, 2009, doi:10.15479/AT:IST-2009-0004.'
short: 'K. Chatterjee, Probabilistic Automata on Infinite Words: Decidability and
Undecidability Results, IST Austria, 2009.'
date_created: 2018-12-12T11:39:04Z
date_published: 2009-11-02T00:00:00Z
date_updated: 2023-02-23T11:45:44Z
day: '02'
ddc:
- '005'
department:
- _id: KrCh
doi: 10.15479/AT:IST-2009-0004
file:
- access_level: open_access
checksum: fb7563150231325b00b1718d956f687b
content_type: application/pdf
creator: system
date_created: 2018-12-12T11:54:08Z
date_updated: 2020-07-14T12:46:43Z
file_id: '5530'
file_name: IST-2009-0004_IST-2009-0004.pdf
file_size: 311065
relation: main_file
file_date_updated: 2020-07-14T12:46:43Z
has_accepted_license: '1'
language:
- iso: eng
month: '11'
oa: 1
oa_version: Published Version
page: '17'
publication_identifier:
issn:
- 2664-1690
publication_status: published
publisher: IST Austria
pubrep_id: '28'
related_material:
record:
- id: '3857'
relation: later_version
status: public
status: public
title: 'Probabilistic automata on infinite words: Decidability and undecidability
results'
type: technical_report
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
year: '2009'
...
---
_id: '5395'
abstract:
- lang: eng
text: 'We study observation-based strategies for partially-observable Markov decision
processes (POMDPs) with omega-regular objectives. An observation-based strategy
relies on partial information about the history of a play, namely, on the past
sequence of observa- tions. We consider the qualitative analysis problem: given
a POMDP with an omega-regular objective, whether there is an observation-based
strategy to achieve the objective with probability 1 (almost-sure winning), or
with positive probability (positive winning). Our main results are twofold. First,
we present a complete picture of the computational complexity of the qualitative
analysis of POMDPs with parity objectives (a canonical form to express omega-regular
objectives) and its subclasses. Our contribution consists in establishing several
upper and lower bounds that were not known in literature. Second, we present optimal
bounds (matching upper and lower bounds) on the memory required by pure and randomized
observation-based strategies for the qualitative analysis of POMDPs with parity
objectives and its subclasses.'
alternative_title:
- IST Austria Technical Report
author:
- first_name: Krishnendu
full_name: Chatterjee, Krishnendu
id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
last_name: Chatterjee
orcid: 0000-0002-4561-241X
- first_name: Laurent
full_name: Doyen, Laurent
last_name: Doyen
- first_name: Thomas A
full_name: Henzinger, Thomas A
id: 40876CD8-F248-11E8-B48F-1D18A9856A87
last_name: Henzinger
orcid: 0000−0002−2985−7724
citation:
ama: Chatterjee K, Doyen L, Henzinger TA. Qualitative Analysis of Partially-Observable
Markov Decision Processes. IST Austria; 2009. doi:10.15479/AT:IST-2009-0001
apa: Chatterjee, K., Doyen, L., & Henzinger, T. A. (2009). Qualitative analysis
of partially-observable Markov decision processes. IST Austria. https://doi.org/10.15479/AT:IST-2009-0001
chicago: Chatterjee, Krishnendu, Laurent Doyen, and Thomas A Henzinger. Qualitative
Analysis of Partially-Observable Markov Decision Processes. IST Austria, 2009.
https://doi.org/10.15479/AT:IST-2009-0001.
ieee: K. Chatterjee, L. Doyen, and T. A. Henzinger, Qualitative analysis of partially-observable
Markov decision processes. IST Austria, 2009.
ista: Chatterjee K, Doyen L, Henzinger TA. 2009. Qualitative analysis of partially-observable
Markov decision processes, IST Austria, 20p.
mla: Chatterjee, Krishnendu, et al. Qualitative Analysis of Partially-Observable
Markov Decision Processes. IST Austria, 2009, doi:10.15479/AT:IST-2009-0001.
short: K. Chatterjee, L. Doyen, T.A. Henzinger, Qualitative Analysis of Partially-Observable
Markov Decision Processes, IST Austria, 2009.
date_created: 2018-12-12T11:39:05Z
date_published: 2009-09-09T00:00:00Z
date_updated: 2023-02-23T11:45:39Z
day: '09'
ddc:
- '005'
department:
- _id: KrCh
- _id: ToHe
doi: 10.15479/AT:IST-2009-0001
file:
- access_level: open_access
checksum: 04d9cc065cc19598a4e8631c47f1a562
content_type: application/pdf
creator: system
date_created: 2018-12-12T11:53:25Z
date_updated: 2020-07-14T12:46:43Z
file_id: '5486'
file_name: IST-2009-0001_IST-2009-0001.pdf
file_size: 342088
relation: main_file
file_date_updated: 2020-07-14T12:46:43Z
has_accepted_license: '1'
language:
- iso: eng
month: '09'
oa: 1
oa_version: Published Version
page: '20'
publication_identifier:
issn:
- 2664-1690
publication_status: published
publisher: IST Austria
pubrep_id: '31'
related_material:
record:
- id: '3855'
relation: later_version
status: public
status: public
title: Qualitative analysis of partially-observable Markov decision processes
type: technical_report
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
year: '2009'
...