---
_id: '9739'
article_processing_charge: No
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Andreas
  full_name: Pavlogiannis, Andreas
  id: 49704004-F248-11E8-B48F-1D18A9856A87
  last_name: Pavlogiannis
  orcid: 0000-0002-8943-0722
- first_name: Ben
  full_name: Adlam, Ben
  last_name: Adlam
- first_name: Martin
  full_name: Novak, Martin
  last_name: Novak
citation:
  ama: Chatterjee K, Pavlogiannis A, Adlam B, Novak M. Detailed proofs for “The time
    scale of evolutionary innovation.” 2014. doi:<a href="https://doi.org/10.1371/journal.pcbi.1003818.s001">10.1371/journal.pcbi.1003818.s001</a>
  apa: Chatterjee, K., Pavlogiannis, A., Adlam, B., &#38; Novak, M. (2014). Detailed
    proofs for “The time scale of evolutionary innovation.” Public Library of Science.
    <a href="https://doi.org/10.1371/journal.pcbi.1003818.s001">https://doi.org/10.1371/journal.pcbi.1003818.s001</a>
  chicago: Chatterjee, Krishnendu, Andreas Pavlogiannis, Ben Adlam, and Martin Novak.
    “Detailed Proofs for ‘The Time Scale of Evolutionary Innovation.’” Public Library
    of Science, 2014. <a href="https://doi.org/10.1371/journal.pcbi.1003818.s001">https://doi.org/10.1371/journal.pcbi.1003818.s001</a>.
  ieee: K. Chatterjee, A. Pavlogiannis, B. Adlam, and M. Novak, “Detailed proofs for
    ‘The time scale of evolutionary innovation.’” Public Library of Science, 2014.
  ista: Chatterjee K, Pavlogiannis A, Adlam B, Novak M. 2014. Detailed proofs for
    “The time scale of evolutionary innovation”, Public Library of Science, <a href="https://doi.org/10.1371/journal.pcbi.1003818.s001">10.1371/journal.pcbi.1003818.s001</a>.
  mla: Chatterjee, Krishnendu, et al. <i>Detailed Proofs for “The Time Scale of Evolutionary
    Innovation.”</i> Public Library of Science, 2014, doi:<a href="https://doi.org/10.1371/journal.pcbi.1003818.s001">10.1371/journal.pcbi.1003818.s001</a>.
  short: K. Chatterjee, A. Pavlogiannis, B. Adlam, M. Novak, (2014).
date_created: 2021-07-28T08:13:57Z
date_published: 2014-09-11T00:00:00Z
date_updated: 2025-09-29T11:53:46Z
day: '11'
department:
- _id: KrCh
doi: 10.1371/journal.pcbi.1003818.s001
fulldoi: https://doi.org/10.1371/journal.pcbi.1003818.s001
month: '09'
oa_version: Published Version
publisher: Public Library of Science
related_material:
  record:
  - id: '2039'
    relation: used_in_publication
    status: public
status: public
title: Detailed proofs for “The time scale of evolutionary innovation”
type: research_data_reference
user_id: 6785fbc1-c503-11eb-8a32-93094b40e1cf
year: '2014'
...
---
_id: '1733'
abstract:
- lang: eng
  text: The classical (boolean) notion of refinement for behavioral interfaces of
    system components is the alternating refinement preorder. In this paper, we define
    a distance for interfaces, called interface simulation distance. It makes the
    alternating refinement preorder quantitative by, intuitively, tolerating errors
    (while counting them) in the alternating simulation game. We show that the interface
    simulation distance satisfies the triangle inequality, that the distance between
    two interfaces does not increase under parallel composition with a third interface,
    that the distance between two interfaces can be bounded from above and below by
    distances between abstractions of the two interfaces, and how to synthesize an
    interface from incompatible requirements. We illustrate the framework, and the
    properties of the distances under composition of interfaces, with two case studies.
article_processing_charge: No
arxiv: 1
author:
- first_name: Pavol
  full_name: Cerny, Pavol
  last_name: Cerny
- first_name: Martin
  full_name: Chmelik, Martin
  id: 3624234E-F248-11E8-B48F-1D18A9856A87
  last_name: Chmelik
- first_name: Thomas A
  full_name: Henzinger, Thomas A
  id: 40876CD8-F248-11E8-B48F-1D18A9856A87
  last_name: Henzinger
  orcid: 0000−0002−2985−7724
- first_name: Arjun
  full_name: Radhakrishna, Arjun
  id: 3B51CAC4-F248-11E8-B48F-1D18A9856A87
  last_name: Radhakrishna
citation:
  ama: Cerny P, Chmelik M, Henzinger TA, Radhakrishna A. Interface simulation distances.
    <i>Theoretical Computer Science</i>. 2014;560(3):348-363. doi:<a href="https://doi.org/10.1016/j.tcs.2014.08.019">10.1016/j.tcs.2014.08.019</a>
  apa: Cerny, P., Chmelik, M., Henzinger, T. A., &#38; Radhakrishna, A. (2014). Interface
    simulation distances. <i>Theoretical Computer Science</i>. Elsevier. <a href="https://doi.org/10.1016/j.tcs.2014.08.019">https://doi.org/10.1016/j.tcs.2014.08.019</a>
  chicago: Cerny, Pavol, Martin Chmelik, Thomas A Henzinger, and Arjun Radhakrishna.
    “Interface Simulation Distances.” <i>Theoretical Computer Science</i>. Elsevier,
    2014. <a href="https://doi.org/10.1016/j.tcs.2014.08.019">https://doi.org/10.1016/j.tcs.2014.08.019</a>.
  ieee: P. Cerny, M. Chmelik, T. A. Henzinger, and A. Radhakrishna, “Interface simulation
    distances,” <i>Theoretical Computer Science</i>, vol. 560, no. 3. Elsevier, pp.
    348–363, 2014.
  ista: Cerny P, Chmelik M, Henzinger TA, Radhakrishna A. 2014. Interface simulation
    distances. Theoretical Computer Science. 560(3), 348–363.
  mla: Cerny, Pavol, et al. “Interface Simulation Distances.” <i>Theoretical Computer
    Science</i>, vol. 560, no. 3, Elsevier, 2014, pp. 348–63, doi:<a href="https://doi.org/10.1016/j.tcs.2014.08.019">10.1016/j.tcs.2014.08.019</a>.
  short: P. Cerny, M. Chmelik, T.A. Henzinger, A. Radhakrishna, Theoretical Computer
    Science 560 (2014) 348–363.
corr_author: '1'
date_created: 2018-12-11T11:53:43Z
date_published: 2014-12-04T00:00:00Z
date_updated: 2025-09-29T13:14:25Z
day: '04'
department:
- _id: ToHe
- _id: KrCh
doi: 10.1016/j.tcs.2014.08.019
ec_funded: 1
external_id:
  arxiv:
  - '1210.2450'
  isi:
  - '000347601300009'
fulldoi: https://doi.org/10.1016/j.tcs.2014.08.019
intvolume: '       560'
isi: 1
issue: '3'
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: http://arxiv.org/abs/1210.2450
month: '12'
oa: 1
oa_version: Submitted Version
page: 348 - 363
project:
- _id: 25EE3708-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '267989'
  name: Quantitative Reactive Modeling
- _id: 25F5A88A-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11402-N23
  name: Moderne Concurrency Paradigms
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: Theoretical Computer Science
publication_status: published
publisher: Elsevier
publist_id: '5392'
quality_controlled: '1'
related_material:
  record:
  - id: '2916'
    relation: earlier_version
    status: public
scopus_import: '1'
status: public
title: Interface simulation distances
type: journal_article
user_id: 317138e5-6ab7-11ef-aa6d-ffef3953e345
volume: 560
year: '2014'
...
---
_id: '2234'
abstract:
- lang: eng
  text: We study Markov decision processes (MDPs) with multiple limit-average (or
    mean-payoff) functions. We consider two different objectives, namely, expectation
    and satisfaction objectives. Given an MDP with κ limit-average functions, in the
    expectation objective the goal is to maximize the expected limit-average value,
    and in the satisfaction objective the goal is to maximize the probability of runs
    such that the limit-average value stays above a given vector. We show that under
    the expectation objective, in contrast to the case of one limit-average function,
    both randomization and memory are necessary for strategies even for ε-approximation,
    and that finite-memory randomized strategies are sufficient for achieving Pareto
    optimal values. Under the satisfaction objective, in contrast to the case of one
    limit-average function, infinite memory is necessary for strategies achieving
    a specific value (i.e. randomized finite-memory strategies are not sufficient),
    whereas memoryless randomized strategies are sufficient for ε-approximation, for
    all ε &gt; 0. We further prove that the decision problems for both expectation
    and satisfaction objectives can be solved in polynomial time and the trade-off
    curve (Pareto curve) can be ε-approximated in time polynomial in the size of the
    MDP and 1/ε, and exponential in the number of limit-average functions, for all
    ε &gt; 0. Our analysis also reveals flaws in previous work for MDPs with multiple
    mean-payoff functions under the expectation objective, corrects the flaws, and
    allows us to obtain improved results.
article_processing_charge: No
author:
- first_name: Tomáš
  full_name: Brázdil, Tomáš
  last_name: Brázdil
- first_name: Václav
  full_name: Brožek, Václav
  last_name: Brožek
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Vojtěch
  full_name: Forejt, Vojtěch
  last_name: Forejt
- first_name: Antonín
  full_name: Kučera, Antonín
  last_name: Kučera
citation:
  ama: Brázdil T, Brožek V, Chatterjee K, Forejt V, Kučera A. Markov decision processes
    with multiple long-run average objectives. <i>Logical Methods in Computer Science</i>.
    2014;10(1). doi:<a href="https://doi.org/10.2168/LMCS-10(1:13)2014">10.2168/LMCS-10(1:13)2014</a>
  apa: Brázdil, T., Brožek, V., Chatterjee, K., Forejt, V., &#38; Kučera, A. (2014).
    Markov decision processes with multiple long-run average objectives. <i>Logical
    Methods in Computer Science</i>. International Federation for Computational Logic.
    <a href="https://doi.org/10.2168/LMCS-10(1:13)2014">https://doi.org/10.2168/LMCS-10(1:13)2014</a>
  chicago: Brázdil, Tomáš, Václav Brožek, Krishnendu Chatterjee, Vojtěch Forejt, and
    Antonín Kučera. “Markov Decision Processes with Multiple Long-Run Average Objectives.”
    <i>Logical Methods in Computer Science</i>. International Federation for Computational
    Logic, 2014. <a href="https://doi.org/10.2168/LMCS-10(1:13)2014">https://doi.org/10.2168/LMCS-10(1:13)2014</a>.
  ieee: T. Brázdil, V. Brožek, K. Chatterjee, V. Forejt, and A. Kučera, “Markov decision
    processes with multiple long-run average objectives,” <i>Logical Methods in Computer
    Science</i>, vol. 10, no. 1. International Federation for Computational Logic,
    2014.
  ista: Brázdil T, Brožek V, Chatterjee K, Forejt V, Kučera A. 2014. Markov decision
    processes with multiple long-run average objectives. Logical Methods in Computer
    Science. 10(1).
  mla: Brázdil, Tomáš, et al. “Markov Decision Processes with Multiple Long-Run Average
    Objectives.” <i>Logical Methods in Computer Science</i>, vol. 10, no. 1, International
    Federation for Computational Logic, 2014, doi:<a href="https://doi.org/10.2168/LMCS-10(1:13)2014">10.2168/LMCS-10(1:13)2014</a>.
  short: T. Brázdil, V. Brožek, K. Chatterjee, V. Forejt, A. Kučera, Logical Methods
    in Computer Science 10 (2014).
das_tickbox: '1'
date_created: 2018-12-11T11:56:29Z
date_published: 2014-02-14T00:00:00Z
date_updated: 2026-07-06T13:23:35Z
day: '14'
ddc:
- '000'
department:
- _id: KrCh
doi: 10.2168/LMCS-10(1:13)2014
ec_funded: 1
external_id:
  isi:
  - '000333744700001'
file:
- access_level: open_access
  checksum: 803edcc2d8c1acfba44a9ec43a5eb9f0
  content_type: application/pdf
  creator: system
  date_created: 2018-12-12T10:07:57Z
  date_updated: 2020-07-14T12:45:34Z
  file_id: '4656'
  file_name: IST-2016-428-v1+1_1104.3489.pdf
  file_size: 375388
  relation: main_file
file_date_updated: 2020-07-14T12:45:34Z
fulldoi: https://doi.org/10.2168/LMCS-10(1:13)2014
has_accepted_license: '1'
intvolume: '        10'
isi: 1
issue: '1'
language:
- iso: eng
license: https://creativecommons.org/licenses/by/4.0/
month: '02'
oa: 1
oa_version: Published Version
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: Logical Methods in Computer Science
publication_identifier:
  issn:
  - 1860-5974
publication_status: published
publisher: International Federation for Computational Logic
publist_id: '4727'
pubrep_id: '428'
quality_controlled: '1'
scopus_import: '1'
status: public
title: Markov decision processes with multiple long-run average objectives
tmp:
  image: /images/cc_by.png
  legal_code_url: https://creativecommons.org/licenses/by/4.0/legalcode
  name: Creative Commons Attribution 4.0 International Public License (CC-BY 4.0)
  short: CC BY (4.0)
type: journal_article
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 10
year: '2014'
...
---
_id: '2027'
abstract:
- lang: eng
  text: We present a general framework for applying machine-learning algorithms to
    the verification of Markov decision processes (MDPs). The primary goal of these
    techniques is to improve performance by avoiding an exhaustive exploration of
    the state space. Our framework focuses on probabilistic reachability, which is
    a core property for verification, and is illustrated through two distinct instantiations.
    The first assumes that full knowledge of the MDP is available, and performs a
    heuristic-driven partial exploration of the model, yielding precise lower and
    upper bounds on the required probability. The second tackles the case where we
    may only sample the MDP, and yields probabilistic guarantees, again in terms of
    both the lower and upper bounds, which provides efficient stopping criteria for
    the approximation. The latter is the first extension of statistical model checking
    for unbounded properties inMDPs. In contrast with other related techniques, our
    approach is not restricted to time-bounded (finite-horizon) or discounted properties,
    nor does it assume any particular properties of the MDP. We also show how our
    methods extend to LTL objectives. We present experimental results showing the
    performance of our framework on several examples.
acknowledgement: This research was funded in part by the European Research Council
  (ERC) under grant agreement 246967 (VERIWARE), by the EU FP7 project HIERATIC, by
  the Czech Science Foundation grant No P202/12/P612, by EPSRC project EP/K038575/1.
alternative_title:
- LNCS
article_processing_charge: No
arxiv: 1
author:
- first_name: Tomáš
  full_name: Brázdil, Tomáš
  last_name: Brázdil
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Martin
  full_name: Chmelik, Martin
  id: 3624234E-F248-11E8-B48F-1D18A9856A87
  last_name: Chmelik
- first_name: Vojtěch
  full_name: Forejt, Vojtěch
  last_name: Forejt
- first_name: Jan
  full_name: Kretinsky, Jan
  id: 44CEF464-F248-11E8-B48F-1D18A9856A87
  last_name: Kretinsky
  orcid: 0000-0002-8122-2881
- first_name: Marta
  full_name: Kwiatkowska, Marta
  last_name: Kwiatkowska
- first_name: David
  full_name: Parker, David
  last_name: Parker
- first_name: Mateusz
  full_name: Ujma, Mateusz
  last_name: Ujma
citation:
  ama: 'Brázdil T, Chatterjee K, Chmelik M, et al. Verification of Markov decision
    processes using learning algorithms. In: <i>12th International Symposium on Automated
    Technology for Verification and Analysis</i>. Vol 8837. Springer; 2014:98-114.
    doi:<a href="https://doi.org/10.1007/978-3-319-11936-6_8">10.1007/978-3-319-11936-6_8</a>'
  apa: 'Brázdil, T., Chatterjee, K., Chmelik, M., Forejt, V., Kretinsky, J., Kwiatkowska,
    M., … Ujma, M. (2014). Verification of Markov decision processes using learning
    algorithms. In <i>12th International Symposium on Automated Technology for Verification
    and Analysis</i> (Vol. 8837, pp. 98–114). Sydney, Australia: Springer. <a href="https://doi.org/10.1007/978-3-319-11936-6_8">https://doi.org/10.1007/978-3-319-11936-6_8</a>'
  chicago: Brázdil, Tomáš, Krishnendu Chatterjee, Martin Chmelik, Vojtěch Forejt,
    Jan Kretinsky, Marta Kwiatkowska, David Parker, and Mateusz Ujma. “Verification
    of Markov Decision Processes Using Learning Algorithms.” In <i>12th International
    Symposium on Automated Technology for Verification and Analysis</i>, 8837:98–114.
    Springer, 2014. <a href="https://doi.org/10.1007/978-3-319-11936-6_8">https://doi.org/10.1007/978-3-319-11936-6_8</a>.
  ieee: T. Brázdil <i>et al.</i>, “Verification of Markov decision processes using
    learning algorithms,” in <i>12th International Symposium on Automated Technology
    for Verification and Analysis</i>, Sydney, Australia, 2014, vol. 8837, pp. 98–114.
  ista: 'Brázdil T, Chatterjee K, Chmelik M, Forejt V, Kretinsky J, Kwiatkowska M,
    Parker D, Ujma M. 2014. Verification of Markov decision processes using learning
    algorithms. 12th International Symposium on Automated Technology for Verification
    and Analysis. ATVA: Automated Technology for Verification and Analysis, LNCS,
    vol. 8837, 98–114.'
  mla: Brázdil, Tomáš, et al. “Verification of Markov Decision Processes Using Learning
    Algorithms.” <i>12th International Symposium on Automated Technology for Verification
    and Analysis</i>, vol. 8837, Springer, 2014, pp. 98–114, doi:<a href="https://doi.org/10.1007/978-3-319-11936-6_8">10.1007/978-3-319-11936-6_8</a>.
  short: T. Brázdil, K. Chatterjee, M. Chmelik, V. Forejt, J. Kretinsky, M. Kwiatkowska,
    D. Parker, M. Ujma, in:, 12th International Symposium on Automated Technology
    for Verification and Analysis, Springer, 2014, pp. 98–114.
conference:
  end_date: 2014-11-07
  location: Sydney, Australia
  name: 'ATVA: Automated Technology for Verification and Analysis'
  start_date: 2014-11-03
das_tickbox: '1'
date_created: 2018-12-11T11:55:17Z
date_published: 2014-11-01T00:00:00Z
date_updated: 2026-07-07T13:15:34Z
day: '01'
department:
- _id: KrCh
- _id: ToHe
doi: 10.1007/978-3-319-11936-6_8
ec_funded: 1
external_id:
  arxiv:
  - '1402.2967'
fulldoi: https://doi.org/10.1007/978-3-319-11936-6_8
intvolume: '      8837'
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: http://arxiv.org/abs/1402.2967
month: '11'
oa: 1
oa_version: Submitted Version
page: 98 - 114
project:
- _id: 25EE3708-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '267989'
  name: Quantitative Reactive Modeling
- _id: 26241A12-B435-11E9-9278-68D0E5697425
  grant_number: '24696'
  name: Light-regulated ligand traps for spatio-temporal inhibition of cell signaling
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 25F5A88A-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11402-N23
  name: Moderne Concurrency Paradigms
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: 12th International Symposium on Automated Technology for Verification
  and Analysis
publication_status: published
publisher: Springer
publist_id: '5046'
quality_controlled: '1'
scopus_import: '1'
status: public
title: Verification of Markov decision processes using learning algorithms
type: conference
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 8837
year: '2014'
...
---
_id: '5415'
abstract:
- lang: eng
  text: 'Recently there has been a significant effort to add quantitative properties
    in formal verification and synthesis. While weighted automata over finite and
    infinite words provide a natural and flexible framework to express quantitative
    properties, perhaps surprisingly, several basic system properties such as average
    response time cannot be expressed with weighted automata. In this work, we introduce
    nested weighted automata as a new formalism for expressing important quantitative
    properties such as average response time. We establish an almost complete decidability
    picture for the basic decision problems for nested weighted automata, and illustrate
    its applicability in several domains.  '
alternative_title:
- IST Austria Technical Report
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Thomas A
  full_name: Henzinger, Thomas A
  id: 40876CD8-F248-11E8-B48F-1D18A9856A87
  last_name: Henzinger
  orcid: 0000−0002−2985−7724
- first_name: Jan
  full_name: Otop, Jan
  id: 2FC5DA74-F248-11E8-B48F-1D18A9856A87
  last_name: Otop
citation:
  ama: Chatterjee K, Henzinger TA, Otop J. <i>Nested Weighted Automata</i>. IST Austria;
    2014. doi:<a href="https://doi.org/10.15479/AT:IST-2014-170-v1-1">10.15479/AT:IST-2014-170-v1-1</a>
  apa: Chatterjee, K., Henzinger, T. A., &#38; Otop, J. (2014). <i>Nested weighted
    automata</i>. IST Austria. <a href="https://doi.org/10.15479/AT:IST-2014-170-v1-1">https://doi.org/10.15479/AT:IST-2014-170-v1-1</a>
  chicago: Chatterjee, Krishnendu, Thomas A Henzinger, and Jan Otop. <i>Nested Weighted
    Automata</i>. IST Austria, 2014. <a href="https://doi.org/10.15479/AT:IST-2014-170-v1-1">https://doi.org/10.15479/AT:IST-2014-170-v1-1</a>.
  ieee: K. Chatterjee, T. A. Henzinger, and J. Otop, <i>Nested weighted automata</i>.
    IST Austria, 2014.
  ista: Chatterjee K, Henzinger TA, Otop J. 2014. Nested weighted automata, IST Austria,
    27p.
  mla: Chatterjee, Krishnendu, et al. <i>Nested Weighted Automata</i>. IST Austria,
    2014, doi:<a href="https://doi.org/10.15479/AT:IST-2014-170-v1-1">10.15479/AT:IST-2014-170-v1-1</a>.
  short: K. Chatterjee, T.A. Henzinger, J. Otop, Nested Weighted Automata, IST Austria,
    2014.
date_created: 2018-12-12T11:39:12Z
date_published: 2014-02-19T00:00:00Z
date_updated: 2026-07-07T14:01:10Z
day: '19'
ddc:
- '004'
department:
- _id: KrCh
- _id: ToHe
doi: 10.15479/AT:IST-2014-170-v1-1
file:
- access_level: open_access
  checksum: 31f90dcf2cf899c3f8c6427cfcc2b3c7
  content_type: application/pdf
  creator: system
  date_created: 2018-12-12T11:53:36Z
  date_updated: 2020-07-14T12:46:48Z
  file_id: '5497'
  file_name: IST-2014-170-v1+1_main.pdf
  file_size: 573457
  relation: main_file
file_date_updated: 2020-07-14T12:46:48Z
fulldoi: https://doi.org/10.15479/AT:IST-2014-170-v1-1
has_accepted_license: '1'
language:
- iso: eng
month: '02'
oa: 1
oa_version: Published Version
page: '27'
publication_identifier:
  issn:
  - 2664-1690
publication_status: published
publisher: IST Austria
pubrep_id: '170'
related_material:
  record:
  - id: '5436'
    relation: later_version
    status: public
  - id: '1656'
    relation: later_version
    status: public
  - id: '467'
    relation: later_version
    status: public
status: public
title: Nested weighted automata
type: technical_report
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
year: '2014'
...
---
_id: '2038'
abstract:
- lang: eng
  text: Recently, there has been an effort to add quantitative objectives to formal
    verification and synthesis. We introduce and investigate the extension of temporal
    logics with quantitative atomic assertions. At the heart of quantitative objectives
    lies the accumulation of values along a computation. It is often the accumulated
    sum, as with energy objectives, or the accumulated average, as with mean-payoff
    objectives. We investigate the extension of temporal logics with the prefix-accumulation
    assertions Sum(v) ≥ c and Avg(v) ≥ c, where v is a numeric (or Boolean) variable
    of the system, c is a constant rational number, and Sum(v) and Avg(v) denote the
    accumulated sum and average of the values of v from the beginning of the computation
    up to the current point in time. We also allow the path-accumulation assertions
    LimInfAvg(v) ≥ c and LimSupAvg(v) ≥ c, referring to the average value along an
    entire infinite computation. We study the border of decidability for such quantitative
    extensions of various temporal logics. In particular, we show that extending the
    fragment of CTL that has only the EX, EF, AX, and AG temporal modalities with
    both prefix-accumulation assertions, or extending LTL with both path-accumulation
    assertions, results in temporal logics whose model-checking problem is decidable.
    Moreover, the prefix-accumulation assertions may be generalized with &quot;controlled
    accumulation,&quot; allowing, for example, to specify constraints on the average
    waiting time between a request and a grant. On the negative side, we show that
    this branching-time logic is, in a sense, the maximal logic with one or both of
    the prefix-accumulation assertions that permits a decidable model-checking procedure.
    Extending a temporal logic that has the EG or EU modalities, such as CTL or LTL,
    makes the problem undecidable.
acknowledgement: The research was supported in part by ERC Starting grant 278410 (QUALITY).
article_number: '27'
article_processing_charge: No
article_type: original
author:
- first_name: Udi
  full_name: Boker, Udi
  id: 31E297B6-F248-11E8-B48F-1D18A9856A87
  last_name: Boker
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Thomas A
  full_name: Henzinger, Thomas A
  id: 40876CD8-F248-11E8-B48F-1D18A9856A87
  last_name: Henzinger
  orcid: 0000−0002−2985−7724
- first_name: Orna
  full_name: Kupferman, Orna
  last_name: Kupferman
citation:
  ama: Boker U, Chatterjee K, Henzinger TA, Kupferman O. Temporal specifications with
    accumulative values. <i>ACM Transactions on Computational Logic</i>. 2014;15(4).
    doi:<a href="https://doi.org/10.1145/2629686">10.1145/2629686</a>
  apa: Boker, U., Chatterjee, K., Henzinger, T. A., &#38; Kupferman, O. (2014). Temporal
    specifications with accumulative values. <i>ACM Transactions on Computational
    Logic</i>. ACM. <a href="https://doi.org/10.1145/2629686">https://doi.org/10.1145/2629686</a>
  chicago: Boker, Udi, Krishnendu Chatterjee, Thomas A Henzinger, and Orna Kupferman.
    “Temporal Specifications with Accumulative Values.” <i>ACM Transactions on Computational
    Logic</i>. ACM, 2014. <a href="https://doi.org/10.1145/2629686">https://doi.org/10.1145/2629686</a>.
  ieee: U. Boker, K. Chatterjee, T. A. Henzinger, and O. Kupferman, “Temporal specifications
    with accumulative values,” <i>ACM Transactions on Computational Logic</i>, vol.
    15, no. 4. ACM, 2014.
  ista: Boker U, Chatterjee K, Henzinger TA, Kupferman O. 2014. Temporal specifications
    with accumulative values. ACM Transactions on Computational Logic. 15(4), 27.
  mla: Boker, Udi, et al. “Temporal Specifications with Accumulative Values.” <i>ACM
    Transactions on Computational Logic</i>, vol. 15, no. 4, 27, ACM, 2014, doi:<a
    href="https://doi.org/10.1145/2629686">10.1145/2629686</a>.
  short: U. Boker, K. Chatterjee, T.A. Henzinger, O. Kupferman, ACM Transactions on
    Computational Logic 15 (2014).
das_tickbox: '1'
date_created: 2018-12-11T11:55:21Z
date_published: 2014-09-16T00:00:00Z
date_updated: 2026-07-07T14:01:43Z
day: '16'
ddc:
- '000'
- '004'
department:
- _id: ToHe
- _id: KrCh
doi: 10.1145/2629686
ec_funded: 1
external_id:
  isi:
  - '000345570700002'
file:
- access_level: open_access
  checksum: 354c41d37500b56320afce94cf9a99c2
  content_type: application/pdf
  creator: system
  date_created: 2018-12-12T10:10:59Z
  date_updated: 2020-07-14T12:45:26Z
  file_id: '4851'
  file_name: IST-2014-192-v1+1_AccumulativeValues.pdf
  file_size: 346184
  relation: main_file
file_date_updated: 2020-07-14T12:45:26Z
fulldoi: https://doi.org/10.1145/2629686
has_accepted_license: '1'
intvolume: '        15'
isi: 1
issue: '4'
language:
- iso: eng
month: '09'
oa: 1
oa_version: Submitted Version
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25F5A88A-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11402-N23
  name: Moderne Concurrency Paradigms
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 25EE3708-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '267989'
  name: Quantitative Reactive Modeling
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: ACM Transactions on Computational Logic
publication_status: published
publisher: ACM
publist_id: '5013'
pubrep_id: '192'
quality_controlled: '1'
related_material:
  record:
  - id: '5385'
    relation: earlier_version
    status: public
  - id: '3356'
    relation: earlier_version
    status: public
scopus_import: '1'
status: public
title: Temporal specifications with accumulative values
type: journal_article
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 15
year: '2014'
...
---
OA_place: repository
OA_type: green
_id: '1903'
abstract:
- lang: eng
  text: 'We consider two-player zero-sum partial-observation stochastic games on graphs.
    Based on the information available to the players these games can be classified
    as follows: (a) general partial-observation (both players have partial view of
    the game); (b) one-sided partial-observation (one player has partial-observation
    and the other player has complete-observation); and (c) perfect-observation (both
    players have complete view of the game). The one-sided partial-observation games
    subsumes the important special case of one-player partial-observation stochastic
    games (or partial-observation Markov decision processes (POMDPs)). Based on the
    randomization available for the strategies, (a) the players may not be allowed
    to use randomization (pure strategies), or (b) they may choose a probability distribution
    over actions but the actual random choice is external and not visible to the player
    (actions invisible), or (c) they may use full randomization. We consider all these
    classes of games with reachability, and parity objectives that can express all
    ω-regular objectives. The analysis problems are classified into the qualitative
    analysis that asks for the existence of a strategy that ensures the objective
    with probability 1; and the quantitative analysis that asks for the existence
    of a strategy that ensures the objective with probability at least λ (0,1). In
    this talk we will cover a wide range of results: for perfect-observation games;
    for POMDPs; for one-sided partial-observation games; and for general partial-observation
    games.'
alternative_title:
- LNCS
article_processing_charge: No
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
citation:
  ama: 'Chatterjee K. Partial-observation stochastic reachability and parity games.
    In: Vol 8634. Springer; 2014:1-4. doi:<a href="https://doi.org/10.1007/978-3-662-44522-8_1">10.1007/978-3-662-44522-8_1</a>'
  apa: 'Chatterjee, K. (2014). Partial-observation stochastic reachability and parity
    games (Vol. 8634, pp. 1–4). Presented at the MFCS: Mathematical Foundations of
    Computer Science, Budapest, Hungary: Springer. <a href="https://doi.org/10.1007/978-3-662-44522-8_1">https://doi.org/10.1007/978-3-662-44522-8_1</a>'
  chicago: Chatterjee, Krishnendu. “Partial-Observation Stochastic Reachability and
    Parity Games,” 8634:1–4. Springer, 2014. <a href="https://doi.org/10.1007/978-3-662-44522-8_1">https://doi.org/10.1007/978-3-662-44522-8_1</a>.
  ieee: 'K. Chatterjee, “Partial-observation stochastic reachability and parity games,”
    presented at the MFCS: Mathematical Foundations of Computer Science, Budapest,
    Hungary, 2014, vol. 8634, no. PART 1, pp. 1–4.'
  ista: 'Chatterjee K. 2014. Partial-observation stochastic reachability and parity
    games. MFCS: Mathematical Foundations of Computer Science, LNCS, vol. 8634, 1–4.'
  mla: Chatterjee, Krishnendu. <i>Partial-Observation Stochastic Reachability and
    Parity Games</i>. Vol. 8634, no. PART 1, Springer, 2014, pp. 1–4, doi:<a href="https://doi.org/10.1007/978-3-662-44522-8_1">10.1007/978-3-662-44522-8_1</a>.
  short: K. Chatterjee, in:, Springer, 2014, pp. 1–4.
conference:
  end_date: 2014-08-29
  location: Budapest, Hungary
  name: 'MFCS: Mathematical Foundations of Computer Science'
  start_date: 2014-08-25
corr_author: '1'
date_created: 2018-12-11T11:54:38Z
date_published: 2014-01-01T00:00:00Z
date_updated: 2026-07-07T14:01:25Z
day: '01'
department:
- _id: KrCh
doi: 10.1007/978-3-662-44522-8_1
ec_funded: 1
fulldoi: https://doi.org/10.1007/978-3-662-44522-8_1
intvolume: '      8634'
issue: PART 1
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: https://doi.org/10.15479/AT:IST-2011-0007
month: '01'
oa: 1
oa_version: Preprint
page: 1 - 4
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication_status: published
publisher: Springer
publist_id: '5192'
pubrep_id: '141'
quality_controlled: '1'
related_material:
  record:
  - id: '5381'
    relation: earlier_version
    status: public
  - id: '2211'
    relation: later_version
    status: public
scopus_import: '1'
status: public
title: Partial-observation stochastic reachability and parity games
type: conference
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 8634
year: '2014'
...
---
_id: '2211'
abstract:
- lang: eng
  text: 'In two-player finite-state stochastic games of partial observation on graphs,
    in every state of the graph, the players simultaneously choose an action, and
    their joint actions determine a probability distribution over the successor states.
    The game is played for infinitely many rounds and thus the players construct an
    infinite path in the graph. We consider reachability objectives where the first
    player tries to ensure a target state to be visited almost-surely (i.e., with
    probability 1) or positively (i.e., with positive probability), no matter the
    strategy of the second player. We classify such games according to the information
    and to the power of randomization available to the players. On the basis of information,
    the game can be one-sided with either (a) player 1, or (b) player 2 having partial
    observation (and the other player has perfect observation), or two-sided with
    (c) both players having partial observation. On the basis of randomization, (a)
    the players may not be allowed to use randomization (pure strategies), or (b)
    they may choose a probability distribution over actions but the actual random
    choice is external and not visible to the player (actions invisible), or (c) they
    may use full randomization. Our main results for pure strategies are as follows:
    (1) For one-sided games with player 2 having perfect observation we show that
    (in contrast to full randomized strategies) belief-based (subset-construction
    based) strategies are not sufficient, and we present an exponential upper bound
    on memory both for almost-sure and positive winning strategies; we show that the
    problem of deciding the existence of almost-sure and positive winning strategies
    for player 1 is EXPTIME-complete and present symbolic algorithms that avoid the
    explicit exponential construction. (2) For one-sided games with player 1 having
    perfect observation we show that nonelementarymemory is both necessary and sufficient
    for both almost-sure and positive winning strategies. (3) We show that for the
    general (two-sided) case finite-memory strategies are sufficient for both positive
    and almost-sure winning, and at least nonelementary memory is required. We establish
    the equivalence of the almost-sure winning problems for pure strategies and for
    randomized strategies with actions invisible. Our equivalence result exhibit serious
    flaws in previous results of the literature: we show a nonelementary memory lower
    bound for almost-sure winning whereas an exponential upper bound was previously
    claimed.'
article_number: '16'
article_processing_charge: No
arxiv: 1
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Laurent
  full_name: Doyen, Laurent
  last_name: Doyen
citation:
  ama: 'Chatterjee K, Doyen L. Partial-observation stochastic games: How to win when
    belief fails. <i>ACM Transactions on Computational Logic</i>. 2014;15(2). doi:<a
    href="https://doi.org/10.1145/2579821">10.1145/2579821</a>'
  apa: 'Chatterjee, K., &#38; Doyen, L. (2014). Partial-observation stochastic games:
    How to win when belief fails. <i>ACM Transactions on Computational Logic</i>.
    ACM. <a href="https://doi.org/10.1145/2579821">https://doi.org/10.1145/2579821</a>'
  chicago: 'Chatterjee, Krishnendu, and Laurent Doyen. “Partial-Observation Stochastic
    Games: How to Win When Belief Fails.” <i>ACM Transactions on Computational Logic</i>.
    ACM, 2014. <a href="https://doi.org/10.1145/2579821">https://doi.org/10.1145/2579821</a>.'
  ieee: 'K. Chatterjee and L. Doyen, “Partial-observation stochastic games: How to
    win when belief fails,” <i>ACM Transactions on Computational Logic</i>, vol. 15,
    no. 2. ACM, 2014.'
  ista: 'Chatterjee K, Doyen L. 2014. Partial-observation stochastic games: How to
    win when belief fails. ACM Transactions on Computational Logic. 15(2), 16.'
  mla: 'Chatterjee, Krishnendu, and Laurent Doyen. “Partial-Observation Stochastic
    Games: How to Win When Belief Fails.” <i>ACM Transactions on Computational Logic</i>,
    vol. 15, no. 2, 16, ACM, 2014, doi:<a href="https://doi.org/10.1145/2579821">10.1145/2579821</a>.'
  short: K. Chatterjee, L. Doyen, ACM Transactions on Computational Logic 15 (2014).
das_tickbox: '1'
date_created: 2018-12-11T11:56:21Z
date_published: 2014-04-01T00:00:00Z
date_updated: 2026-07-07T14:01:26Z
day: '01'
department:
- _id: KrCh
doi: 10.1145/2579821
external_id:
  arxiv:
  - '1107.2141'
  isi:
  - '000336005000006'
fulldoi: https://doi.org/10.1145/2579821
intvolume: '        15'
isi: 1
issue: '2'
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: http://arxiv.org/abs/1107.2141
month: '04'
oa: 1
oa_version: Preprint
publication: ACM Transactions on Computational Logic
publication_status: published
publisher: ACM
publist_id: '4759'
quality_controlled: '1'
related_material:
  record:
  - id: '5381'
    relation: earlier_version
    status: public
  - id: '1903'
    relation: earlier_version
    status: public
  - id: '2955'
    relation: earlier_version
    status: public
scopus_import: '1'
status: public
title: 'Partial-observation stochastic games: How to win when belief fails'
type: journal_article
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 15
year: '2014'
...
---
_id: '2054'
abstract:
- lang: eng
  text: 'We study two-player concurrent games on finite-state graphs played for an
    infinite number of rounds, where in each round, the two players (player 1 and
    player 2) choose their moves independently and simultaneously; the current state
    and the two moves determine the successor state. The objectives are ω-regular
    winning conditions specified as parity objectives. We consider the qualitative
    analysis problems: the computation of the almost-sure and limit-sure winning set
    of states, where player 1 can ensure to win with probability 1 and with probability
    arbitrarily close to 1, respectively. In general the almost-sure and limit-sure
    winning strategies require both infinite-memory as well as infinite-precision
    (to describe probabilities). While the qualitative analysis problem for concurrent
    parity games with infinite-memory, infinite-precision randomized strategies was
    studied before, we study the bounded-rationality problem for qualitative analysis
    of concurrent parity games, where the strategy set for player 1 is restricted
    to bounded-resource strategies. In terms of precision, strategies can be deterministic,
    uniform, finite-precision, or infinite-precision; and in terms of memory, strategies
    can be memoryless, finite-memory, or infinite-memory. We present a precise and
    complete characterization of the qualitative winning sets for all combinations
    of classes of strategies. In particular, we show that uniform memoryless strategies
    are as powerful as finite-precision infinite-memory strategies, and infinite-precision
    memoryless strategies are as powerful as infinite-precision finite-memory strategies.
    We show that the winning sets can be computed in (n2d+3) time, where n is the
    size of the game structure and 2d is the number of priorities (or colors), and
    our algorithms are symbolic. The membership problem of whether a state belongs
    to a winning set can be decided in NP ∩ coNP. Our symbolic algorithms are based
    on a characterization of the winning sets as μ-calculus formulas, however, our
    μ-calculus formulas are crucially different from the ones for concurrent parity
    games (without bounded rationality); and our memoryless witness strategy constructions
    are significantly different from the infinite-memory witness strategy constructions
    for concurrent parity games.'
alternative_title:
- LNCS
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
citation:
  ama: 'Chatterjee K. Qualitative concurrent parity games: Bounded rationality. In:
    Baldan P, Gorla D, eds. <i>Lecture Notes in Computer Science (Including Subseries
    Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)</i>.
    Vol 8704. Schloss Dagstuhl - Leibniz-Zentrum für Informatik; 2014:544-559. doi:<a
    href="https://doi.org/10.1007/978-3-662-44584-6_37">10.1007/978-3-662-44584-6_37</a>'
  apa: 'Chatterjee, K. (2014). Qualitative concurrent parity games: Bounded rationality.
    In P. Baldan &#38; D. Gorla (Eds.), <i>Lecture Notes in Computer Science (including
    subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)</i>
    (Vol. 8704, pp. 544–559). Rome, Italy: Schloss Dagstuhl - Leibniz-Zentrum für
    Informatik. <a href="https://doi.org/10.1007/978-3-662-44584-6_37">https://doi.org/10.1007/978-3-662-44584-6_37</a>'
  chicago: 'Chatterjee, Krishnendu. “Qualitative Concurrent Parity Games: Bounded
    Rationality.” In <i>Lecture Notes in Computer Science (Including Subseries Lecture
    Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)</i>, edited
    by Paolo Baldan and Daniele Gorla, 8704:544–59. Schloss Dagstuhl - Leibniz-Zentrum
    für Informatik, 2014. <a href="https://doi.org/10.1007/978-3-662-44584-6_37">https://doi.org/10.1007/978-3-662-44584-6_37</a>.'
  ieee: 'K. Chatterjee, “Qualitative concurrent parity games: Bounded rationality,”
    in <i>Lecture Notes in Computer Science (including subseries Lecture Notes in
    Artificial Intelligence and Lecture Notes in Bioinformatics)</i>, Rome, Italy,
    2014, vol. 8704, pp. 544–559.'
  ista: 'Chatterjee K. 2014. Qualitative concurrent parity games: Bounded rationality.
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial
    Intelligence and Lecture Notes in Bioinformatics). CONCUR: Concurrency Theory,
    LNCS, vol. 8704, 544–559.'
  mla: 'Chatterjee, Krishnendu. “Qualitative Concurrent Parity Games: Bounded Rationality.”
    <i>Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial
    Intelligence and Lecture Notes in Bioinformatics)</i>, edited by Paolo Baldan
    and Daniele Gorla, vol. 8704, Schloss Dagstuhl - Leibniz-Zentrum für Informatik,
    2014, pp. 544–59, doi:<a href="https://doi.org/10.1007/978-3-662-44584-6_37">10.1007/978-3-662-44584-6_37</a>.'
  short: K. Chatterjee, in:, P. Baldan, D. Gorla (Eds.), Lecture Notes in Computer
    Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture
    Notes in Bioinformatics), Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2014,
    pp. 544–559.
conference:
  end_date: 2014-09-05
  location: Rome, Italy
  name: 'CONCUR: Concurrency Theory'
  start_date: 2014-09-02
corr_author: '1'
date_created: 2018-12-11T11:55:27Z
date_published: 2014-09-01T00:00:00Z
date_updated: 2026-07-07T14:02:37Z
day: '01'
department:
- _id: KrCh
doi: 10.1007/978-3-662-44584-6_37
ec_funded: 1
editor:
- first_name: Paolo
  full_name: Baldan, Paolo
  last_name: Baldan
- first_name: Daniele
  full_name: Gorla, Daniele
  last_name: Gorla
fulldoi: https://doi.org/10.1007/978-3-662-44584-6_37
intvolume: '      8704'
language:
- iso: eng
month: '09'
oa_version: None
page: 544 - 559
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: Lecture Notes in Computer Science (including subseries Lecture Notes
  in Artificial Intelligence and Lecture Notes in Bioinformatics)
publication_status: published
publisher: Schloss Dagstuhl - Leibniz-Zentrum für Informatik
publist_id: '4992'
quality_controlled: '1'
related_material:
  record:
  - id: '3354'
    relation: earlier_version
    status: public
scopus_import: '1'
status: public
title: 'Qualitative concurrent parity games: Bounded rationality'
type: conference
user_id: 4435EBFC-F248-11E8-B48F-1D18A9856A87
volume: 8704
year: '2014'
...
---
_id: '535'
abstract:
- lang: eng
  text: Energy games belong to a class of turn-based two-player infinite-duration
    games played on a weighted directed graph. It is one of the rare and intriguing
    combinatorial problems that lie in NP∩co-NP, but are not known to be in P. The
    existence of polynomial-time algorithms has been a major open problem for decades
    and apart from pseudopolynomial algorithms there is no algorithm that solves any
    non-trivial subclass in polynomial time. In this paper, we give several results
    based on the weight structures of the graph. First, we identify a notion of penalty
    and present a polynomial-time algorithm when the penalty is large. Our algorithm
    is the first polynomial-time algorithm on a large class of weighted graphs. It
    includes several worst-case instances on which previous algorithms, such as value
    iteration and random facet algorithms, require at least sub-exponential time.
    Our main technique is developing the first non-trivial approximation algorithm
    and showing how to convert it to an exact algorithm. Moreover, we show that in
    a practical case in verification where weights are clustered around a constant
    number of values, the energy game problem can be solved in polynomial time. We
    also show that the problem is still as hard as in general when the clique-width
    is bounded or the graph is strongly ergodic, suggesting that restricting the graph
    structure does not necessarily help.
article_processing_charge: No
article_type: original
arxiv: 1
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Monika H
  full_name: Henzinger, Monika H
  id: 540c9bbd-f2de-11ec-812d-d04a5be85630
  last_name: Henzinger
  orcid: 0000-0002-5008-6530
- first_name: Sebastian
  full_name: Krinninger, Sebastian
  last_name: Krinninger
- first_name: Danupon
  full_name: Nanongkai, Danupon
  last_name: Nanongkai
citation:
  ama: Chatterjee K, Henzinger M, Krinninger S, Nanongkai D. Polynomial-time algorithms
    for energy games with special weight structures. <i>Algorithmica</i>. 2014;70(3):457-492.
    doi:<a href="https://doi.org/10.1007/s00453-013-9843-7">10.1007/s00453-013-9843-7</a>
  apa: Chatterjee, K., Henzinger, M., Krinninger, S., &#38; Nanongkai, D. (2014).
    Polynomial-time algorithms for energy games with special weight structures. <i>Algorithmica</i>.
    Springer. <a href="https://doi.org/10.1007/s00453-013-9843-7">https://doi.org/10.1007/s00453-013-9843-7</a>
  chicago: Chatterjee, Krishnendu, Monika Henzinger, Sebastian Krinninger, and Danupon
    Nanongkai. “Polynomial-Time Algorithms for Energy Games with Special Weight Structures.”
    <i>Algorithmica</i>. Springer, 2014. <a href="https://doi.org/10.1007/s00453-013-9843-7">https://doi.org/10.1007/s00453-013-9843-7</a>.
  ieee: K. Chatterjee, M. Henzinger, S. Krinninger, and D. Nanongkai, “Polynomial-time
    algorithms for energy games with special weight structures,” <i>Algorithmica</i>,
    vol. 70, no. 3. Springer, pp. 457–492, 2014.
  ista: Chatterjee K, Henzinger M, Krinninger S, Nanongkai D. 2014. Polynomial-time
    algorithms for energy games with special weight structures. Algorithmica. 70(3),
    457–492.
  mla: Chatterjee, Krishnendu, et al. “Polynomial-Time Algorithms for Energy Games
    with Special Weight Structures.” <i>Algorithmica</i>, vol. 70, no. 3, Springer,
    2014, pp. 457–92, doi:<a href="https://doi.org/10.1007/s00453-013-9843-7">10.1007/s00453-013-9843-7</a>.
  short: K. Chatterjee, M. Henzinger, S. Krinninger, D. Nanongkai, Algorithmica 70
    (2014) 457–492.
date_created: 2018-12-11T11:47:01Z
date_published: 2014-11-01T00:00:00Z
date_updated: 2026-07-08T05:50:38Z
day: '01'
department:
- _id: KrCh
doi: 10.1007/s00453-013-9843-7
ec_funded: 1
external_id:
  arxiv:
  - '1604.08234'
  isi:
  - '000340552300005'
fulldoi: https://doi.org/10.1007/s00453-013-9843-7
intvolume: '        70'
isi: 1
issue: '3'
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: https://arxiv.org/abs/1604.08234
month: '11'
oa: 1
oa_version: Preprint
page: 457 - 492
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: Algorithmica
publication_status: published
publisher: Springer
publist_id: '7282'
quality_controlled: '1'
related_material:
  record:
  - id: '10905'
    relation: earlier_version
    status: public
scopus_import: '1'
status: public
title: Polynomial-time algorithms for energy games with special weight structures
type: journal_article
user_id: 317138e5-6ab7-11ef-aa6d-ffef3953e345
volume: 70
year: '2014'
...
---
_id: '2716'
abstract:
- lang: eng
  text: Multi-dimensional mean-payoff and energy games provide the mathematical foundation
    for the quantitative study of reactive systems, and play a central role in the
    emerging quantitative theory of verification and synthesis. In this work, we study
    the strategy synthesis problem for games with such multi-dimensional objectives
    along with a parity condition, a canonical way to express ω ω -regular conditions.
    While in general, the winning strategies in such games may require infinite memory,
    for synthesis the most relevant problem is the construction of a finite-memory
    winning strategy (if one exists). Our main contributions are as follows. First,
    we show a tight exponential bound (matching upper and lower bounds) on the memory
    required for finite-memory winning strategies in both multi-dimensional mean-payoff
    and energy games along with parity objectives. This significantly improves the
    triple exponential upper bound for multi energy games (without parity) that could
    be derived from results in literature for games on vector addition systems with
    states. Second, we present an optimal symbolic and incremental algorithm to compute
    a finite-memory winning strategy (if one exists) in such games. Finally, we give
    a complete characterization of when finite memory of strategies can be traded
    off for randomness. In particular, we show that for one-dimension mean-payoff
    parity games, randomized memoryless strategies are as powerful as their pure finite-memory
    counterparts.
acknowledgement: "Krishnendu Chatterjee is supported by Austrian Science Fund (FWF)
  Grant No P 23499-N23, FWF NFN Grant No S11407 (RiSE), ERC Starting Grant (279307:
  Graph Games) and Microsoft faculty fellowship. Mickael Randour is supported by F.R.S.-FNRS.
  fellowship. \r\nJean-François Raskin is supported by ERC Starting Grant (279499:
  inVEST).Thanks to D. Sbabo for useful pointers, V. Bruyère for comments on a preliminary
  draft, and A. Bohy for fruitful discussions about the Acacia+ tool. We are grateful
  to the anonymous reviewers for their insightful comments. "
article_processing_charge: No
article_type: original
arxiv: 1
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Mickael
  full_name: Randour, Mickael
  last_name: Randour
- first_name: Jean
  full_name: Raskin, Jean
  last_name: Raskin
citation:
  ama: Chatterjee K, Randour M, Raskin J. Strategy synthesis for multi-dimensional
    quantitative objectives. <i>Acta Informatica</i>. 2014;51(3-4):129-163. doi:<a
    href="https://doi.org/10.1007/s00236-013-0182-6">10.1007/s00236-013-0182-6</a>
  apa: Chatterjee, K., Randour, M., &#38; Raskin, J. (2014). Strategy synthesis for
    multi-dimensional quantitative objectives. <i>Acta Informatica</i>. Springer.
    <a href="https://doi.org/10.1007/s00236-013-0182-6">https://doi.org/10.1007/s00236-013-0182-6</a>
  chicago: Chatterjee, Krishnendu, Mickael Randour, and Jean Raskin. “Strategy Synthesis
    for Multi-Dimensional Quantitative Objectives.” <i>Acta Informatica</i>. Springer,
    2014. <a href="https://doi.org/10.1007/s00236-013-0182-6">https://doi.org/10.1007/s00236-013-0182-6</a>.
  ieee: K. Chatterjee, M. Randour, and J. Raskin, “Strategy synthesis for multi-dimensional
    quantitative objectives,” <i>Acta Informatica</i>, vol. 51, no. 3–4. Springer,
    pp. 129–163, 2014.
  ista: Chatterjee K, Randour M, Raskin J. 2014. Strategy synthesis for multi-dimensional
    quantitative objectives. Acta Informatica. 51(3–4), 129–163.
  mla: Chatterjee, Krishnendu, et al. “Strategy Synthesis for Multi-Dimensional Quantitative
    Objectives.” <i>Acta Informatica</i>, vol. 51, no. 3–4, Springer, 2014, pp. 129–63,
    doi:<a href="https://doi.org/10.1007/s00236-013-0182-6">10.1007/s00236-013-0182-6</a>.
  short: K. Chatterjee, M. Randour, J. Raskin, Acta Informatica 51 (2014) 129–163.
das_tickbox: '1'
date_created: 2018-12-11T11:59:14Z
date_published: 2014-06-01T00:00:00Z
date_updated: 2026-07-28T11:24:52Z
day: '01'
department:
- _id: KrCh
doi: 10.1007/s00236-013-0182-6
ec_funded: 1
external_id:
  arxiv:
  - '1201.5073'
  isi:
  - '000335981500002'
fulldoi: https://doi.org/10.1007/s00236-013-0182-6
intvolume: '        51'
isi: 1
issue: 3-4
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: http://arxiv.org/abs/1201.5073
month: '06'
oa: 1
oa_version: Preprint
page: 129 - 163
project:
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: Acta Informatica
publication_status: published
publisher: Springer
publist_id: '4176'
quality_controlled: '1'
related_material:
  record:
  - id: '10904'
    relation: earlier_version
    status: public
scopus_import: '1'
status: public
title: Strategy synthesis for multi-dimensional quantitative objectives
type: journal_article
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 51
year: '2014'
...
---
_id: '10902'
abstract:
- lang: eng
  text: We consider how to edit strings from a source language so that the edited
    strings belong to a target language, where the languages are given as deterministic
    finite automata. Non-streaming (or offline) transducers perform edits given the
    whole source string. We show that the class of deterministic one-pass transducers
    with registers along with increment and min operation suffices for computing optimal
    edit distance, whereas the same class of transducers without the min operation
    is not sufficient. Streaming (or online) transducers perform edits as the letters
    of the source string are received. We present a polynomial time algorithm for
    the partial-repair problem that given a bound α asks for the construction of a
    deterministic streaming transducer (if one exists) that ensures that the ‘maximum
    fraction’ η of the strings of the source language are edited, within cost α, to
    the target language.
acknowledgement: 'The research was supported by Austrian Science Fund (FWF) Grant
  No P 23499-N23, FWF NFN Grant No S11407-N23 (RiSE), ERC Start grant (279307: Graph
  Games), and Microsoft faculty fellows award. Thanks to Gabriele Puppis for suggesting
  the problem of identifying a deterministic transducer to compute the optimal cost,
  and to Martin Chmelik for his comments on the introduction.'
alternative_title:
- LNCS
article_processing_charge: No
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Siddhesh
  full_name: Chaubal, Siddhesh
  last_name: Chaubal
- first_name: Sasha
  full_name: Rubin, Sasha
  id: 2EC51194-F248-11E8-B48F-1D18A9856A87
  last_name: Rubin
citation:
  ama: 'Chatterjee K, Chaubal S, Rubin S. How to travel between languages. In: <i>7th
    International Conference on Language and Automata Theory and Applications</i>.
    Vol 7810. LNCS. Berlin, Heidelberg: Springer Nature; 2013:214-225. doi:<a href="https://doi.org/10.1007/978-3-642-37064-9_20">10.1007/978-3-642-37064-9_20</a>'
  apa: 'Chatterjee, K., Chaubal, S., &#38; Rubin, S. (2013). How to travel between
    languages. In <i>7th International Conference on Language and Automata Theory
    and Applications</i> (Vol. 7810, pp. 214–225). Berlin, Heidelberg: Springer Nature.
    <a href="https://doi.org/10.1007/978-3-642-37064-9_20">https://doi.org/10.1007/978-3-642-37064-9_20</a>'
  chicago: 'Chatterjee, Krishnendu, Siddhesh Chaubal, and Sasha Rubin. “How to Travel
    between Languages.” In <i>7th International Conference on Language and Automata
    Theory and Applications</i>, 7810:214–25. LNCS. Berlin, Heidelberg: Springer Nature,
    2013. <a href="https://doi.org/10.1007/978-3-642-37064-9_20">https://doi.org/10.1007/978-3-642-37064-9_20</a>.'
  ieee: K. Chatterjee, S. Chaubal, and S. Rubin, “How to travel between languages,”
    in <i>7th International Conference on Language and Automata Theory and Applications</i>,
    Bilbao, Spain, 2013, vol. 7810, pp. 214–225.
  ista: 'Chatterjee K, Chaubal S, Rubin S. 2013. How to travel between languages.
    7th International Conference on Language and Automata Theory and Applications.
    LATA: Language and Automata Theory and ApplicationsLNCS, LNCS, vol. 7810, 214–225.'
  mla: Chatterjee, Krishnendu, et al. “How to Travel between Languages.” <i>7th International
    Conference on Language and Automata Theory and Applications</i>, vol. 7810, Springer
    Nature, 2013, pp. 214–25, doi:<a href="https://doi.org/10.1007/978-3-642-37064-9_20">10.1007/978-3-642-37064-9_20</a>.
  short: K. Chatterjee, S. Chaubal, S. Rubin, in:, 7th International Conference on
    Language and Automata Theory and Applications, Springer Nature, Berlin, Heidelberg,
    2013, pp. 214–225.
conference:
  end_date: 2013-04-05
  location: Bilbao, Spain
  name: 'LATA: Language and Automata Theory and Applications'
  start_date: 2013-04-02
corr_author: '1'
date_created: 2022-03-21T07:56:21Z
date_published: 2013-04-15T00:00:00Z
date_updated: 2025-07-10T11:50:03Z
day: '15'
department:
- _id: KrCh
doi: 10.1007/978-3-642-37064-9_20
ec_funded: 1
fulldoi: https://doi.org/10.1007/978-3-642-37064-9_20
intvolume: '      7810'
language:
- iso: eng
month: '04'
oa_version: None
page: 214-225
place: Berlin, Heidelberg
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: 7th International Conference on Language and Automata Theory and Applications
publication_identifier:
  eisbn:
  - '9783642370649'
  eissn:
  - 1611-3349
  isbn:
  - '9783642370632'
  issn:
  - 0302-9743
publication_status: published
publisher: Springer Nature
quality_controlled: '1'
scopus_import: '1'
series_title: LNCS
status: public
title: How to travel between languages
type: conference
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 7810
year: '2013'
...
---
_id: '2238'
abstract:
- lang: eng
  text: "We study the problem of achieving a given value in Markov decision processes
    (MDPs) with several independent discounted reward objectives. We consider a generalised
    version of discounted reward objectives, in which the amount of discounting depends
    on the states visited and on the objective. This definition extends the usual
    definition of discounted reward, and allows to capture the systems in which the
    value of different commodities diminish at different and variable rates.\r\n\r\nWe
    establish results for two prominent subclasses of the problem, namely state-discount
    models where the discount factors are only dependent on the state of the MDP (and
    independent of the objective), and reward-discount models where they are only
    dependent on the objective (but not on the state of the MDP). For the state-discount
    models we use a straightforward reduction to expected total reward and show that
    the problem whether a value is achievable can be solved in polynomial time. For
    the reward-discount model we show that memory and randomisation of the strategies
    are required, but nevertheless that the problem is decidable and it is sufficient
    to consider strategies which after a certain number of steps behave in a memoryless
    way.\r\n\r\nFor the general case, we show that when restricted to graphs (i.e.
    MDPs with no randomisation), pure strategies and discount factors of the form
    1/n where n is an integer, the problem is in PSPACE and finite memory suffices
    for achieving a given value. We also show that when the discount factors are not
    of the form 1/n, the memory required by a strategy can be infinite.\r\n"
alternative_title:
- LNCS
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Vojtěch
  full_name: Forejt, Vojtěch
  last_name: Forejt
- first_name: Dominik
  full_name: Wojtczak, Dominik
  last_name: Wojtczak
citation:
  ama: Chatterjee K, Forejt V, Wojtczak D. Multi-objective discounted reward verification
    in graphs and MDPs. 2013;8312:228-242. doi:<a href="https://doi.org/10.1007/978-3-642-45221-5_17">10.1007/978-3-642-45221-5_17</a>
  apa: 'Chatterjee, K., Forejt, V., &#38; Wojtczak, D. (2013). Multi-objective discounted
    reward verification in graphs and MDPs. Presented at the LPAR: Logic for Programming,
    Artificial Intelligence, and Reasoning, Stellenbosch, South Africa: Springer.
    <a href="https://doi.org/10.1007/978-3-642-45221-5_17">https://doi.org/10.1007/978-3-642-45221-5_17</a>'
  chicago: Chatterjee, Krishnendu, Vojtěch Forejt, and Dominik Wojtczak. “Multi-Objective
    Discounted Reward Verification in Graphs and MDPs.” Lecture Notes in Computer
    Science. Springer, 2013. <a href="https://doi.org/10.1007/978-3-642-45221-5_17">https://doi.org/10.1007/978-3-642-45221-5_17</a>.
  ieee: K. Chatterjee, V. Forejt, and D. Wojtczak, “Multi-objective discounted reward
    verification in graphs and MDPs,” vol. 8312. Springer, pp. 228–242, 2013.
  ista: Chatterjee K, Forejt V, Wojtczak D. 2013. Multi-objective discounted reward
    verification in graphs and MDPs. 8312, 228–242.
  mla: Chatterjee, Krishnendu, et al. <i>Multi-Objective Discounted Reward Verification
    in Graphs and MDPs</i>. Vol. 8312, Springer, 2013, pp. 228–42, doi:<a href="https://doi.org/10.1007/978-3-642-45221-5_17">10.1007/978-3-642-45221-5_17</a>.
  short: K. Chatterjee, V. Forejt, D. Wojtczak, 8312 (2013) 228–242.
conference:
  end_date: 2013-12-19
  location: Stellenbosch, South Africa
  name: 'LPAR: Logic for Programming, Artificial Intelligence, and Reasoning'
  start_date: 2013-12-14
date_created: 2018-12-11T11:56:30Z
date_published: 2013-12-01T00:00:00Z
date_updated: 2020-08-11T10:09:42Z
day: '01'
department:
- _id: KrCh
doi: 10.1007/978-3-642-45221-5_17
ec_funded: 1
fulldoi: https://doi.org/10.1007/978-3-642-45221-5_17
intvolume: '      8312'
language:
- iso: eng
month: '12'
oa_version: None
page: 228 - 242
project:
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
publication_status: published
publisher: Springer
publist_id: '4723'
quality_controlled: '1'
scopus_import: 1
series_title: Lecture Notes in Computer Science
status: public
title: Multi-objective discounted reward verification in graphs and MDPs
type: conference
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 8312
year: '2013'
...
---
_id: '2279'
abstract:
- lang: eng
  text: We consider two-player games played on weighted directed graphs with mean-payoff
    and total-payoff objectives, two classical quantitative objectives. While for
    single-dimensional games the complexity and memory bounds for both objectives
    coincide, we show that in contrast to multi-dimensional mean-payoff games that
    are known to be coNP-complete, multi-dimensional total-payoff games are undecidable.
    We introduce conservative approximations of these objectives, where the payoff
    is considered over a local finite window sliding along a play, instead of the
    whole play. For single dimension, we show that (i) if the window size is polynomial,
    deciding the winner takes polynomial time, and (ii) the existence of a bounded
    window can be decided in NP ∩ coNP, and is at least as hard as solving mean-payoff
    games. For multiple dimensions, we show that (i) the problem with fixed window
    size is EXPTIME-complete, and (ii) there is no primitive-recursive algorithm to
    decide the existence of a bounded window.
acknowledgement: 279307; ERC; Fonds National de la Reserche Luxembourg;  279499; ERC;
  Fonds National de la Reserche Luxembourg
alternative_title:
- LNCS
article_processing_charge: No
arxiv: 1
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Laurent
  full_name: Doyen, Laurent
  last_name: Doyen
- first_name: Mickael
  full_name: Randour, Mickael
  last_name: Randour
- first_name: Jean
  full_name: Raskin, Jean
  last_name: Raskin
citation:
  ama: Chatterjee K, Doyen L, Randour M, Raskin J. Looking at mean-payoff and total-payoff
    through windows. 2013;8172:118-132. doi:<a href="https://doi.org/10.1007/978-3-319-02444-8_10">10.1007/978-3-319-02444-8_10</a>
  apa: 'Chatterjee, K., Doyen, L., Randour, M., &#38; Raskin, J. (2013). Looking at
    mean-payoff and total-payoff through windows. Presented at the ATVA: Automated
    Technology for Verification and Analysis, Hanoi, Vietnam: Springer. <a href="https://doi.org/10.1007/978-3-319-02444-8_10">https://doi.org/10.1007/978-3-319-02444-8_10</a>'
  chicago: Chatterjee, Krishnendu, Laurent Doyen, Mickael Randour, and Jean Raskin.
    “Looking at Mean-Payoff and Total-Payoff through Windows.” Lecture Notes in Computer
    Science. Springer, 2013. <a href="https://doi.org/10.1007/978-3-319-02444-8_10">https://doi.org/10.1007/978-3-319-02444-8_10</a>.
  ieee: K. Chatterjee, L. Doyen, M. Randour, and J. Raskin, “Looking at mean-payoff
    and total-payoff through windows,” vol. 8172. Springer, pp. 118–132, 2013.
  ista: Chatterjee K, Doyen L, Randour M, Raskin J. 2013. Looking at mean-payoff and
    total-payoff through windows. 8172, 118–132.
  mla: Chatterjee, Krishnendu, et al. <i>Looking at Mean-Payoff and Total-Payoff through
    Windows</i>. Vol. 8172, Springer, 2013, pp. 118–32, doi:<a href="https://doi.org/10.1007/978-3-319-02444-8_10">10.1007/978-3-319-02444-8_10</a>.
  short: K. Chatterjee, L. Doyen, M. Randour, J. Raskin, 8172 (2013) 118–132.
conference:
  end_date: 2013-10-18
  location: Hanoi, Vietnam
  name: 'ATVA: Automated Technology for Verification and Analysis'
  start_date: 2013-10-15
date_created: 2018-12-11T11:56:44Z
date_published: 2013-01-01T00:00:00Z
date_updated: 2025-09-23T09:29:54Z
day: '01'
department:
- _id: KrCh
doi: 10.1007/978-3-319-02444-8_10
ec_funded: 1
external_id:
  arxiv:
  - '1302.4248'
fulldoi: https://doi.org/10.1007/978-3-319-02444-8_10
intvolume: '      8172'
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: http://arxiv.org/abs/1302.4248
month: '01'
oa: 1
oa_version: Preprint
page: 118 - 132
project:
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
publication_status: published
publisher: Springer
publist_id: '4656'
quality_controlled: '1'
related_material:
  record:
  - id: '523'
    relation: later_version
    status: public
scopus_import: '1'
series_title: Lecture Notes in Computer Science
status: public
title: Looking at mean-payoff and total-payoff through windows
type: conference
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 8172
year: '2013'
...
---
_id: '2292'
abstract:
- lang: eng
  text: This book constitutes the thoroughly refereed conference proceedings of the
    38th International Symposium on Mathematical Foundations of Computer Science,
    MFCS 2013, held in Klosterneuburg, Austria, in August 2013. The 67 revised full
    papers presented together with six invited talks were carefully selected from
    191 submissions. Topics covered include algorithmic game theory, algorithmic learning
    theory, algorithms and data structures, automata, formal languages, bioinformatics,
    complexity, computational geometry, computer-assisted reasoning, concurrency theory,
    databases and knowledge-based systems, foundations of computing, logic in computer
    science, models of computation, semantics and verification of programs, and theoretical
    issues in artificial intelligence.
alternative_title:
- LNCS
citation:
  ama: Chatterjee K, Sgall J, eds. <i>Mathematical Foundations of Computer Science
    2013</i>. Vol 8087. Springer; 2013:VI-854. doi:<a href="https://doi.org/10.1007/978-3-642-40313-2">10.1007/978-3-642-40313-2</a>
  apa: 'Chatterjee, K., &#38; Sgall, J. (Eds.). (2013). <i>Mathematical Foundations
    of Computer Science 2013</i> (Vol. 8087, p. VI-854). Presented at the MFCS: Mathematical
    Foundations of Computer Science, Klosterneuburg, Austria: Springer. <a href="https://doi.org/10.1007/978-3-642-40313-2">https://doi.org/10.1007/978-3-642-40313-2</a>'
  chicago: Chatterjee, Krishnendu, and Jiri Sgall, eds. <i>Mathematical Foundations
    of Computer Science 2013</i>. Vol. 8087. Lecture Notes in Computer Science. Springer,
    2013. <a href="https://doi.org/10.1007/978-3-642-40313-2">https://doi.org/10.1007/978-3-642-40313-2</a>.
  ieee: K. Chatterjee and J. Sgall, Eds., <i>Mathematical Foundations of Computer
    Science 2013</i>, vol. 8087. Springer, 2013, p. VI-854.
  ista: Chatterjee K, Sgall J eds. 2013. Mathematical Foundations of Computer Science
    2013, Springer,p.
  mla: Chatterjee, Krishnendu, and Jiri Sgall, editors. <i>Mathematical Foundations
    of Computer Science 2013</i>. Vol. 8087, Springer, 2013, p. VI-854, doi:<a href="https://doi.org/10.1007/978-3-642-40313-2">10.1007/978-3-642-40313-2</a>.
  short: K. Chatterjee, J. Sgall, eds., Mathematical Foundations of Computer Science
    2013, Springer, 2013.
conference:
  end_date: 2013-08-30
  location: Klosterneuburg, Austria
  name: 'MFCS: Mathematical Foundations of Computer Science'
  start_date: 2013-08-26
date_created: 2018-12-11T11:56:48Z
date_published: 2013-08-08T00:00:00Z
date_updated: 2020-08-11T10:09:45Z
day: '08'
department:
- _id: KrCh
doi: 10.1007/978-3-642-40313-2
editor:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Jiri
  full_name: Sgall, Jiri
  last_name: Sgall
fulldoi: https://doi.org/10.1007/978-3-642-40313-2
intvolume: '      8087'
language:
- iso: eng
month: '08'
oa_version: None
page: VI - 854
publication_identifier:
  isbn:
  - 978-3-642-40312-5
publication_status: published
publisher: Springer
publist_id: '4636'
quality_controlled: '1'
scopus_import: 1
series_title: Lecture Notes in Computer Science
status: public
title: Mathematical Foundations of Computer Science 2013
type: conference_editor
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 8087
year: '2013'
...
---
_id: '2295'
abstract:
- lang: eng
  text: We consider partially observable Markov decision processes (POMDPs) with ω-regular
    conditions specified as parity objectives. The qualitative analysis problem given
    a POMDP and a parity objective asks whether there is a strategy to ensure that
    the objective is satisfied with probability 1 (resp. positive probability). While
    the qualitative analysis problems are known to be undecidable even for very special
    cases of parity objectives, we establish decidability (with optimal EXPTIME-complete
    complexity) of the qualitative analysis problems for POMDPs with all parity objectives
    under finite-memory strategies. We also establish asymptotically optimal (exponential)
    memory bounds.
alternative_title:
- LIPIcs
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Martin
  full_name: Chmelik, Martin
  id: 3624234E-F248-11E8-B48F-1D18A9856A87
  last_name: Chmelik
- first_name: Mathieu
  full_name: Tracol, Mathieu
  id: 3F54FA38-F248-11E8-B48F-1D18A9856A87
  last_name: Tracol
citation:
  ama: Chatterjee K, Chmelik M, Tracol M. What is decidable about partially observable
    Markov decision processes with omega-regular objectives. 2013;23:165-180. doi:<a
    href="https://doi.org/10.4230/LIPIcs.CSL.2013.165">10.4230/LIPIcs.CSL.2013.165</a>
  apa: 'Chatterjee, K., Chmelik, M., &#38; Tracol, M. (2013). What is decidable about
    partially observable Markov decision processes with omega-regular objectives.
    Presented at the CSL: Computer Science Logic, Torino, Italy: Schloss Dagstuhl
    - Leibniz-Zentrum für Informatik. <a href="https://doi.org/10.4230/LIPIcs.CSL.2013.165">https://doi.org/10.4230/LIPIcs.CSL.2013.165</a>'
  chicago: Chatterjee, Krishnendu, Martin Chmelik, and Mathieu Tracol. “What Is Decidable
    about Partially Observable Markov Decision Processes with Omega-Regular Objectives.”
    Leibniz International Proceedings in Informatics. Schloss Dagstuhl - Leibniz-Zentrum
    für Informatik, 2013. <a href="https://doi.org/10.4230/LIPIcs.CSL.2013.165">https://doi.org/10.4230/LIPIcs.CSL.2013.165</a>.
  ieee: K. Chatterjee, M. Chmelik, and M. Tracol, “What is decidable about partially
    observable Markov decision processes with omega-regular objectives,” vol. 23.
    Schloss Dagstuhl - Leibniz-Zentrum für Informatik, pp. 165–180, 2013.
  ista: Chatterjee K, Chmelik M, Tracol M. 2013. What is decidable about partially
    observable Markov decision processes with omega-regular objectives. 23, 165–180.
  mla: Chatterjee, Krishnendu, et al. <i>What Is Decidable about Partially Observable
    Markov Decision Processes with Omega-Regular Objectives</i>. Vol. 23, Schloss
    Dagstuhl - Leibniz-Zentrum für Informatik, 2013, pp. 165–80, doi:<a href="https://doi.org/10.4230/LIPIcs.CSL.2013.165">10.4230/LIPIcs.CSL.2013.165</a>.
  short: K. Chatterjee, M. Chmelik, M. Tracol, 23 (2013) 165–180.
conference:
  end_date: 2013-09-05
  location: Torino, Italy
  name: 'CSL: Computer Science Logic'
  start_date: 2013-09-02
date_created: 2018-12-11T11:56:50Z
date_published: 2013-08-27T00:00:00Z
date_updated: 2025-09-18T11:38:38Z
day: '27'
ddc:
- '000'
department:
- _id: KrCh
doi: 10.4230/LIPIcs.CSL.2013.165
ec_funded: 1
file:
- access_level: open_access
  checksum: ba2828322955574d9283bea0e17a37a6
  content_type: application/pdf
  creator: system
  date_created: 2018-12-12T10:09:42Z
  date_updated: 2020-07-14T12:45:37Z
  file_id: '4766'
  file_name: IST-2017-756-v1+1_2.pdf
  file_size: 345171
  relation: main_file
file_date_updated: 2020-07-14T12:45:37Z
fulldoi: https://doi.org/10.4230/LIPIcs.CSL.2013.165
has_accepted_license: '1'
intvolume: '        23'
language:
- iso: eng
month: '08'
oa: 1
oa_version: Published Version
page: 165 - 180
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication_status: published
publisher: Schloss Dagstuhl - Leibniz-Zentrum für Informatik
publist_id: '4633'
pubrep_id: '756'
quality_controlled: '1'
related_material:
  record:
  - id: '5400'
    relation: earlier_version
    status: public
  - id: '1477'
    relation: later_version
    status: public
scopus_import: 1
series_title: Leibniz International Proceedings in Informatics
status: public
title: What is decidable about partially observable Markov decision processes with
  omega-regular objectives
tmp:
  image: /images/cc_by.png
  legal_code_url: https://creativecommons.org/licenses/by/4.0/legalcode
  name: Creative Commons Attribution 4.0 International Public License (CC-BY 4.0)
  short: CC BY (4.0)
type: conference
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 23
year: '2013'
...
---
_id: '2299'
abstract:
- lang: eng
  text: 'The standard hardware design flow involves: (a) design of an integrated circuit
    using a hardware description language, (b) extensive functional and formal verification,
    and (c) logical synthesis. However, the above-mentioned processes consume significant
    effort and time. An alternative approach is to use a formal specification language
    as a high-level hardware description language and synthesize hardware from formal
    specifications. Our work is a case study of the synthesis of the widely and industrially
    used AMBA AHB protocol from formal specifications. Bloem et al. presented the
    first formal specifications for the AMBA AHB Arbiter and synthesized the AHB Arbiter
    circuit. However, in the first formal specification some important assumptions
    were missing. Our contributions are as follows: (a) We present detailed formal
    specifications for the AHB Arbiter incorporating the missing details, and obtain
    significant improvements in the synthesis results (both with respect to the number
    of gates in the synthesized circuit and with respect to the time taken to synthesize
    the circuit), and (b) we present formal specifications to generate compact circuits
    for the remaining two main components of AMBA AHB, namely, AHB Master and AHB
    Slave. Thus with systematic description we are able to automatically and completely
    synthesize an important and widely used industrial protocol.'
author:
- first_name: Yashdeep
  full_name: Godhal, Yashdeep
  id: 5B547124-EB61-11E9-8887-89D9C04DBDF5
  last_name: Godhal
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Thomas A
  full_name: Henzinger, Thomas A
  id: 40876CD8-F248-11E8-B48F-1D18A9856A87
  last_name: Henzinger
  orcid: 0000−0002−2985−7724
citation:
  ama: 'Godhal Y, Chatterjee K, Henzinger TA. Synthesis of AMBA AHB from formal specification:
    A case study. <i>International Journal on Software Tools for Technology Transfer</i>.
    2013;15(5-6):585-601. doi:<a href="https://doi.org/10.1007/s10009-011-0207-9">10.1007/s10009-011-0207-9</a>'
  apa: 'Godhal, Y., Chatterjee, K., &#38; Henzinger, T. A. (2013). Synthesis of AMBA
    AHB from formal specification: A case study. <i>International Journal on Software
    Tools for Technology Transfer</i>. Springer. <a href="https://doi.org/10.1007/s10009-011-0207-9">https://doi.org/10.1007/s10009-011-0207-9</a>'
  chicago: 'Godhal, Yashdeep, Krishnendu Chatterjee, and Thomas A Henzinger. “Synthesis
    of AMBA AHB from Formal Specification: A Case Study.” <i>International Journal
    on Software Tools for Technology Transfer</i>. Springer, 2013. <a href="https://doi.org/10.1007/s10009-011-0207-9">https://doi.org/10.1007/s10009-011-0207-9</a>.'
  ieee: 'Y. Godhal, K. Chatterjee, and T. A. Henzinger, “Synthesis of AMBA AHB from
    formal specification: A case study,” <i>International Journal on Software Tools
    for Technology Transfer</i>, vol. 15, no. 5–6. Springer, pp. 585–601, 2013.'
  ista: 'Godhal Y, Chatterjee K, Henzinger TA. 2013. Synthesis of AMBA AHB from formal
    specification: A case study. International Journal on Software Tools for Technology
    Transfer. 15(5–6), 585–601.'
  mla: 'Godhal, Yashdeep, et al. “Synthesis of AMBA AHB from Formal Specification:
    A Case Study.” <i>International Journal on Software Tools for Technology Transfer</i>,
    vol. 15, no. 5–6, Springer, 2013, pp. 585–601, doi:<a href="https://doi.org/10.1007/s10009-011-0207-9">10.1007/s10009-011-0207-9</a>.'
  short: Y. Godhal, K. Chatterjee, T.A. Henzinger, International Journal on Software
    Tools for Technology Transfer 15 (2013) 585–601.
corr_author: '1'
date_created: 2018-12-11T11:56:51Z
date_published: 2013-10-01T00:00:00Z
date_updated: 2024-10-09T20:55:16Z
day: '01'
ddc:
- '000'
department:
- _id: KrCh
- _id: ToHe
doi: 10.1007/s10009-011-0207-9
file:
- access_level: open_access
  checksum: 57b06a732dd8d6349190dba6b5b0d33b
  content_type: application/pdf
  creator: system
  date_created: 2018-12-12T10:11:53Z
  date_updated: 2020-07-14T12:45:37Z
  file_id: '4910'
  file_name: IST-2012-87-v1+1_Synthesis_of_AMBA_AHB_from_formal_specifications-_A_case_study.pdf
  file_size: 277372
  relation: main_file
file_date_updated: 2020-07-14T12:45:37Z
fulldoi: https://doi.org/10.1007/s10009-011-0207-9
has_accepted_license: '1'
intvolume: '        15'
issue: 5-6
language:
- iso: eng
month: '10'
oa: 1
oa_version: Submitted Version
page: 585 - 601
project:
- _id: 25832EC2-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S 11407_N23
  name: Rigorous Systems Engineering
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: International Journal on Software Tools for Technology Transfer
publication_status: published
publisher: Springer
publist_id: '4629'
pubrep_id: '87'
quality_controlled: '1'
scopus_import: 1
status: public
title: 'Synthesis of AMBA AHB from formal specification: A case study'
type: journal_article
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 15
year: '2013'
...
---
_id: '2305'
abstract:
- lang: eng
  text: We study the complexity of central controller synthesis problems for finite-state
    Markov decision processes, where the objective is to optimize both the expected
    mean-payoff performance of the system and its stability. e argue that the basic
    theoretical notion of expressing the stability in terms of the variance of the
    mean-payoff (called global variance in our paper) is not always sufficient, since
    it ignores possible instabilities on respective runs. For this reason we propose
    alernative definitions of stability, which we call local and hybrid variance,
    and which express how rewards on each run deviate from the run's own mean-payoff
    and from the expected mean-payoff, respectively. We show that a strategy ensuring
    both the expected mean-payoff and the variance below given bounds requires randomization
    and memory, under all the above semantics of variance. We then look at the problem
    of determining whether there is a such a strategy. For the global variance, we
    show that the problem is in PSPACE, and that the answer can be approximated in
    pseudo-polynomial time. For the hybrid variance, the analogous decision problem
    is in NP, and a polynomial-time approximating algorithm also exists. For local
    variance, we show that the decision problem is in NP. Since the overall performance
    can be traded for stability (and vice versa), we also present algorithms for approximating
    the associated Pareto curve in all the three cases. Finally, we study a special
    case of the decision problems, where we require a given expected mean-payoff together
    with zero variance. Here we show that the problems can be all solved in polynomial
    time.
article_processing_charge: No
arxiv: 1
author:
- first_name: Tomáš
  full_name: Brázdil, Tomáš
  last_name: Brázdil
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Vojtěch
  full_name: Forejt, Vojtěch
  last_name: Forejt
- first_name: Antonín
  full_name: Kučera, Antonín
  last_name: Kučera
citation:
  ama: 'Brázdil T, Chatterjee K, Forejt V, Kučera A. Trading performance for stability
    in Markov decision processes. In: <i>28th Annual ACM/IEEE Symposium</i>. IEEE;
    2013:331-340. doi:<a href="https://doi.org/10.1109/LICS.2013.39">10.1109/LICS.2013.39</a>'
  apa: 'Brázdil, T., Chatterjee, K., Forejt, V., &#38; Kučera, A. (2013). Trading
    performance for stability in Markov decision processes. In <i>28th Annual ACM/IEEE
    Symposium</i> (pp. 331–340). New Orleans, LA, United States: IEEE. <a href="https://doi.org/10.1109/LICS.2013.39">https://doi.org/10.1109/LICS.2013.39</a>'
  chicago: Brázdil, Tomáš, Krishnendu Chatterjee, Vojtěch Forejt, and Antonín Kučera.
    “Trading Performance for Stability in Markov Decision Processes.” In <i>28th Annual
    ACM/IEEE Symposium</i>, 331–40. IEEE, 2013. <a href="https://doi.org/10.1109/LICS.2013.39">https://doi.org/10.1109/LICS.2013.39</a>.
  ieee: T. Brázdil, K. Chatterjee, V. Forejt, and A. Kučera, “Trading performance
    for stability in Markov decision processes,” in <i>28th Annual ACM/IEEE Symposium</i>,
    New Orleans, LA, United States, 2013, pp. 331–340.
  ista: 'Brázdil T, Chatterjee K, Forejt V, Kučera A. 2013. Trading performance for
    stability in Markov decision processes. 28th Annual ACM/IEEE Symposium. LICS:
    Logic in Computer Science, 331–340.'
  mla: Brázdil, Tomáš, et al. “Trading Performance for Stability in Markov Decision
    Processes.” <i>28th Annual ACM/IEEE Symposium</i>, IEEE, 2013, pp. 331–40, doi:<a
    href="https://doi.org/10.1109/LICS.2013.39">10.1109/LICS.2013.39</a>.
  short: T. Brázdil, K. Chatterjee, V. Forejt, A. Kučera, in:, 28th Annual ACM/IEEE
    Symposium, IEEE, 2013, pp. 331–340.
conference:
  end_date: 2013-06-28
  location: New Orleans, LA, United States
  name: 'LICS: Logic in Computer Science'
  start_date: 2013-06-25
date_created: 2018-12-11T11:56:53Z
date_published: 2013-08-01T00:00:00Z
date_updated: 2025-09-29T14:16:57Z
day: '01'
department:
- _id: KrCh
doi: 10.1109/LICS.2013.39
ec_funded: 1
external_id:
  arxiv:
  - '1305.4103'
  isi:
  - '000326815000038'
fulldoi: https://doi.org/10.1109/LICS.2013.39
isi: 1
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: http://arxiv.org/abs/1305.4103
month: '08'
oa: 1
oa_version: Preprint
page: 331 - 340
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication: 28th Annual ACM/IEEE Symposium
publication_status: published
publisher: IEEE
publist_id: '4622'
quality_controlled: '1'
related_material:
  record:
  - id: '1294'
    relation: later_version
    status: public
scopus_import: '1'
status: public
title: Trading performance for stability in Markov decision processes
type: conference
user_id: 317138e5-6ab7-11ef-aa6d-ffef3953e345
year: '2013'
...
---
_id: '2329'
abstract:
- lang: eng
  text: 'Two-player games on graphs are central in many problems in formal verification
    and program analysis such as synthesis and verification of open systems. In this
    work, we consider both finite-state game graphs, and recursive game graphs (or
    pushdown game graphs) that model the control flow of sequential programs with
    recursion. The objectives we study are multidimensional mean-payoff objectives,
    where the goal of player 1 is to ensure that the mean-payoff is non-negative in
    all dimensions. In pushdown games two types of strategies are relevant: (1) global
    strategies, that depend on the entire global history; and (2) modular strategies,
    that have only local memory and thus do not depend on the context of invocation.
    Our main contributions are as follows: (1) We show that finite-state multidimensional
    mean-payoff games can be solved in polynomial time if the number of dimensions
    and the maximal absolute value of the weights are fixed; whereas if the number
    of dimensions is arbitrary, then the problem is known to be coNP-complete. (2)
    We show that pushdown graphs with multidimensional mean-payoff objectives can
    be solved in polynomial time. For both (1) and (2) our algorithms are based on
    hyperplane separation technique. (3) For pushdown games under global strategies
    both one and multidimensional mean-payoff objectives problems are known to be
    undecidable, and we show that under modular strategies the multidimensional problem
    is also undecidable; under modular strategies the one-dimensional problem is NP-complete.
    We show that if the number of modules, the number of exits, and the maximal absolute
    value of the weights are fixed, then pushdown games under modular strategies with
    one-dimensional mean-payoff objectives can be solved in polynomial time, and if
    either the number of exits or the number of modules is unbounded, then the problem
    is NP-hard. (4) Finally we show that a fixed parameter tractable algorithm for
    finite-state multidimensional mean-payoff games or pushdown games under modular
    strategies with one-dimensional mean-payoff objectives would imply the fixed parameter
    tractability of parity games.'
alternative_title:
- LNCS
arxiv: 1
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Yaron
  full_name: Velner, Yaron
  last_name: Velner
citation:
  ama: Chatterjee K, Velner Y. Hyperplane separation technique for multidimensional
    mean-payoff games. 2013;8052:500-515. doi:<a href="https://doi.org/10.1007/978-3-642-40184-8_35">10.1007/978-3-642-40184-8_35</a>
  apa: 'Chatterjee, K., &#38; Velner, Y. (2013). Hyperplane separation technique for
    multidimensional mean-payoff games. Presented at the CONCUR: Concurrency Theory,
    Buenos Aires, Argentinia: Springer. <a href="https://doi.org/10.1007/978-3-642-40184-8_35">https://doi.org/10.1007/978-3-642-40184-8_35</a>'
  chicago: Chatterjee, Krishnendu, and Yaron Velner. “Hyperplane Separation Technique
    for Multidimensional Mean-Payoff Games.” Lecture Notes in Computer Science. Springer,
    2013. <a href="https://doi.org/10.1007/978-3-642-40184-8_35">https://doi.org/10.1007/978-3-642-40184-8_35</a>.
  ieee: K. Chatterjee and Y. Velner, “Hyperplane separation technique for multidimensional
    mean-payoff games,” vol. 8052. Springer, pp. 500–515, 2013.
  ista: Chatterjee K, Velner Y. 2013. Hyperplane separation technique for multidimensional
    mean-payoff games. 8052, 500–515.
  mla: Chatterjee, Krishnendu, and Yaron Velner. <i>Hyperplane Separation Technique
    for Multidimensional Mean-Payoff Games</i>. Vol. 8052, Springer, 2013, pp. 500–15,
    doi:<a href="https://doi.org/10.1007/978-3-642-40184-8_35">10.1007/978-3-642-40184-8_35</a>.
  short: K. Chatterjee, Y. Velner, 8052 (2013) 500–515.
conference:
  end_date: 2013-08-30
  location: Buenos Aires, Argentinia
  name: 'CONCUR: Concurrency Theory'
  start_date: 2013-08-27
date_created: 2018-12-11T11:57:01Z
date_published: 2013-08-01T00:00:00Z
date_updated: 2025-09-10T11:00:30Z
day: '01'
department:
- _id: KrCh
doi: 10.1007/978-3-642-40184-8_35
ec_funded: 1
external_id:
  arxiv:
  - '1210.3141'
fulldoi: https://doi.org/10.1007/978-3-642-40184-8_35
intvolume: '      8052'
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: http://arxiv.org/abs/1210.3141
month: '08'
oa: 1
oa_version: Preprint
page: 500 - 515
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication_status: published
publisher: Springer
publist_id: '4597'
quality_controlled: '1'
related_material:
  record:
  - id: '717'
    relation: later_version
    status: public
scopus_import: 1
series_title: Lecture Notes in Computer Science
status: public
title: Hyperplane separation technique for multidimensional mean-payoff games
type: conference
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 8052
year: '2013'
...
---
_id: '2444'
abstract:
- lang: eng
  text: 'We consider two core algorithmic problems for probabilistic verification:
    the maximal end-component decomposition and the almost-sure reachability set computation
    for Markov decision processes (MDPs). For MDPs with treewidth k, we present two
    improved static algorithms for both the problems that run in time O(n·k 2.38·2k
    ) and O(m·logn· k), respectively, where n is the number of states and m is the
    number of edges, significantly improving the previous known O(n·k·√n· k) bound
    for low treewidth. We also present decremental algorithms for both problems for
    MDPs with constant treewidth that run in amortized logarithmic time, which is
    a huge improvement over the previously known algorithms that require amortized
    linear time.'
alternative_title:
- LNCS
arxiv: 1
author:
- first_name: Krishnendu
  full_name: Chatterjee, Krishnendu
  id: 2E5DCA20-F248-11E8-B48F-1D18A9856A87
  last_name: Chatterjee
  orcid: 0000-0002-4561-241X
- first_name: Jakub
  full_name: Ła̧Cki, Jakub
  last_name: Ła̧Cki
citation:
  ama: Chatterjee K, Ła̧Cki J. Faster algorithms for Markov decision processes with
    low treewidth. 2013;8044:543-558. doi:<a href="https://doi.org/10.1007/978-3-642-39799-8_36">10.1007/978-3-642-39799-8_36</a>
  apa: 'Chatterjee, K., &#38; Ła̧Cki, J. (2013). Faster algorithms for Markov decision
    processes with low treewidth. Presented at the CAV: Computer Aided Verification,
    St. Petersburg, Russia: Springer. <a href="https://doi.org/10.1007/978-3-642-39799-8_36">https://doi.org/10.1007/978-3-642-39799-8_36</a>'
  chicago: Chatterjee, Krishnendu, and Jakub Ła̧Cki. “Faster Algorithms for Markov
    Decision Processes with Low Treewidth.” Lecture Notes in Computer Science. Springer,
    2013. <a href="https://doi.org/10.1007/978-3-642-39799-8_36">https://doi.org/10.1007/978-3-642-39799-8_36</a>.
  ieee: K. Chatterjee and J. Ła̧Cki, “Faster algorithms for Markov decision processes
    with low treewidth,” vol. 8044. Springer, pp. 543–558, 2013.
  ista: Chatterjee K, Ła̧Cki J. 2013. Faster algorithms for Markov decision processes
    with low treewidth. 8044, 543–558.
  mla: Chatterjee, Krishnendu, and Jakub Ła̧Cki. <i>Faster Algorithms for Markov Decision
    Processes with Low Treewidth</i>. Vol. 8044, Springer, 2013, pp. 543–58, doi:<a
    href="https://doi.org/10.1007/978-3-642-39799-8_36">10.1007/978-3-642-39799-8_36</a>.
  short: K. Chatterjee, J. Ła̧Cki, 8044 (2013) 543–558.
conference:
  end_date: 2013-07-19
  location: St. Petersburg, Russia
  name: 'CAV: Computer Aided Verification'
  start_date: 2013-07-13
date_created: 2018-12-11T11:57:42Z
date_published: 2013-07-01T00:00:00Z
date_updated: 2020-08-11T10:09:47Z
day: '01'
department:
- _id: KrCh
doi: 10.1007/978-3-642-39799-8_36
ec_funded: 1
external_id:
  arxiv:
  - '1304.0084'
fulldoi: https://doi.org/10.1007/978-3-642-39799-8_36
intvolume: '      8044'
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: http://arxiv.org/abs/1304.0084
month: '07'
oa: 1
oa_version: Preprint
page: 543 - 558
project:
- _id: 2584A770-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: P 23499-N23
  name: Modern Graph Algorithmic Techniques in Formal Verification
- _id: 25863FF4-B435-11E9-9278-68D0E5697425
  call_identifier: FWF
  grant_number: S11407
  name: Game Theory
- _id: 2581B60A-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '279307'
  name: 'Quantitative Graph Games: Theory and Applications'
- _id: 2587B514-B435-11E9-9278-68D0E5697425
  name: Microsoft Research Faculty Fellowship
publication_status: published
publisher: Springer
publist_id: '4459'
quality_controlled: '1'
scopus_import: 1
series_title: Lecture Notes in Computer Science
status: public
title: Faster algorithms for Markov decision processes with low treewidth
type: conference
user_id: 2DF688A6-F248-11E8-B48F-1D18A9856A87
volume: 8044
year: '2013'
...
