Smart sampling for lightweight verification of Markov decision processes

TitleSmart sampling for lightweight verification of Markov decision processes
Publication TypeJournal Article
Year of Publication2015
AuthorsD'Argenio, PR, Legay, A, Sedwards, S, Traonouez, L-M
JournalInternational Journal on Software Tools for Technology Transfer
Volume17
Pagination469–484
AbstractMarkov decision processes (MDP) are useful to model optimisation problems in concurrent systems. To verify MDPs with efficient Monte Carlo techniques requires that their nondeterminism be resolved by a scheduler. Recent work has introduced the elements of lightweight techniques to sample directly from scheduler space, but finding optimal schedulers by simple sampling may be inefficient. Here we describe “smart” sampling algorithms that can make substantial improvements in performance.
URLhttp://dx.doi.org/10.1007/s10009-015-0383-0
DOI10.1007/s10009-015-0383-0
PDF (Full text): 
Powered by Drupal