2017
DOI: 10.1287/stsy.2017.0003
|View full text |Cite
|
Sign up to set email alerts
|

Detecting Markov Chain Instability: A Monte Carlo Approach

Abstract: Abstract. We devise a Monte Carlo based method for detecting whether a non-negative Markov chain is stable for a given set of parameter values. More precisely, for a given subset of the parameter space, we develop an algorithm that is capable of deciding whether the set has a subset of positive Lebesgue measure for which the Markov chain is unstable. The approach is based on a variant of simulated annealing, and consequently only mild assumptions are needed to obtain performance guarantees.The theoretical unde… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
4
0

Year Published

2020
2020
2024
2024

Publication Types

Select...
5
2

Relationship

1
6

Authors

Journals

citations
Cited by 8 publications
(4 citation statements)
references
References 28 publications
0
4
0
Order By: Relevance
“…To estimate optimal weights, we use an experimental design and heuristic adjustments as a calibration (finding the optimal weights for the model) following some principles discussed on Mandies et al [9].…”
Section: Resultsmentioning
confidence: 99%
“…To estimate optimal weights, we use an experimental design and heuristic adjustments as a calibration (finding the optimal weights for the model) following some principles discussed on Mandies et al [9].…”
Section: Resultsmentioning
confidence: 99%
“…[60], [61], [52], [34], [59], [99], [57], [84], [91] Queue Inference Engine Problems: This paradigm deals with a branch of problems where transactional observations are recorded and the trajectory of the queue within a given cycle is inferred.…”
Section: (F)mentioning
confidence: 99%
“…A different line of research that we would like to highlight here is the detection of stability or instability of queueing systems. To date not much work has been done towards this direction but one notable publication is [91] where the authors deal with Monte Carlo simulation of systems for detecting stability or instability.…”
Section: Inference With Queueing Fundamentalsmentioning
confidence: 99%
“…The main contribution of this chapter (published as [74]) concerned the development of an automated procedure that determines if, for a specified set of parameter values, a given Markov chain is unstable.…”
Section: Discussionmentioning
confidence: 99%