Quantitative approximation of the invariant distribution of a Markov chain. A new approach - Institut de Recherche Mathématiques de Rennes
Pré-Publication, Document De Travail Année : 2023

Quantitative approximation of the invariant distribution of a Markov chain. A new approach

Résumé

In this paper, we deal with a Markov chain on a measurable state space $(\mathbb{X},\mathcal{X})$ which has a transition kernel $P$ admitting some small-set $S \in \mathcal{X}$, that is such that $P(x,A) \ge \nu(1_A) 1_S(x)$ for any $x \in \mathbb{X}$, $A \in \mathcal{X}$ and for some positive measure $\nu$. Under this condition, we propose a constructive characterisation of the existence of an $P$-invariant probability measure $\pi$ on $(\mathbb{X},\mathcal{X})$ such that $\pi(1_S)>0$. When such an $\pi$ exists, it is approximated in weighted or standard total variation norms by a finite linear combination of non-negative measures only depending on $\nu$, $P$ and $S$. Next, using standard drift-type conditions, we provide geometric/subgeometric convergence bounds of the approximation. Theses bounds are fully explicit and are as simple as possible. The rates of convergence are accurate, and they are optimal in the atomic case. Note that the rate of convergence for approximating the iterates of $P$ by the finite-rank submarkovian kernels introduced in [HerLedECP20] is also discussed. This is a new approach for approximating $\pi$ in the sense that it is not based on the convergence of the iterates of $P$ to $\pi$. Thus we need no aperiodicity condition. Moreover, the proofs are direct. They use neither the split chain in the non-atomic case, nor the renewal theory, nor the coupling method, nor the spectral theory. In some sense, this approach for Markov chains with a small-set is self-contained.
Fichier principal
Vignette du fichier
ApproPi-HAL_v5.pdf (603.71 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03605636 , version 1 (11-03-2022)
hal-03605636 , version 2 (28-04-2022)
hal-03605636 , version 3 (04-07-2022)
hal-03605636 , version 4 (08-07-2022)
hal-03605636 , version 5 (13-09-2022)
hal-03605636 , version 6 (31-01-2023)

Identifiants

  • HAL Id : hal-03605636 , version 6

Citer

Loïc Hervé, James Ledoux. Quantitative approximation of the invariant distribution of a Markov chain. A new approach. 2023. ⟨hal-03605636v6⟩
503 Consultations
168 Téléchargements

Partager

More