Salvato in:
Dettagli Bibliografici
Autori principali: Pal, Soumik, Mesikepp, Tim
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2510.14165
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909849696075776
author Pal, Soumik
Mesikepp, Tim
author_facet Pal, Soumik
Mesikepp, Tim
contents This is a free textbook suitable for a one-semester course on Markov chains, covering basics of finite-state chains, many classical models, asymptotic behavior and mixing times, Monte Carlo methods, and martingales and harmonic functions. It is designed to fill a gap in the literature by being suitable for undergraduates; much of the theory is thus built from the ground up, with only basic probability and linear algebra assumed. We take as our basic framework the first four chapters of the classic Levin-Peres text "Markov Chains and Mixing Times," generously expanding to make an exposition suitable for an undergraduate audience. We also incorporate over a hundred exercises and problems, along with a rich set of accompanying illustrations. Suggested homework sets are found in an appendix. Updated editions will periodically appear as new versions of this submission.
format Preprint
id arxiv_https___arxiv_org_abs_2510_14165
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Finite Markov chains and Monte-Carlo Methods: An Undergraduate Introduction
Pal, Soumik
Mesikepp, Tim
Probability
60-01, 60J10
This is a free textbook suitable for a one-semester course on Markov chains, covering basics of finite-state chains, many classical models, asymptotic behavior and mixing times, Monte Carlo methods, and martingales and harmonic functions. It is designed to fill a gap in the literature by being suitable for undergraduates; much of the theory is thus built from the ground up, with only basic probability and linear algebra assumed. We take as our basic framework the first four chapters of the classic Levin-Peres text "Markov Chains and Mixing Times," generously expanding to make an exposition suitable for an undergraduate audience. We also incorporate over a hundred exercises and problems, along with a rich set of accompanying illustrations. Suggested homework sets are found in an appendix. Updated editions will periodically appear as new versions of this submission.
title Finite Markov chains and Monte-Carlo Methods: An Undergraduate Introduction
topic Probability
60-01, 60J10
url https://arxiv.org/abs/2510.14165