Tracking the Mean of a Piecewise Stationary Sequence
Fuente:
arXiv
Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911825723916288 |
|---|---|
| author | Ganesan, Ghurumuruhan |
| author_facet | Ganesan, Ghurumuruhan |
| contents | In this paper we study the problem of tracking the mean of a piecewise stationary sequence of independent random variables. First we consider the case where the transition times are known and show that a direct running average performs the tracking in short time and with high accuracy. We then use a single valued weighted running average with a tunable parameter for the case when transition times are unknown and establish deviation bounds for the tracking accuracy. Our result has applications in choosing the optimal rewards for the multiarmed bandit scenario. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_02266 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Tracking the Mean of a Piecewise Stationary Sequence Ganesan, Ghurumuruhan Probability In this paper we study the problem of tracking the mean of a piecewise stationary sequence of independent random variables. First we consider the case where the transition times are known and show that a direct running average performs the tracking in short time and with high accuracy. We then use a single valued weighted running average with a tunable parameter for the case when transition times are unknown and establish deviation bounds for the tracking accuracy. Our result has applications in choosing the optimal rewards for the multiarmed bandit scenario. |
| title | Tracking the Mean of a Piecewise Stationary Sequence |
| topic | Probability |
| url | https://arxiv.org/abs/2404.02266 |