cs.LGmath.OC

Decentralized Bandit Learning of Markov Perfect Equilibria

📅 👥 2 authors arXiv:2610.14333v1

Authors

Abstract

We study decentralized bandit learning in discounted infinite-horizon, general-sum Markov games with continuous actions. Agents observe the public state, but only their own realized rewards, and use simultaneous perturbation stochastic approximation to update their actions. Under strong monotonicity of the negative running-reward gradients and sufficiently small time steps, we prove that the fully decentralized procedure converges almost surely to the unique stationary Markov perfect equilibrium. We obtain an $O(n^{-1/2})$ convergence rate and present a natural extension to episodic finite-horizon learning.

Paper Information

arXiv ID:
2610.14333v1
Published:

Related Categories

cs.LGmath.OC