A stochastic mean-payoff game is a mean-payoff game with additional chance vertices. At each such graph vertex, a prescribed discrete distribution selects the next outgoing graph edge.
Writing
for the reward of graph edge
, the value at a starting graph
vertex
is
where
and
range over the players' history-dependent strategies,
which may use private randomness. The expectation
value is taken after the pathwise infimum limit.