In this paper, we consider a game theoretic approach to option valuation under Markovian regime-switching models, namely, a Markovian regime-switching geometric Brownian motion (GBM) and a Markovian regime-switching jump-diffusion model. In particular, we consider a stochastic differential game with two players, namely, the representative agent and the market. The representative agent has a power utility function and the market is a “fictitious” player of the game. We also explore and strengthen the connection between an equivalent martingale measure for option valuation selected by an equilibrium state of the stochastic differential game and that arising from a regime switching version of the Esscher transform. When the stock price process is governed by a Markovian regime-switching GBM, the pricing measures chosen by the two approaches coincide. When the stock price process is governed by a Markovian regime-switching jump-diffusion model, we identify the condition under which the pricing measures selected by the two approaches are identical.