Abstract: This paper proposed a method through a time domain Markov decision process as a countermeasure of random periodic impulse jamming for a user in a time slotted environment. First, the random periodic impulse jamming is modelled. Then the time domain MDP-based anti-jamming communication model is proposed and the optimal transition probability on each state is calculated. Finally, we proposed an online learning algorithm to approach the optimal transition probabilities. Simulation results show that our method is better than other countermeasures of impulse jamming.