The authors consider a cognitive radio network with multiple Primary Users (PUs) and one Secondary User (SU), where a spectrum server is utilized for scheduling the SU to transmit over one of the PU channels opportunistically. One practical yet challenging scenario is when both the PU occupancy and the channel fading vary over time and exhibit temporal correlations. Little work has been done for exploiting such temporal memory in the channel fading and the PU occupancy simultaneously for opportunistic spectrum scheduling. Further, the scenario where PU occupancy possesses a long temporal memory has been under explored as well.