A mistake

Ok i know that there are hardly any mistakes in the walking dead universe but in the new season of the walking dead tv series it has already been winter and they have been going from house to house to find a place to rest and find food and try and evade the herd and now they have found the prison.But at the season 2 finale the prison is just beside them so why did it take so long to find the safe haven.