Apparently I am wrong about that--it seems that Radagast's withdrawl from the world is only mentioned in Tolkien's letters, and of course the filmmakers don't have the rights to those. The last we hear about him in LotR is at Rivendell when scouts are sent to Rhosgobel looking for him, but he's not at home. So I guess the writers will have to make something up.