We study Riemannian or pseudo-Riemannian manifolds which admit a closed conformal vector field. Subject to the condition that at each point the set of conformal gradient vector fields spans a non-degenerate subspace of TpM, using a warped product structure theorem we give a complete description of the space of conformal vector fields on arbitrary non-Ricci flat Einstein spaces.