Frustration usually means that there is an infinite degeneracy of the classical ground state. The random field effectively turns the system into that of a spin glass, where the interactions between spins will become effectively random. A spin glass has lots and lots of degenerate states, so I guess this is where the frustration comes in.