The Sheppards were formed in 1959 out of two earlier groups managed by Bill Sheppard, the Ballads and the Bel Aires. Members were Millard Edwards (lead and bass), Jimmy Allen (baritone), and James Dennis Isaac (bass and fifth tenor) from the Bel Aires; and Murrie Eskridge (lead and top tenor), O. C. Perkins (second tenor), and Kermit Chandler (Guitar) from the Ballads.

The Bel Aires first got together in 1957 calling themselves the Del Ricos and eventually joined producer Bill Shepard. He had been recording Chicago vocal groups since 1953 and found them two fine tunes and an excellent arrangement. He also secured the facilities of Decca, a major label, for the group whose name he had changed. The record initially did well but never really took off.