Keltner played on recordings by members of The Beatles, after they disbanded. He and Ringo Starr played drums as a team during George Harrison's Concert for Bangladesh in 1971, and got along well. Keltner even played drums on some of Starr's solo records, and Starr was thought of as one of the best drummers in rock and roll music.

John Lennon counted on Keltner to play drums on his solo records, when Starr was not available. In 1973, he helped Lennon's wife Yoko Ono put a band together to record and tour with her.

Keltner toured the United States with George Harrison during 1974. He told Harrison he did not want to be paid to play on the tour. Harrison wanted to give him something for his work. Keltner was tired of driving his old car, so Harrison bought him a new Mercedes-Benz, as payment.

While Keltner had played for many artists and bands, he had never been a member of a band, until Little Village formed in the late 1980s.