Sense deteriorated from "thin layer atop liquid" to "film of dirt," then just "dirt." Meaning "lowest class of humanity" is 1580s; scum of the Earth is from 1712. Adopted in Romanic, cf. Old French escume, Modern French écume, Spanish escuma, Italian schiuma.