early 12c., "religious recluse, one who dwells apart in a solitary place for religious meditation," from Old French hermit, ermit "hermit, recluse," from Late Latin eremita, from Greek eremites, literally "person of the desert," from eremia "desert, solitude," from eremos "uninhabited, empty, desolate, bereft," from PIE *ere- (2) "to separate" (cognates: Latin rete "net," Lithuanian retis "sieve"). The unhistorical h- first appeared in Medieval Latin heremite.

Transferred sense of "person living in solitude" is from 1799. Related: Hermitic; hermitical. The hermit crab (1735) is said to be so called for its seeking out and dwelling in a solitary cell.