The group’s name comes from the manner in which their songs were written, due to the fact that the two of them lived too far away to be able to work together in person. Tamborello would create beats and mail them to singer and lyricist Gibbard, who would then edit them and put his melodies over the tracks and mail them back. Gibbard didn’t write any of the lyrics until the tracks were completely finished.

In August 2003, the United States Postal Service sent the band a cease and desist letter, citing its trademark on the phrase “postal service”. After negotiations, the USPS relented, allowing the band use of the trademark in exchange for promotional efforts on behalf of the USPS and a performance at its annual National Executive Conference.