I stumbled upon a presentation by Pressflow founder David Strauss with a nice checklist of common (open source) technologies and buzzwords for building highly scalable web applications. The slides focus on deployment and load/configuration management rather than software design considerations: Scalable LAMP infrastructure.