Learning statistics requires learning the language of statistics. Statistics draws upon words from general English, mathematical English, discipline-specific English and words used primarily in statistics. This leads to many linguistic challenges in teaching statistics and the way in which the language is used in statistics creates an extra layer. This paper identifies many challenges in teaching statistics related to language and the use of language. Some implications for the effective learning and teaching of statistics are raised and methods to help students overcome these linguistic challenges are suggested.