Short version: For a Voltage Controlled Voltage Amplifier, such as is typically used in audio, impedance matching is not desirable.

Technical version: With matched impedances, maximum power is transferred. With bridged impedances, minimal power is transferred. This is desirable, because we aren't interested in electrical power, we're interested in the shape of the voltage waveform.