Speaker/crossover location

Can you put a crossover right next to a speaker? Will the magnet interfere with the coil in the crossover? I'm putting the crossover in the door and the only place to secure it is right next to the speaker.