Playbacks are a useful tool for conducting well-controlled and replicated experiments on the effects of anthropogenic noise, particularly for repeated exposures. However, playbacks are unlikely to fully reproduce original sources of anthropogenic noise. Here we examined the sound pressure and particle acceleration of boat noise playbacks in a field experiment and reveal that although there remain recognized limitations, the signal-to-noise ratios of boat playbacks to ambient noise do not exceed those of a real boat. The experimental setup tested is therefore of value for use in experiments on the effects of repeated exposure of aquatic animals to boat noise.