Resampling techniques are used widely within the ERP community to assess statistical significance and especially in the deception detection literature. Here, we argue that because of statistical bias, bootstrap should not be used in combination with methods like peak-to-peak. Instead, permutation tests provide a more appropriate alternative.