If I had to guess I'd say you're not getting the caps tight enough. When I get done bottling into plastic, I tighten as much as I can by hand, then take one of those grippers like you open a pickle jar with and give each cap a little more.