While this is old, here is another solution. Instead of leaving a column blank you could simply adjust the margins for a one column document. While this potentially has some undesired side effects, I found this straight forward for multipage documents. The settings below just give a bigger margin to one side for comments. Add the following in your preamble: