To make remote execution send stderr to stderr a major change has been implemented in remote execution. If you use GNU Parallel for remote execution (--sshlogin) then please test this alpha release.
...