Just pointing out that it was still dangerous enough for even Gandalf to be a bit worried and for them to be relieved to find shelter from it.

Occasionally it is described here as if the company were just watching them in the distance without concern, so it seemed worth plucking out that the company feeling in danger, in contrast, is a more straightforward interpretation.