When one or more of the windows have one or few items, and the mouse cursor is pointing to this window and it is active, the scrolling take place on another window.
Try to play around with the hoovering system and you will see what i mean.