If
a person dozes while listening to the Friday sermon, it is recommended
for him to change the place with the person next to him. In doing this
he should be careful not to speak; rather, he should use some gestures
(hand movements, etc.).

The evidence for this is the hadith narrated by Samrah who said:

The
Prophet (peace be upon him) said: If one of you dozes during the
Friday sermon, he should exchange his position with the person sitting
next to him.

(Al-Baihaqi, 3/238; Sahih Al-Jami‘ No. 812)

Another hadith has been narrated by Ibn ‘Umar who said:

The Prophet said: If one of you dozes in the mosque on Friday, he should move his position to another place.