Source at the Nitro City hotel where Bieber was staying this weekend confirm to PEOPLE that Usher did, in fact, join the singer, 19, and his friends on their getaway. The pair departed the hotel late Sunday afternoon, the source adds.

Whether Usher, 35, who discovered the pop star five years ago, is guiding Bieber through a difficult time after his recent legal troubles or simply joining him on a vacation to blow off steam, the twosome will certainly draw some major attention.

When Bieber first appeared in the small beach town of Punta Chame on Saturday witnesses said that fans – mostly girls – suddenly flocked to the area, making it difficult for Bieber to obtain any privacy.

Bieber was arrested in Miami Beach early Thursday for DUI and told police he had been smoking marijuana and taken prescription medication.