We were first alerted when the guy at the taxi rank laughed and said "ah that's a brothel" when we said the name of our "hotel". We then got in the taxi and the driver (who hadn't heard the first conversation) reacted in exactly the same way.

A lot of people noted it in their Tripadvisor reviews. I wasn't responsible for booking it so hadn't looked into it before going....