aibu RE wearing shorts in a swimming pool

Twice I have been asked in our local leisure centre to remove my shorts when I've been spotted wearing them in the pool. The first time they 'let me off' because I was pregnant. The second time I had to take them off.

We're going swimming this weekend so aibu to wear them and refuse to take them off? Surely it's not that much of a hazard? Plenty of men wear shorts swimming. I asked the reasoning behind this policy and apparently it's incase they have to rescue you from the pool for whatever reason. I have sensitive skin and can't shave before going in chlorine or I get an awful rash and have been cursed with thick black pubic hair that grows onto the top of my thighs so really self conscious without shorts.

They are my partners men's swim shorts. They aren't long, halfway between the tops of thighs and top of knees. Never heard of swim dresses or legsuits. Will have a look and hopefully be able to get one before I go

Go on some triathlon sites; they will sell tri shorts which are really comfy, swimsuit fabric and cover everything down to just above knee if you fancy. I think Speedo do some plain swim shorts too. Just don't buy ones with a really bulky bike pad!