How to delete unwanted host IP without bringing it up

i'm trying to create two node cluster with azure VMs.
during installation i used public IP which was dynamic. Now i'm not finding ways to delete that IP, as host should be up to be replaced or removed.