Modify Local DNS/DNS Spoof? How Best to Test Site Before Going Live?

I am moving from other hosting to Digital Ocean. I believe I've set everything up properly so I just need to change my A record for the domains and everything should be up and running. The issue is that I'd really like to test this! I'm on a Windows machine so I modified the hosts file. The issue is that since I'm using Wordpress it appears as though they rewrite the URL to add www. in front which is querying for the real address. Is there a workaround that people use to test things such as this? Thank you!