Two ways to get around this bug: approach portal very slowly from side and as soon as you can press A, hope that it lets you through, otherwise you have to run at the anvil from the opposite side of the portal and jump on top of the anvil and immediately press A, I get through every time when i do this. Still annoying though lol