Yup, should work. Find the IP address, and add the printer using the "Network" printer option in Windows.

I've always been unable to reach my old HP Laserjet 4plus on XP that is networked using the Network option.
Found I needed to use: Local printer attached to this computer -> Create a new port - Standard TCP/IP port.
Another dialog box comes up titled "Add Standard TCP/IP Printer Port Wizard" which indicates "You use this wizard to add a port for a network printer" - certainly goooooooooooooooooofy! ... but it IS Windows.