thermostat

If you don't have a volt meter it's going to be tough to troubleshoot. Pics would help a lot. If you have two thermostats and one furnace, that "control box" sounds a lot like a zone panel. It's a part completely independent of the furnace.