Just wear the silverhawk boots? Boo hoo you lose 2% farm xp...If you really care about a specific perk, like the traits from checking animals, you can just equip the boots while you do that and then switch back.

There is absolutely no logical connection between those two sets and no reason to combine them. Might as well just say allow Silverhawks in place of any XP-boosting set boots. I dont agree with that suggestion either however.

Basically anything you do you lose one benefit in order to gain another and since there's really no relation between them I don't really see a good reason for doing this. It would only make sense if they work with the nimble outfit, which they do.