So what that means is that a free trade agreement can have exceptions... but these can't be "the rule", they can't dominate the agreement.

I don't know enough about the Japan/EU FTA to say how much in the way of exceptions it has. Presumably since it was not challenged by [anyone at] the WTO (all FTAs of member need to be registered with them) it passes these tests.