Being part of the European Union gives UK certain privileges like free travel. However, the EU holds superiority over its member states and joining the EU means you have to abide by their rules, which you cannot change. Rules likes immigration.