So far the Bank of England has not detected any signs of workers from other EU countries packing their bags, but it has noticed a marked decline in the number of staff from across the continent moving into the UK.