Ivor's early playing career took in amateur appearances for Finchley, Northfleet, Finchley again, Tottenham and Millwall, before he became the youngest player-manager ever at Carlisle United – in 1946 – at the tender age of 23.