I decided to press the bearing back in, and make a little bracket to retain it. I'd hoped to be able to make a circular one, but the way the chuck backplate is welded to the shaft precluded this. In the end I made a little clip that bolts to the chassis upright - it should be serviceable in this application, but not if it was used (say) on a milling machine.