Put pieces of 4mm copper rivet into the holes and peen with a hammer, stretching outwards and staying put. Another possibility would be to screw in pieces of M5 thread, which has a core diameter of just about 4 mm and should fit nicely.