A couple things. You may be able to redrill the holes and still have the new handle cover the old. If not, you can put a decorative escutcheon or a brass or stainless steel washer under the handle to cover the holes. Instead of a handle, use knobs.