The shards from the bearings can get into the gears and other tight spaces bad things can happen. I would not delay much longer. The noise will go away and be replaced with crunching grinding noises....