It can if oil is leaking onto the alternator. It will also damage the belt if the belt gets contaminated.
The inside of the timing case should be dry. If there is oil leaking out of the timing cover, there is most likely a leaking seal behind that cover that should also be addressed.