If/when we replace artifacts next expansion, will we be able to transmog our new weapons into them? All that work being put into leveling them up and not being able to use their appearance afterward would feel awful.

Can already answer that with, they will be replaced and yes They will be moggable.