NO!! Different words have different meanings. For example, if you
delete something, it's gone. If you remove something, you can later put
it back again.
You might substitute a fresh football player for a tired one, but you'd
replace a broken light bulb (answer, it only takes one Emacs hacker to
change a light bulb).
And so on.
There a few pairs of words indeed in English in which one means exactly
the same as the other. It is surely the same in other languages. Let us
strive, always, to use the most fitting word, and to preserve and retain
the fine control this gives us over our meanings.

That is nice. For some non native English speakers it would be good to
have a document describing those small differences.