off taste to refrigerator water

I have successfully used FF filter, but when installing new one, I had an off taste to the water. FF replaced the filter but still had the taste. I ordered the manufacturers filter and thought the off taste was gone, but now it's back. Any ideas as to what the problem may be? Water from the sink doesn't have this off taste.