Substantial penalty for early withdrawal of all Certificates of Deposit (CDs) except for some IRA CDs If you withdraw some of the funds before maturity, the interest rate for the remaining funds in your CD may be reduced to the current applicable CD rate.