WASHINGTON—The Internal Revenue Service is seeking bank records for U.S. taxpayers suspected of hiding accounts at a Caribbean lender, opening up a new front in efforts to combat offshore tax evasion.

The IRS said it is investigating whether taxpayers stashed money at Canadian Imperial Bank of Commerce's FirstCaribbean International Bank. Instead of pursuing foreign bank records directly, the IRS got court authorization to serve a...