As with other credit cards that are already accepted, the tax offices will charge a 2.5 percent convenience fee but also will still accept cash or check. In the past, Visa objected to the added-on fee, but that policy has changed and Randolph made in-house changes to allow customers to use Visa, an official there said.

"We believe that this will significantly reduce the need for customers to write checks, as well as save processing time for our office," Randolph said in a statement.