ISI officers were due in London for discussions on counter-terrorism co-operation with British security services. But the talks have been scrapped after the prime minister's remarks while on a visit to India on Wednesday, the Times reported.

"The visit has been cancelled in reaction to the comments made by the British prime minister against Pakistan," an ISI spokesman was quoted as saying. "Such irresponsible statements could affect our co-operation with Britain."

Cameron sparked outrage in Islamabad when he said: "We cannot tolerate in any sense the idea that this country is allowed to look both ways and is able, in any way, to promote the export of terror, whether to India, whether to Afghanistan, or to anywhere else in the world."

The comments were made during a visit to Delhi.

Neither Downing Street nor the Foreign Office would comment on the reported decision by the ISI, which also comes days before a UK visit by the Pakistani president Asif Ali Zardari. He is expected to stay with Cameron at his country retreat, Chequers.

Last night, officials said that Zardari's visit was still expected to take place. "Our understanding is that the visit is on," a Foreign Office spokeswoman said.

Following Cameron's remarks, Pakistani politicians pointed to the country's offensive against militants on the border with Afghanistan and the many victims of terrorist bombs in Pakistan.

Cameron defended his comments a day later, saying: "I don't think the British taxpayer wants me to go around the world saying what people want to hear."

Sign up for the Guardian Today

Our editors' picks for the day's top news and commentary delivered to your inbox each morning.