The loan is not allowed to be taken in the first place if there is interest attached on it.

But beacuse the loan has now been taken by previous governments any sincere Islamic leadership would not honour any contract which was haram either in its origin or in its content. In this case both apply.

It was haram to take the loan in the first place. It is haram to continue to pay interest and honour the haram contract.