The cb sets the interest rate and yields along are relative to the interest rate based on market expectations of future cb activity relative to changing economic conditions and price stability.

A high amount of government debt doesn't lead to inflation, in that deficits generally increase when the economy is not doing well, so a large deficit indicates poor economic conditions, i.e., nongovernment prefers to save rather than spend. That's deflationary rather than inflationary.