WASHINGTON—The chief operating officer of the Federal Housing Finance Agency faces a felony charge after he allegedly made violent threats concerning the regulator's former director, according to a police report and court records.

Richard Hornsby, the agency's chief operating officer, was charged last Wednesday with one felony count of threatening to kidnap or injure a person, court records show. He was ordered to stay away from the...