United Empire Loyalist statue and plaque in front of 50 Main Street East, Hamilton, Ontario, Canada. Photo by Saforrest on Wikimedia under CC BY-SA 3.0 license.

There are a number of men in the Jeffrey Ferris lineage who chose to remain loyal to England during the American Revolution. The facts are a bit difficult to winkle out because the families were less than pleased and kept some of the particulars from history. The names can be found, but they are so common in the lineage at the time that much more looking has to be done.
In addition, the other Ferris lineage also had a few Tories and that creates even more confusion.

Here is what I have at the moment:

Joseph Ferris (1746-1836) – Stamford, Ct.
This one is easy. The hometown folks tarred and feathered him. He actively fought with the British in Butler’s Rangers and he died in Canada. The link has more.

Solomon Ferris (1756-1820) – Greenwich, Ct.
The good folks of Connecticut were serious about this Tory. He was arrested, sentenced to death for treason, and eventually exchanged for some patriots being held by the British.

Joseph Ferris (1757-1841) – Peekskill, NY
Looking for more on this chap.

George Ferris (1767-1839) – Westchester County, NY
Listed as receiving a land grant in Canada as a United Empire Loyalist. He eventually returned to New York State. “George was the Tory (U.E. Loyalists) (along with Peter and Joshua) from Westchester NY” Found in the Ferris Family Tree – John page 1 (1.1.1.5)