JOSEPH AND JOHN - HELP PLEASE!!

I believe that Joseph Monroe and John Monroe are brothers. In the 1860 census for De Pere, Brown Co. they are living next to each other. In the 1870 census they are both still in De Pere but living further apart. In 1870 Joseph's family is as follows: Wife Nancy, daughter Josephine 16, son Frank 18. John's family is: wife Jane, son John 11, daughters Elizabeth 10, Eliza 8. In 1880 John and family still in De Pere. Can't find Joseph, he probably died, did find Nancy living with daughter Josephine in Lewis Co.,NY who had married Peter Delmon and their children were Ann 3, and Edward 1 yr. And Frank is now living in Big Stone City, Dakota Territory. Does anyone know these families.???