This didn't do it, but, it's giving me an idea about how to fix another issue I had with Samba where I was connected to my main computer and my main computer would shut off on me after a certain period.

Unless there are other suggestions, can someone tell me what steps to take to start from scratch without re-installing the OS. I remember when this worked and it was quite easy. So, I'd rather just restart from scratch if possible. I thought a purge and deleting my .ssh directory would do it. Is there anything else I need to do to make it seem like it's a brand new install?

The message is pretty clear, sshd refused the connection from localhost ::1 ipv6 address, have you changed the default /etc/hosts.deny and /etc/hosts.allow files content ?

OMG, I forgot about that! I didn't know about those files actually and learned about them and changed them one time when I was reading some article. I was only thinking that my firewall was disabled so nothing should be stopping my connection.