Its the anonyminity(wtf? spell?) of it that is so annoying.
I trade every bar of rep or point I'd ever get to look at my user cp and see all the people who've neg repped me anonymously. I don't care about green bars at all at all.