If I respond to a review and don't change the review score it posts anyway

i.e.

I respond to a review (i'm the admin) and don't change the score, I'm simply interested in commenting, but when I post my comment my review score is still added and I can't edit it either.

Is there a way to fix this? So I don't have to score every GARS I read? I'm using 2.14. I have seen regular members respond without a score, so I don't know why it works the way it does for me, but not them.