One can vote for or against a person or issue. One can vote “yes” or “no”, which are merely synonyms for “for” and “against”, in this context. But one does not vote “up” or “down”. The closest might be a group in an elevator, voting for or against going up. Or for or against going down.