Because talking about voting is somewhat annoying as it has nothing to do with the discussion at hand.

To expand on what themstheones said: upvotes and downvotes are for increasing the visibility of a comment in proportion to how it contributes to a good discussion. Downvotes aren't punishment.