There should be a pop-up on the site that ask you to potentially add a tag to your blacklist before you can click on the downvote option again. This is just a suggestion to fight spam downvoting that I have personally seen increasing since the beginning of the year.