Down voting is a great way to discourage bad answers, but what if the original answer or question has been improved?
I believe providing a way to let the down-votes removable will highly encourage self-improving of answers and questions.
An idea after a quick discussion with @nohat:
How about letting poster owner have the ability to send out the notifications to down voters, and holding a limitation like 10 notifications per user per day?