Here are a few nice markup validators. Let me know if you have any favorites/preferences.
Then again, a lot of tools provide support for this. Visual Studio is ok, but questionable - we'll see if it gets any better. I'm sure someone has probably built a plug-in to validate code from within VS.