So after a week-long delay (too many things came up at work and home to play), I've finally installed everything needed for XNA on a spare laptop. Ran into a minor glitch trying to run the Spacewar! demo that's included, and found an MSDN Forum entry which squared me away :)
So now I'm off to play!