I would recommend a whole new system, with Windows XP if possible.
My only advice about a printer is to check how much the replacement cartridges are - they can be dearer than a whole new printer!
Decide how much you want to spend, but a PC magazine and read the reviews. Learn what is the 'normal' standard spec so you can tell if you are getting value for money.
There is no need to buy a high spec machine if you don't want to play high tech games, or do video editing.
A basic machine will suit you very well.