If the " is shift-two then you need to set your keyboard to UK.
If the @ is shift-two, then you need to set it to US.
Once you've set it, uninstall the keyboard that you don't require, so that you can't accidentally change it.
Shame you forgot to mention which version of Windows.
In XP:
Control panel
Region and Language
Languages tab
Details button