The sim card is the thing that has the phone number. The handset is just a device you happen to use.
New sim card, new number.
However, it's pretty easy to keep your existing number if you want to; phone your current operator, get a PAC code from them, and then inform your new operator of this. Sadly, some operators require you request it in writing (O2 for one, I believe).