How much weight do you want/need to lose?
If you are quite overweight, I would suggest start walking instead of jogging, since it is less demanding on your joints.
And fast walking can be very demanding, too.
I am not talking about going for a walk!!!
In either case though, do buy good shoes.
I usually hold my keys in my hand, or put them into a little inside pocket in my pants.
I only take drinks when going for long runs (i.e. > 15 km), for that I have a special bag that I carry round my waist.
Other than that, some people find it easier to get into a routine when they have a partner.
It is harder to cancel runs, if somebody is waiting for you.
Have fun!