Your unsure because your too busy worrying about what others think and worrying about it all going wrong. What about if it all goes right? You'll never know if you don't make that move. We've all made decisions that haven't gone our way, you just learn to dust yourself off and carry on. It isn't the end of the world if it doesn't work out, you can always get another job, but until you make that move you are going to carry on feeling this way.
I'm not saying that it will be easy if you move, you will need to work at it, things will seem hard at times and you may doubt that what you have done was right. One day you will have to move from your comfort zone at your parent's, why not make that now?