Without wanting to sound patronising you are still very young and the world is your oyster even though you're not 'fresh' out of school or uni or whatever. Take it from a 32 year old with lots of regrets, GO FOR IT. Do whatever you want to do to make YOU happy. Travelling is the best education in life you can get and can open up a world of opportunities. Okay so you may have to borrow and beg to get yourself around, but what an adventure!
There must be websites for people who want to travel alone, people in your area maybe who are in a similar situation who you can hook up with and get to know. But I know many people who have set off on their travels alone and met a wealth of people on their journeys. People that are now friends for life.
I wish I'd travelled, I wish I'd gone to uni but more than anything I wish I hadn't got bogged down with working and paying a mortgage so young. Yes I've got a nice house now, but I regret so much because I made all the excuses you have as to why I couldn't do what I really wanted to do. Basically I was a coward and took the EASY option (job/money/house). Although that isn't easy, but once you're in that circle it's hard to get out and before you know it you'll be 32 and advising a 23 year old what they should do!!
You have lots of time to settle down, get a career and a house and all that jazz. Looking back on my life so far, I've realized that I wasted the best opportunity of my life - living my twenties to the max.
I INSIST you live out your dream! And whilst you're living it, think of me stuck here at my boring 9-5 job!!
Please go for it and don't get caught up in the negatives, just do it, otherwise I promise you you'll regret it later.
GOOD LUCK!! x