Are you really in love with the real him, or with the him you remember? You may need to take off the rose-colored glasses for a while and figure this out.
If you were meant to be together, wouldn't one of you have made it happen by now? You may be thinking of the man you wish he were, and not the man he is. You just haven't seen enough of him over the years to know who he is now. You were both free (albeit at different times), and yet did either of you contact the other to say you were interested in meeting?
It sounds like you need closure of some sort. Maybe that means contacting him. Maybe that means pouring out your heart into a letter that you keep just for you. But you can't move on without coming to some sort of decision as to whether or not you want to try to make him a part of your life.
Sure, if you're meant to be together, it will happen. (It happened to my voice teacher and her high school sweetheart 25 YEARS after graduation.) But will you make your destiny happen or just put your life on hold waiting for the gods - or him - to act? You may be afraid that he won't give you the answer you want, but at least you'll know. Who knows? Maybe he's thinking the same as you but doesn't know how you feel.
I'm not the cynic I may appear to be - I fell in love with my absolute soulmate on first sight, and in May we celebrated our 20th wedding anniversary. Soulmates and true love cannot be denied.