hi CAJ, it's difficult to judge without knowing all the facts and you don't even know them yourself. you've every right to be angry with him, but would you maybe regret not exploring this in a few years time? is he going to be the only link to the rest of your family? it would never be a "normal" relationship considering the circumstances, but a lot of time has passed and maybe he has had one of those sobering "what the hell have I done?" moments.
I guess it's up to you whether you want to punish him for what he has done (no one would blame you for being angry and upset), or maybe explore how you can take it forward. I would never judge you, either way.. it's your choice but there's no rush. talk it through with your nearest and dearest, and lots of luck x