I picked up on the comments that he doesn't feel like a good dad and wonder if this could be a very important statement. It is difficult because you don't say how old you are and people mature at different ages.
Little people aren't very good at telling you if you are good at being a mum or dad, but he should be able to tell if your other child is pleased to see him. One is very young for any real confirmation to an adult! Can you reassure him, by commenting on how your child smiles when he/she sees him or quietens down when he is cuddling them. Praise him for the little things he does.
He may just be scared because it has all happened so quickly, two babies in a short time. I am sure that he is not really wishing that he never met you! Be positive, which I know is difficult with hormones raging, but please try. He does have emotions, but just doesn't know how to show them.
Be strong and look forward to a happy future.