Men, eh! Does he find it difficult to express his emotions generally or is it just where your relationship's concerned? I'd say the best bet is to go with your gut-feeling. It's easy to give an opinion based on what you've said because no one would condone staying with an uncaring partner, but equally, no one knows what's going on in his mind either. If you genuinely love him, I hope you can work things out, though if he's not willing to open up it could become soul destroying. Could you maybe suggest some time apart and see how he reacts?