It is difficult to answer this both sensitively and honestly, but I shall try, as I see it.
I am married, we have one daughter, and my wife is expecting again. I like this for many reasons, but the one which seems to relate to your situation is that they are part of my life, and I feel part of theirs.
I could never have lived with someone and felt any respect for them or myself. Other men I know see the living with a person as an extended date, sex included, with a very easy option to move on.
I think your bf - he is not a partner as partnership implies equallity and stability - is expressing a common view, and I agree with him. I also agree with froggequene that he is a complete *rse.
You are in an unhealthy relationship. That is your fault. The bf is a self centred overgrown juvenile - emotionally retarded is an expression that springs to mind, and men have a longer shelf life than women so he will be able to get away with it for quite a while and you won't.
Sorry for the above, but you did ask for the man's point of view, and perhaps by doing it something may be gained.