When you find THE person then you KNOW it, you don't have to keeping thinking about it.
I have been married to my second wife for about 24 years, but I cant imagine my life without her.
If anything happened to her my life would collapse.
If anyone tried to hurt her I would risk my life to save her.
THAT is what loving someone is about, not lying in bed wondering if you should stay together, and IF you love each other.
Break up with him and go out and find somebody you REALLY care about.
p.s. The first woman I married I did not love. Our relationship was ok but nothing more (bit like yours). We drifted into marriage and had two children but finished up having 10 miserable years together before divorcing.
Don't go down that route.
When you met THE person you will know, you wont have to keep asking yourself.