The bottom line is, he has started pushing you around physically, to the extent where you have ended up with bruises. Walk away now, and stay away. This is just the beginning. If you allow yourself to be abused like this, it can only go in one direction. The abuse will increase, your willpower and self-esteem will decrease and you will be trapped. More importantly, so will your children. If you care anything for them, put your own feelings to one side and do what is best for them, by getting rid of this man.