What should i do...?

It sounds like you are having children before you know the female well enough to start a family. That is the larger concern. Please learn from your past experience. Perhaps put forth a lot of effort into the relationship you are in now, and do your best to make things work. If you are not going to be happy after sincere effort, then yes get out of the relationship with the women. Make your children your priority and not another female.