Candice,
I would, from what I have gleaned from the scripture, that you are the injured party. It is obvious that this man did not have the right intentions nor spirit. The fact that he remarried without benefit of legally ending his marriage to you would give the very definite idea that you are dealing with an immoral person, an adulterer if you will. That is a "deal breaker" and very suitable grounds to divorce. Then, ask G-d to bring you the G-dly man you need and deserve. My wife was in a bad situration, began to pray for a man that would love the L-rd as much as she did and two years later, we met and just a year later, were married. That was 36 years ago. G-d has provided for us and blessed us in ways un imaginable.
Blessings,
David