What would you do?

I had been with the father of my child for over 4 1/2 years. We both love each other and we both have behavior issues that affect our relationship. We both acknowledge these issues and know we need to work on them if we are ever going to reconcile and get back together. There are two dynamics that make me wonder if I should try and work things out with him. 1. He started seeing someone else a month before we eventually broke up. Not the first time he has had an affair, and he admitted that his cheating is one of the things he needs to change on his end. 2. Before we started talking about working things out I turned to dating apps to take my mind off the heartbreak, and while I didn't have much interest in talking to the people that tried to connect with me, it was a real confidence builder to constantly be told throughout the day how attractive I am. I did connect with one person, however, and enjoy talking to them. They call me beautiful and ask about my day. I feel I could fall for this person however we have never so much as spoken over the phone, only text messages. We both have 2 kids and aren't interested in having more.

Now that the father of my child wants to work things out they tell me they love me more often and generally seem more loving in the way they talk to me.

I'm torn in whether I should try and see if me and my ex can work things out, or if I should explore this new interest.