Did I read more into this than I should have?

ok, couple of weeks ago and ex bf from way too many years ago got in touch on linked in. we chatted on the fone a couple of days later. He expressed that he had a hard time getting over me and for years compared other women to me. surprising conversation as he wasnt that nice to me when we dated but ok. He also spent quite a bit of time telling me how successful and rich he is. In the end we caught up and I wished him well in life. He lives in Atlanta and is married with 2 kids.

Now today he called me and told me he is in town on business and asked me out for lunch or coffee. I told him I had plans and couldnt. He pressed me as to why I wouldnt meet him. We chatted a bit, he starts in again about how special I used to be to him blah blah blah. He kept trying to figure out why I wouldnt meet him for coffee or something. Annoyed I finally told him, given our history and the fact that he is married I didnt feel it was appropriate given he is a married man. But he says this is MY chance to put a period on our relationship (after 23 years?) and this is the last time HE will as ME ever. I asked him if his wife knew about his plans...not but he will tell her and if she has a problem thats her problem.

I guess now I wonder if I overreacted. what do you think?