I am trying to find the name of a book I read many years ago?

The basic plot was a woman married a man after her childhood sweetheart left town. Sweetheart came back many years later after being a journalist over seas for many years and they had an affair. She got hurt and nearly died. Her life was put into perspective.

I think it was called something like "this could happen to you" or "these walls could talk" but I have no clue.

Please someone help me!