What does "Its not a viable time for children" really mean?

I am really feeling quite lost right now. My fiance and I have been trying for a baby for just over a year. With both of us being in our early 30's (I am 33, he is 35), I feel that we are best continuing to try and I thought he thought so too. We went and got tested and it came back that his sperm are swimming slow and that he is best getting it retested. He has started saying that "Children may not be a viable option right now". meaning that he now thinks that we can't afford it. I understand that, but as I pointed out to him, there is never a good time fianacially to have children. I am unsure of what to do. Is he just trying to get out of having kids? Can he really just not be bothered beacuse he has to do some thing? I am so confused and sad right now and I am unsure if I should stay in this relationship and wait or move on. Please help.