Boyfriend says he loves me but wants to go slow?

Ok.. So I've been with him 4 months almost... The first 3 months were amazing.. He wound up getting fired from his job and it seems his works came crashing down.. He fell into a major depression.. I was living with him the entire 4 months. When he got depressed,it rubbed off on me since we were around each other 24/7 for almost a month.. Well,we kept bickering and I wound up getting my things and leaving... I've been at my sisters house since..

I went over his house Saturday night,and spent all if yesterday with him and slept over last night too... He told me he loves me very much,that we are together and he wants me.. But doesn't think it's fair or right that I move back in so quick. Oh,he got a new job.. And is back to being his awesome/happy self too.

Now I'm very crushed and hurt cause I wanna live back with him,and I'm so sad and mad at myself that I left on an angry whim :'(. He shares the house with roommates by the way.

Any advice??? I can't stop crying.