Should I file for full custody since the father doesn't seem to care to spend time?

I have a 5yr old son and I can basically can count on 1 maybe both hands how many times he has spent time with him in hhiswhole little 5yrs. About 1 1/2 years ago I ffiledfor child support and have been receiving it every since. When I filed for child support I thought it would be pointless to file for split custody because I ddidn'tfeel as though the courts should make him spend time with his son. Now he is calling every 3-4 months asking to see him then most of the time he ddoesn'teven show up. I ddon'twant my son to go tthroughthis anymore with him cause I know exactly how that feels because my father did the same thing to me and it took me 24 years to get over it. I do have a male figure (my fiance) in his life that has been there since my son was 1 and a half. He also (my fiance) ddoesn'twant him coming around or popping in and out of his life neither. I wanted to change my number and just get rid of him because I am tired of him doing this to my son. Also he ddoesn'tlive far so its not like he cant get to him and I never denied him to see him even when he never shows up. But I am fed up and ddon'twant my son to be bothered. I kinda feel bad if I file for full but I kinda ddon't I just ddon'tknow what to do?