this is an eviction question?

ok i have an apartment house and my old house on my property. for months ago a guy said he would help me out around my greenhouses for a place to crash once in a while. My apartment house is full so i told him he could crash at my old house if he needed to. I never made p a lease for him because he wasnt a tenant he was just there a cople days a week. Now 4 months later he is living in there. I want this guy out. We have caught him on hidden camera breaking and entering my tenants apartments. Do i have to give this guy an eviction? Can i just go into my house and take his stuff out legally? The police are trying to find him but he runs whenever they come and they cant catch him. What are my options? please help this i s sincere

I live in hampton NY