Can I refuse to talk to my aggressive landlord in person, and only deal in writing?

Sorry submitted this early by accident.

My landlord tends to be rude, agressive and makes threats when I talk to him on the phone or in person, to the point where I am too anxious to call him because I get nothing but grief from him, and also there is no evidence of his actions.

Can I for instance, refuse his calls and say he has to contact me through email or text. That way he either has to treat me with respect or give me evidence of his actions