I think my neighbor is watching me? ?

I am a 20 year old female living with my parents. a few months ago my parents had advised me to shut my blinds and window at night because they noticed our neighbor stands around my side of the fence a lot. I had simply told them he tends to go there to have private phone calls or smoke, so we all didn’t think much of it. as of late I notice his voice come out of nowhere on a phone call, or a glass bottle, presumably alcohol, be thrown into their garbage bins on that same side. today I was studying when I was watching their plants move from the strong winds through the cracks of our fence. it was until then that I noticed another figure moving, I quickly pulled out my phone and filmed through my window to the best of my ability and saw that it was a person shifting from side to side. I was too scared to film any better videos so I shut my window loudly and closed my blinds and I noticed that they were immediately gone. scary part of it is that they made no noise. my dog tends to bark near my window outside too, at night especially. should I wait to catch them again before telling anybody? thing is we are really friendly with our neighbors so I’m unsure how I could tell them that their dad is a creep...