Is it wrong that i get annoyed by smalltalk every easily?

No, it's not wrong. Many people don't like it but act like they do because they are only being polite.

If a conversation is preventing you from continuing with your job he must be told that it is. If he becomes irritating to you then interject with something of your own and, maybe, the conversation can be turned around to something that will interest you more, so that you'll then be able to be involved more. Your other choice would be to just switch off your 'phone or computer.

Also, please understand the difference between the words 'very' and 'every'.

Change the conversation! If you're tired of the same questions, ask the person some things about themselves

A lot of people hate small talk. The polite thing to do is answer, but for this guy who repeats the same thing everyday, I wouldn't blame you for not answering him. I avoid small talk as much as I can, in fact sometimes I'll go out of my way to avoid it (eg take a turn if I'm on a walk and see someone I know up ahead). It's definitely not wrong that you easily get annoyed by it.

Nah its not wrong of you, I feel the same way sometimes. But as a consequence of not answering he might think you're an asshole, even tho I wouldn't consider you one from that. Maybe instead you could ask him very specific questions about random things you think of, like what shows did you watch in middle school or when you have family cookouts whats an interesting reoccurring dish, and then have a conversation springboarding from there. Or i mean just don't talk to him if you don't like the guy and don't want a friendship with him, your call.