My computer tells me I have no internet conncection when I do?

I have a Dell Inspiron N7110 with Windows 7. It isn't the best computer, but it works and generally gets the job done. The most pressing issue with this computer would definitely have to be it's inconsistency when it comes to connecting to the internet. I usually end up getting connected through playing around with it, but that isn't why I am posting this question.

Every time I do connect to the internet, the icon in the bottom right corner either has a yellow asterisk saying networks are available or a red X across the bars. Even with these icons being there, I am still connected to the internet and it runs fine. When I click on the icon, It says connected next to the network I am using.

I know this is just an aesthetic thing, but I would really like to know why my computer is doing this and if there is a way to fix it.

Thanks in advance