HELP! POTATO BUGS?

Seeing you got them, then you do not need any help. Wish I had some.  They go good with a white wine, a Gewurztraminer which is slightly spicey & not too dry.

First off, there are several bugs that go by that name.  Do you mean the small grey ones that have scales like an armadillo?  If so:

1) They're harmless to you, you can definitely go back in there.

2) They are there because there's a damp problem somewhere in or under your room.  You really need to find it and do something about it.  Damp, decaying wood just happens to be what tater bugs eat.  They won't harm anything that's sound.

You can vacuum them up.  They probably won't survive it, in fact they won't if you vacuum the whole house because they'll desiccate and die.

The other two species that go by that name are a beetle and a cousin to crickets.  Both those species are striped, can bite painfully but are not venomous, and do not like it indoors.  I'd be very surprised if those were the bugs you meant, but if so, I'd hit them with bug spray and then go hunting down the vegetable matter that attracted them and deal with that.

Turn 'em into french fries. It's eat or be eaten.