How do I know what light my plants need?

I have four pepper plants, two aloe vera plants, one parsley plant, and one chives plant. I want them to not die over the winter, and ideally I would like to plant the veggies and herbs in my garden next summer. I'm thinking I need to buy them an indoor light because otherwise they won't be getting enough sunshine.

What sort of light should I purchase? Links and frugality are appreciated.