Lactation in female that is and has not been pregnant. Should I be concerned?

About a year ago, during a breast self-exam, I noticed a milky/clear liquid coming from my nipple. It really freaked me out, and I realized both breasts would leak the fluid if pressed.

I've tried some different things, hoping it would stop, like bigger bras, but eventually thought it was my birth control, so I stopped it and relied solely on the condoms we always use about a month ago. I'm still having the discharge.

I had been on the pill, and we always used condoms, and I took pregnancy tests when it started. I have never been pregnant. I am 28, had been on the pill for years, and have been on Effexor for at least five years. I did gain a little weight the past years, so now I am a normal weight, which has caused my breasts to grow (before, I was very skinny and had very little breast tissue.)

The discharge is always clear or pale white, and there are usually a few drops worth in one breast, and a bit more in the other, but one seems to squirt out.

Any med student out there that want to take a crack at this one?