who said this ?

I'm speculating. It grew out of the white supremest culture. It's from "the south". I doubt it dates back past the 1940's. The phrase is used in lyrics by Johnny Reb. He doesn't seem to actually be credited with coining the phrase, tho.

This IS a quote by R.E.Lee-

With all my devotion to the Union and the feeling of loyalty and duty of an American citizen, I have not been able to make up my mind to raise my hand against my relatives, my children, my home. I have therefore resigned my commission in the Army, and save in defense of my native State, with the sincere hope that my poor services may never be needed, I hope I may never be called on to draw my sword...

Robert E Lee