Can you switch a cactus from soil to sand?

I have a small round cactus potted in cacti potting soil. I've had it for four to five years and it's to about four times it's starting size. Not counting the thorns it's about the size of a softball. It fell out of it's pot today and it's roots are only about three tablespoons in size.

Would it be ok to transfer it to a shallow tray of sand?

(It's outside in part sun if that's a consideration.)