Crossing US/Canadian border, marriage?

Hi, I recently am married to my wife who is a canadian citizen. I live in the US and plan on visiting her again in canada. We plan on flying out together to the bahamas for our honeymoon seeing how we previously didn't have time to plan one. So, basically, I would be going into Canada, just to fly out, come back and leave again to the US. I know that seems silly, but surprisingly it's cheaper this way. My question is though, should I be worried about crossing the canadian border because i now have my spouse there? I eventually plan to move up there but have not turned in any of the paperwork, etc

all advice is appreciated, thank you