The Joke:
My wife always complains that I have no sense of direction. So I packed up my stuff and right.
Here’s why it works:
“I have no sense of direction” normally means I get lost easily / I don’t know left from right.
When someone is angry or fed up, you’d expect:
“So I packed up my stuff and left.”
But the punchline says:
“So I packed up my stuff and right.”
That’s the joke.
He should say left, but since he has no sense of direction, he can’t even say left correctly… so he says right instead.
It’s wordplay + literal thinking