This phrase originates from the bases where fourth base, or home base, describes sex. If you move past this by having anal sex, you've reached fifth. To do it without permission, you stole fifth.
"How did that go?"
"She let me stay for extra innings"