It means you blew it. It originated from the popular television show "Family Ties" in which the character named "Skippy Handleman" always messed things up with his clutsy and nerdy behavior. The phrase started as an expansion of the popular phrase Damn Skippy.
Damn Skippy Handleman! Next time you better get her digits!