This is a phrase used in the absence of the phrases such as fuck off or piss off. It can be said to people of older generations and they cannot tell you off as they dont know what it means.
It is also used when a person cant be arsed to have an argument but knows hes right;
Person 2 - How did i, gay bastard.
Person 3 - Yea u did i saw u.
Person 2 - Rack off!