the term came about for the fact that when lonely people are literally seen kicking rocks as they walk out of their boredom/depression...
You said WHAT?! Motherfucka, kick rocks before I stomp yo punk ass!!
You want me to do what.....kick rocks!
If you do not like this phrase, then kick rocks!