A phrase used after a serious comment makes an individual angry. The phrase is to make light of the serious comment, such as to convince the person spoken to that the aforementioned comment was just a joke.....even though actually it was not a joke.
Come on lighten up.....when I told you that you are ugly I didn't mean it. It was just a little roadside humour!!!