To be overly:
It is used to overly exaggerate that specific feeling.
And no, it DOES NOT literally mean anything. It's an IDIOMATIC EXPRESSION, it does NOT mean that you actually want to punch a baby in the face.
I'm so confused, I just want to punch a baby in the face.