Slang meets colloquialism:
Speaking out of your rear, In this case your rear is the
pocket.
Removes the first word and your and hence removing the previous limits and this increase the variety of application.
(You,that, it, _____) (are,is) (so) out of
pocket.
See “out of your a**”