Usually but not always pertaining to cross dressing or closeted gay fathers, 'daddy's drawer' is the drawer daddy told you to stay out of, and that you regret looking in for the rest of your living days. Contents can vary depending on the individual.
I quickly became an obedient child after looking inside 'daddy's drawer', when he had clearly instructed me not to.
Sandy: I'm so wet Dan. I am ready. Put it to me right now.
Dan: Yea baby. Bend over for me while I rifle through Grandpa's Sock Drawer and sheath one up.