An outside source (usually an individual) used to pick/manage the lemons on a farm or a stand of some sort. Lemon men usually work alone and the career itself has been rumored to have an annual income of around twenty thousand dollars a year.
Guy 1: Hey man wanna come get some lemons with me at the super market?
Guy 2: Oh they're out. I checked yesterday. You should go to the lemon man.