When one has the intention of getting some action and is trying to be discrete around his(her) date about scoring. The lite sweater refers to the act of 'getting some'.
Richard: "Dude, tonight I am going to put on a lite sweater."
Frank: "Is the weather permitting?"
Richard: "Yeah the weather is calling for a lite sweater."