A unique definition for a man that is physically fit, has swagger, dresses well and properly accessorizes. Women will notice this but other men won't understand (e.g. sweet man may have a red wallet that women love but other men think is silly).
This man will be on the opposite side of the spectrum from baseball cap wearing, tobacco chewing, color mis-matching, sloppy looking men but no so far down the scale that he looks gay (e.g. metro men). It should be noted that gay men will occassionally pay special attention to the sweet man as gay men may get confused upon an initial sighting.
The sweet man will not wax his eyebrows, highlight his hair, apply a fake tan or carry a man bag but will maintain a fine balance between being rough and being smooth.
How did that guy land such a beautiful wife? Dude, look at his fancy slippers and symmetrical hair, he is looking sweet.