This refers to the fact that dark-skinned people generally look younger than their age. Similar to the phrase "Black don't crack."
"You're 50! I thought you were 35!"
"Brown don't frown, baby!"
by Foos and shoes August 24, 2015
Get the Brown don't frown mug.