From the traditional folk song of the Southern United States, "The Yellow Rose of Texas". The Yellow Rose was Emily West Morgan, a mulatto. The term 'High Yellow' was used to describe non-Caucasian people whose skin color was so light, that they could pass for white. A high yellow female was sometimes referred to as a Yellow Rose.
"There's a yellow rose in Texas that I am going to see..."