A lot of different groups identify with the color "brown" but if I had to pick an official "brown race" I'd say it would have to be Malay-Polynesians whicj includes Polynesians, Micronesians, Filipinos, native Malaysians and Indonesians. Middle Easterners and Latinos have a close genetic connection to white Europeans and many are pale faced as any "white person".
In the colonial era a "brown person" was either Malayo-Polynesian groups or South Asians. Latinos were not called "brown" during this period. Latinos of predominantly European ancestry were white. Indians were red, etc.