forced silent minority

A minority of a population forced to keep silent or "in the closet" for fear of stereotypes, ostracism, and silencing by the majority.

Atheists are a forced silent minority-whenever one admits that they are an atheist, they will be stereotyped as an amoral, loud, boorish, fad-follower - never mind if their belief is right or not.