The victim hat is not a real hat, it is metaphorical. Those who "wear the victim hat" are those who complain that whatever "pain" and "suffering" they are experiencing is caused by the actions of another person or another group of people. This usually results in a demand of compensation (in some form or another) by the one who feels that he or she is victimized, from the one(s) that is causing the victimization.