Working as a Gay Male in Forensic Psychiatric Care

I got a summer job working as a psychiatric technician in a forensic psychiatric care facility (for offenders who suffer from a serious mental disorder).Now I'm feeling insane for even applying for this job. During the interview they told me they needed every kind of competence they could get, and being 'softer' than most of the other guys working there I thought I could contribute with something that was missing. It turns out I can't, because the environment makes me freeze. It's a male-dominated workplace with mostly male offenders, where both patients and staff drop homophobic comments and joke around about girls and stuff.This is making me so stressed out I leave work feeling nauseous some days. I've come out to some of the women at work and the guys I feel safe with (mostly the younger men). But when I'm working alone with the majority of the regular staff I just sit around at work in constant fear that the staff and (sometimes violent) patients might find out and I'll be at risk because of this, I know some of them are searching for every weakness they can find. I'm afraid that the staff will try to freeze me out if they find out.I'm feeling left out, lonely and 'odd'. I can't connect with the patients and do the work well on days when I'm feeling like this. Has anybody been through anything similar? Any advice would be helpful.