unconsciencly homophobic?

Hi, so I am a 20 year old guy from Belgium and I recently got a (first) boyfriend with a lot of gay friends. I can't really put my finger on it but I don't seem to get along all to well with most gay men. I already met a lot of gay people but never really felt like I could hang out with them or really like them as friends. My boyfriend thinks it is a bit weird. I just hang around with all my guys who happen to be straight. Am I unconsciencly being a bit homophobic or do I just don't really fit into the gay community? I would like to stress that I am not generalising gay men, I know that a lot of people aren't the stereotypical representation and I am proud to be gay.