Were you offended by "it's none of my business" in support of gay people?

I'm 41 (straight) and remember from my entire childhood in the 80's to the coming of age in the 90's whenever the question was asked "do you think he's gay?" the appropriate PC answer was always "It's none of my business". While I agree with the sentiment, I have always felt it a cop out, as if to say "I don't have to have/express an opinion"?