Why isn't sexual orientation as commonly considered as hand dominance?

I just want to know the difference why would people think it's wrong to be born gay but it's okay to be born left-handed which is also a minority of the people? Isn't it kind of the same thing? Aside from the environmental factors that might cause sexual orientations to differ.