I have a crush on a presumedly straight boy and I don't know how to deal with it (gay)

So I'm in an improvisation team at my high school and one of the guys is really attractive and sweet and intelligent. But, I'm pretty sure he's straight or closeted (he dresses really well which is a huge contrast to the people at my school... stereotypes sorry). I don't know if I should tell him or just deal with it but ughh he's perfect. He does look at me often and when we talk he looks deep in my eyes and sometimes gets a bit awkward (so do I). Lately he started to purposely try to annoy me but I don't know if this means anything. Thoughts?