I am so lost

So I have this straight friend, and have known him for awhile. We'd booked a hotel in the city for the night, to celebrate his 21st birthday. Somewhere in between the celebrations, we got really drunk and he ended up in my bed. He asked me to give him head, but midway, through he freaked out and told me to stop- which I did. Nothing was said the next day, until I got home and he messaged me to say that he thinks that I raped him, which I denied. Even if he asked for a blowjob- he's not gay so I should have known better is his argument. I am at lost as what to do, he ignores me when he sees me out, which hurts because I don't think I did anything wrong