Left alone

Soo. We are together in a club with my good friend (with benefits), we came together, just the two of us. He is a bit paranoid if he meets people he knows and stressed that they might ask who I am or where we've met or something... It happened and he met his classmate, while we were dancing.. When he meets him, he then followed him and danced around with the group the schoolmate was there with (he doesn't know anyone there besides the classmate). He didn't even say a word to me about going with him or that he'll be right back or whatever. So I'm standing there alone in the dance floor, see him dancing and not giving a fuck.. I was feeling like a left alone piece of... So I was thinking I should just leave, he wouldn't really notice anyway. But then I went to him after like two minutes and told him I was gonna get a drink. He joined and then I told him how it felt. He was feeling kinda "bad" for it and he said he didn't know how to handle it... But that he'll come to my place later if I want to leave.. Can you believe it? So we come there together, and he just would let me leave and go dance with other people? Am I stupid, or is he a freaking asshole to me?