Post game shame...

I feel so miserable about this... Well. I feel just miserable in general. I need some advice. I'm not really out (only to a few friends), but I just recently tried fooling around/dating with a guy. My first guy. And so far when I'm with him, everything feels so nice and fun and just great. But then in the hard light of the next day, I slowly start to feel a deep shame. And not just for messing around with a man, but shame for feeling shame. I start feeling panicky, and get the urge to sabotage things so i can go back to being lonely... It's fucked up, and my guy deserves better than to get dragged into this muck... but... I really like him too... DAE experience this? How do I move past this?