How ghosting has caused "PSD" in my life

It's been about two years since my last serious relationship. Since then things with men have gotten serious, then suddenly it's like they've vanished into thin air. Ghosting is something I've become used to and in some situations expected. Because of this I decided to take a break from dating. I wanted to spend some time on myself and focus on something else besides finding a man. I have reentered the dating scene but I'm finding that all the times of getting ghosted has really caused some "PSD" in my life. I am talking to somebody we have went on some dates and I'm really into him, but he is terrible at communication. He takes hours and hours to reply. He will read/open my messages but not reply and I can't help feeling anxious when it happens. It makes me fear that I'm getting ghosted again. Can anyone offer some advice on how to deal with this? I've thought about telling him my fears but I'm scared he will think I'm crazy or too serious for where we are in the relationship. Any help will be greatly appreciated!