Pain the days after anal sex

This is interesting. I don't get pain at all when receiving anal, but the day after I feel some sort of discomfort or inflammation down there. Like my anus was stretched. This goes on for 3 to 5 days.Is this a cause of concern?