Is anal sex harder for males?

When I watch porn the girls seem to do it effortlessly and the guys pound into them and quickly. But with gay guys its so slow and looks painful. I'm just wondering why that is that it seems a lot harder for men than women.