Need advice: unique relationship conundrum

Hello everyone, I have a question/conundrum. Sorry this is a bit long. But I am looking for a neutral viewpoint. Thanks in advance.I am a divorced bi-male. I met a guy about a year ago and we’ve become amazing friends. We see each other 4 days a week and chat via text throughout the day - even weekends and holidays. A good morning text everyday. We average about 100+ texts a day.We’ve gently explored a sexual relationship (no oral or penetration), lots of body contact, massage, HJs, and mutual masturbation; he has also allowed me to use small dildos on him. We’ve climaxed together often.He is married to a woman and she is fully aware of the levels of our friendship - it’s complicated for sure. I adore her and consider her a friend as well. She has given him full reign to explore sexually (penetration and oral), but not with someone who is a friend, as to eliminate emotional investment. I get it; she is afraid of losing him. She would prefer that he met random men for casual sex. He and I have discussed this in great detail and he wants to respect the boundaries of their agreement. Yet, when we are alone and during our conversations, we stand on the threshold of exploring further. The sexual tension is unbelievable.The conundrum is: he has met other men and has arranged to meet with them for casual sex, but backs out every time. This has happened three times over the past year. He stops all contact with them. Yet immediately returns to me, we talk in depth, and he says that doesn’t know why he can’t go and just get F-ed. Then he says that he is being a jerk for even talking with other men and doesn’t want to hurt me, but sex with friends is off limits. As he needs to/wants to have a great normal friendship with me.The question is: do you think that his actions toward not exploring with other men means that he has deep feelings for me?This is a very atypical situation, and as I said, I love our friendship. But am I standing in the way of him being able to explore?Any thoughts would be greatly appreciated.