Perhaps there was no one behind us. I don't recall letting anyone through. It was a quiet day at the course.
As I recall, our round took over four-and-a-half hours.
You are polite , well mannered.
By the 2nd tee box I would have ditched that guy and played on ahead (which probably would not be the first time somebody did that to him).
Now I will share a golf story
Guy is on the ladies tee box and the pro shop loudspeaker announces " Sir, you are not permitted to play from the ladies tees, please step back to the men's"
The guy looks over, shakes his head, and takes another practice swing.
Pro shop announces again, over the loudspeaker for everyone to hear, an emphatic demand that "Do not play from the ladies tee box, you must step back to the men's tees !"
Guy looks over to the pro shop and shouts" will you shut up, I am trying to play my second shot here".