Agreed, he will be back soon enough. I would also think about setting up to hunt in that spot later in the same afternoon.
I usually keep a mouth call in while walking in to my spot in the morning. If I bump a hen and it's not too early I will do a fly down cackle to cover up my mistake.