I mean, you could potentially use a expression like "gentleman caller," but only if you do not intellect sounding such as you're a personality in Jane Austen novel and only if you do not mind that, although it does dispose of the infantilizing "boy" misnomer, it falls in need of denoting the man is elderly, under no circumstances mind how it may be