A Bucks doctor who allegedly started a relationship with a vulnerable former patient is set to face a tribunal.