JohnFen
a year ago
I'm assuming for the sake of argument here that doctors actually are diligently checking LLM-generated responses before they get sent.
> Other systems — including Stanford Health Care, U.W. Health, U.N.C. Health and N.Y.U. Langone Health — decided that notifying patients would do more harm than good.
This is my primary problem (which goes hand-in-hand with efforts to make the LLM speak "in the voice of the doctor) with this whole thing. Not notifying patients that they're interacting with a machine is just deceptive. It's lying.
That some hospitals are OK with this behavior doesn't just affect those specific hospitals. It means that no communications from any "doctor" can be trusted unless the doctor is speaking to you in person.
Regarding speaking in the voice of the doctor:
> Brent Lamm, chief information officer for U.N.C. Health, said this addressed common complaints he heard from doctors: “My personal voice is not coming through” or “I’ve known this patient for seven years. They’re going to know it’s not me.”
So they implemented this level of deception because doctors were complaining that the system wasn't deceptive enough. Nice.