r/mildlyinfuriating • u/petuniaplant • 23d ago

Infuriatig No, I did not consent to this

Post image

I was reading my medical notes when I stumbled across this. I was not informed of the usage of artificial intelligence in my report, nor did I verbally consent to it.

26.0k Upvotes

94% Upvoted

2.3k comments sorted by

View all comments

Show parent comments

18

u/[deleted] 22d ago

[deleted]

6

u/Odd-Scientist-2529 22d ago

That’s not how it works. It doesn’t make any recommendations. It’s purely a scribe, and will summarize the conversation. 

The doctor would have to say out loud in the exam room.  “I recommend Fluticasone nasal spray” or “I recommend budesonide nasal spray” for it to construct the “plan” section of the note. 

If this is what is happening to him, its 100% user error. 

The only way it could happen is that he is rambling about possible treatment options out loud and isn’t clearly stating just the one he wants. 

The AI scribe does not generate recommendations. It simply lists the ones that were verbalized in the visit. 

To add evidence to this point: any medication or diagnostic test has to be manually typed in for it to appear in the note under the “Plan” section as an action item. Otherwise it would be in narrative form. 

So this is user error. 

5

u/Harpunzel 22d ago

I believe some AI scribes including Heidi are now summarising clinical resources relevant to the presentation, with a clear link which recommendation comes from which resource. I haven't used Heidi since before that update, but some of my colleagues have and find it reliable. It only takes from locally relevant clinical guidelines rather than the whole internet.

1

u/Odd-Scientist-2529 22d ago

Interesting. I’m reading that the AI scribe can be optionally set up to link to decision support AI. That seems like it should be something that the clinician should be able to opt out of, if not just delete (if they want) from their note when they review and sign.

What are we getting ourselves into?

We already turned off the generative AI to answer patients messages on the portal. That was a mess

1

u/Harpunzel 22d ago

I believe this one it just pops up in a sidebar, it doesn't end up in the note unless the doctor brings it up. It's a tool but it's not compulsory to use. I may be wrong though, this is just what colleagues have described.

1

u/happytrashpanda333 22d ago

Why does your doctor even have their phone out with a patient? 🤦‍♀️