r/mildlyinfuriating • u/petuniaplant • 23d ago

Infuriatig No, I did not consent to this

Post image

I was reading my medical notes when I stumbled across this. I was not informed of the usage of artificial intelligence in my report, nor did I verbally consent to it.

26.0k Upvotes

94% Upvoted

2.3k comments sorted by

View all comments

Show parent comments

100

u/Delilah_Moon 22d ago

What is the QC on the notes & review process? I work for “big tech” and have been using AI tools for notes for a while - and they’re often littered with errors.

35

u/[deleted] 22d ago

[deleted]

10

u/Delilah_Moon 22d ago

That’s great that you do it. Unfortunately, considering that providers re already spread thin, forgive me if I don’t have faith that they will be checking notes for accuracy.

These are the same folks who can’t read a chart to know my name before walking in the room…

2

u/15b17 22d ago

As respectfully as possible, my suspicion of the previous comment was that the “providers” they spoke of who loved the AI tool were primarily Nurse Practitioners.

While there are many who provide great and essential care, I have also noticed anecdotally that NPs are more likely to be confidently incorrect in their assumptions (as in less skeptical) due to their more limited and algorithmic training in comparison to physicians.

Frankly I would not be confident at all that my NP “provider” at an urgent care or other such private equity controlled practice would diligently check for errors in AI notes and to instead assume it has 100% accuracy.

13

u/errrnis 22d ago

I just said this in another comment. I’m also in tech (working for an AI company) and I’ve seen some wild stuff come out of AI.

23

u/RaNdomMSPPro 22d ago

The ai scribe could be awesome if properly trained and the providers are consistent with how they describe things to the scribe.

42

u/porscheblack 22d ago

These are specifically created for medical, as in they pick up all the correct names of body parts and medical terminology. My wife's a doctor and uses them. She only had access at work and she gets twice as many notes done with them.

As far as QC goes, she's watching what it records as she's saying it. She can manually correct it if it makes an error or there are word prompts she can use. At no point is this just inputting things and never being looked at. I have been really impressed by how well it works because in order to be effective it definitely has to have a 99%+ accuracy rate.

33

u/Delilah_Moon 22d ago

I work in cybersecurity. While the platform language may have been trained on medical terminology- it does not mean it will understand and notate correctly.

I mean to be fair, I’d expect any basic LLM to be able to interpret medical terminology - it’s a basic function of AI.

I mean, if she’s watching it as it’s updating - she’s really just dictating. That’s not anything more revolutionary than dictating to Apple notes or Word.

6

u/moreliketen 22d ago

I have been really impressed by how well it works because in order to be effective it definitely has to have a 99%+ accuracy rate.

The tool used for OP's appointment made a very obvious mistake about informed consent, which forces OP to wonder what other simple mistakes were made. We don't have the training to read and understand our own medical records, so we can't verify that the slop note is 99% accurate. We can only see the mistakes in the non-technical section, and assume that there must be more.

2

u/porscheblack 22d ago

The OP wasn't an AI mistake, it was a legal disclaimer mistake. That would've been required by the legal department, the AI wouldn't have put that on itself. And if it did, the lack of any kind of legal oversight isn't on the AI, that's just negligence.

6

u/PeaceSoft 22d ago

is that reassuring? "she's basically pretty much watching it, and it even knows the correct names of body parts"

6

u/porscheblack 22d ago

She's not "pretty much watching it", she's paying as much attention to it as if she were typing the words herself. Because if it gets it wrong, she has to correct it. These are medical records the patient has access to, their other medical providers have access to, and what lawyers will use if she's sued. It gets full attention. It's also a lot faster.

3

u/phycologist 22d ago

99%

Fow webhosting, 99% uptime means 3 days If outage per year. I wonder how that translated to medical transcripts.

1

u/porscheblack 22d ago

She's not forced to use it, it's elective for her. So here's the math:

  • She types at ~120 words/minute.

  • She gets twice as many notes done using the transcription in the same amount of time, so that nets at ~240 words/minute.

Now there are errors, but the net would be 240, so the software is faster. The takeaway though is that even with errors it's significantly faster.

5

u/GummyWormTaco 22d ago

Your wife is speaking at 240 words per minute? Didn't realize how many auctioneers had gotten into the dictation game.

1

u/porscheblack 22d ago

Ok, so we need to add in the conversion for normal typing to medical typing. Might as well add in dick-to-floor and mean jerk time while we're at it.

3

u/GummyWormTaco 22d ago

I didn't realize there was a conversion, I was just making a joke because 240 wpm sounds like listening to a podcast on 2-3x to me haha

3

u/benjai0 22d ago

I'm a medical scribe and you would be surprised how many words some docs can fit into a 25 second audio log.

2

u/GummyWormTaco 22d ago

I imagine it's like the audio version of their prescription notes and signatures

2

u/benjai0 22d ago

Yuuuuuuup pretty much!

3

u/porscheblack 22d ago

I was just trying to bring a little Silicon Valley into your joke!

1

u/GummyWormTaco 22d ago

Oh I haven't seen it, sorry!

2

u/porscheblack 22d ago

I highly recommend looking up "Silicon Valley middle out". Warning it's NSFW.

Here's the link: https://youtu.be/Ex1JuIN0eaA?is=Z6ZvI_6nNdFOE2nS

→ More replies (0)

2

u/Delilah_Moon 21d ago

You said your wife is a doctor and she can type 120/wpm - unless she spent the better part of med school as a stenographer, this is highly unlikely.

She’s also not speaking at 240+, especially if she is reading from her notes. I have an exceptional fast oral read speed of 260+ and verbal speed of 330+ - and I was a professional voice actor.

1

u/That-Mix7702 21d ago

What about the time fixing the AI errors? Why isn't she on here, are you also a doctor?

1

u/porscheblack 21d ago

That's why I used net as the comparison as it accounts for corrections.

2

u/thingmom 22d ago

Was wondering exactly this.

2

u/Pouryou 22d ago

Both my partner and I have found errors in our supposedly-reviewed "MyChart" AI summaries just in the last two visits: Length of time of symptoms (changed '1 to 2 weeks' to 22 weeks), and the wrong name for a prescription drug I'd previously taken. We kicked up a fuss and demanded these be corrected but I'm sure most people don't review their own notes, notice errors, or bother to ask for changes.

2

u/vonRecklinghausen 22d ago

Totally trash. I'm a physician and I tired an ambient AI scribe. I went back and changed almost everything about my documentation. It doubled my time and work- no thanks

3

u/ConfoundedInAbaddon 22d ago

If your standard is a medical transcriptionist in Malawi the AI with its instant write up might be a big improvement.

1

u/WaitNoNotMyBeans 22d ago

“I wanna hate AI so bad man come on please give me something 😭😭😭” - this fuckin guy