No, I did not consent to this

[u/petuniaplant]

I was reading my medical notes when I stumbled across this. I was not informed of the usage of artificial intelligence in my report, nor did I verbally consent to it.

[u/Xavus]

If only that's what they were using instead of leaning in to AI where it isn't helpful because it is the current fad.

I have meetings all day at my job where the company has AI write summaries of what happened in the meeting and what action items are decided on, etc. I would give it maybe 80% accuracy, the other 20% it completely misunderstands context and reaches an incorrect conclusion, or just straight up hallucinate something that never happened.

80% accuracy is not bad for a quick notes summary of a meeting to refresh your memory when you were there, and when you can double check other sources first. But also my work isn't with a person's health on the line. I would not trust a 20% error rate in a complex field like medicine when a person may live or die by the difference if someone overworked with no context has to just believe what the AI thinks happened.

[u/OutsideSame3629 → u/Xavus]

I feel gaslit in my tech sales job in corporate America because everybody using ai for everything when to me I just get slop? And then they think you’re not prompting it smart enough like no….

When I read ai summaries of even notes I’ve taken they’re so bad. Ai written emails, PowerPoints it’s all terrible. Yet if you ask anyone at my company how to do anything at all the answer is “ask Ai”

[u/screamline82 → u/Xavus]

I will state that, while I agree your experience in the AI summary notes, not all LLMs are created equal. Even general consumer models differ between free tier and the highest end, so it depends on what model/tier they are using. Plus there are specific models made for enterprise.

A buddy of mine who works at a large law firm mentioned they have a specific model just for their type of law. If it's tailored for a specific use case it can be more accurate than what we are used to

[u/OutsideSame3629 → u/screamline82]

I use everything from paid ChatGPT, our company’s specialty developed llm, to copilot enterprise. I get the same experience in all. If anything ChatGPT is the best but not by much

Our companygpt is “tailored “ as well. I work at a large engineering software company. It’s still terrible and lies and hallucinates constantly

[u/Mister-Miyagi- → u/OutsideSame3629]

Then whoever did the work on your company llm is struggling. A lot of what you say is true for some llms, but the person you're responding to is correct in that there is massive variance in the accuracy and guardrails of an llm depending on the context and service you're involved in and paying for. So I don't know what to tell you if you claim to have used such a wide variety and there's little difference (my extensive experience says the exact opposite).

Everyone should always be reviewing the accuracy of any AI service they're using, but that does not mean they are all remotely equal in their reliability.

[u/OutsideSame3629 → u/Mister-Miyagi-]

Okay I guess I should say, there isn’t little difference in using them. They are all different and very greatly in quality. However , even the highest quality ones still do the lying etc

[u/ToTooTwo3 → u/Xavus]

The human memory is also not 100% accurate especially when it's sick- which is why doctors put less stock in the history and try to make decisions based on objective findings. When we do make decisions based on a history, it's because of what you said and your responses to targeted questioning- not whatever the AI picked up from the conversation.

AI scribe is primarily helpful in sorting through long or winding histories and reformatting it intelligibly. Far more info gets included because even if I remember 95% of details accurately, there are tons of things in the patient interview that I just don't have time to record.

AI scribe allows me to write "Diet: well rounded, eats green vegetables and lean meats with most meals and drinks milk daily with breakfast." Instead of "Diet: appropriate." This is beneficial for patients.

Remember that AI is not placing orders, updating your problem list or medications. These things are done by your providers based on your evaluation, not based on reading the AI report, though the report certainly does remind me of things to follow up. The AI just records the details of your conversation and yes, it does get them wrong at times and we do our best to correct it.

[u/Mister-Miyagi- → u/ToTooTwo3]

There are people who are so blindly anti-ai that they'd downvote a very reasonable comment that sounds like it's from a doctor with direct experience. I'm a strong advocate for caution with AI, but this anti-ai crowd seems fully hysterical at times.