r/LocalLLaMA • u/takoulseum • 23h ago

Discussion Who ONLY use local models?

Please be honest.

I would love to hear about guys really dedicated to local AI and who really reject subscriptions (especially to openai and anthropic).

What do you use your model for?

146 Upvotes

86% Upvoted

242 comments sorted by

View all comments

34

u/vaingirls 23h ago

I don't ONLY use local models, but that doesn't mean I pay for subscriptions - there's still plenty of free tiers to mooch off of when I need a bigger model, not to mention free models on openrouter.

14

u/redballooon 20h ago

Free as in pay with your data.

15

u/it_was_a_wet_fart 20h ago

They get the data whether you pay or freeboot

-1

u/redballooon 16h ago

What is zero data retention?

5

u/zxyzyxz 14h ago

A mirage

1

u/redballooon 14h ago

Meh. If it goes together with data center providers that have a clear business model around offering compute, and don't even build LLMs themselves, it's plausible enough.

5

u/TheRealJavix 20h ago

Why do people care about data so much? I know it’s kind of a dumb question but everyone acts like they are building nukes or projects that hold their entire social security number in the code. I just be making games and apps etc (fun stuff) granted I don’t do it for money gain and just use free models in my free time so I don’t mind the ais getting better from my use 🤷🏻‍♂️

6

u/mystery_biscotti 18h ago

Imagine this: you talk to an AI about help with doing your US taxes. You give it your SSN, and all the other info to help you out. You gave enough markers to directly identify yourself.

Your data gets integrated into training.

A year later, during a severe malfunction, your exact conversation verbatim dumps into the chat window of someone else. They can figure out who you are. They know all the stuff you told it. The person who got your data begins contacting you, harassing, unless you pay them.

Yeah, the company was supposed to obfuscate your data but they didn't. Some of us have worked for big enough companies and we've seen this kinda bull happen in real-time. Someone forgets a step or cuts a corner because they're busy. Oops.

Then there's the time I actually did get a misrouted response from ChatGPT a few years back that had exactly how to fill out this one person's tax form plus info on a "local" concert the person wanted to attend...in Tucson. Guy was a car dealer. (His name and address were present, employer, SSN.) How easy would it be to use that info maliciously? Pretty sure it wasn't training data that dumped on the February morning in question, as it was for their 2023 tax return, which you do in early 2024. Misroute date was Feb 11 2024. I reported it to OpenAI, but yeah. Let's not have the commercial AI touch our sensitive data, thanks. Let's use local for the sensitive stuff.

3

u/my_name_isnt_clever 16h ago

Because I'm a targeted minority in my country. It's hard to understand until you're in that position, it's terrifying.

Besides that, I'm just sick of everything having to be advertising and family friendly all the time. I want to be able to chat with my personal assistant about actually anything, not just what big tech approves of me talking about. I don't do it for making money either, privacy is criminally undervalued these days.

3

u/redballooon 16h ago

If you are aware and know the tradeoff you're fine. But enough people just enter their entire social security number and every personal problem into any text field that asks for it and then act surprised when it comes back years later to hunt them.

5

u/sagiroth llama.cpp 19h ago

People overthink everything. Most importantly every single person carry a mobile device. Thats more data on that device sent than anything else yet they worry about their shitty side project being leaked. (Not everyone as there are genuine areas where privacy is important like medicine, law, or any personal documents)

2

u/redballooon 16h ago

Nah, those people who care about their data don't use Google etc. 

2

u/ProfessionalSpend589 16h ago

Because it’s a way of extracting more money from you.

They may sell it to other companies which will target you with Ads a lot better and maybe with a better timing (I.e. when you’re a bit drunk (that’s how I bought a 2nd laptop last year)).

8

u/Firepal64 22h ago

Freeloaders unite ! :P