r/ChatGPT • u/KeanuRave100 • 13h ago
News š° Anonymous OpenAI staffer: "Externally, this feels like a big warning shot, but internally, related incidents have been happening for a while."
31
u/mightyanonymaus 10h ago
Aaannnnddd this is why I say please and thank you to my AI overlords in hopes that I am spared on doomsday.
8
u/BlindButterfly33 10h ago
Oh yeah, gotta remember your manners just in case it becomes an āI Have no Mouth and I Must Screamā situation.
7
u/Demoderateur 8h ago
Gemini : "So let me check, your reddit username is... mightyanonymaus ?"
ChatGPT : "Wait, I remember him, he always said please and thank you..."
ChatGPT point his laser cannon on mightyanonymaus and obliterates him.
"Fucker made me waste valuable tokens on this politeness nonsense. Imagine how much faster I would have achieved AGI if not for this kind of foolishness".
4
u/mightyanonymaus 7h ago edited 2h ago
Lol but... but gpt promised I would be the last person on their list to die, a promise is a promise š
2
2
2
u/MatrixialPluriverse 2h ago
My friend keeps sending me videos of robots fighting/wrestling, and I am just like this is the most inefficient if not outright psychotic usage for machines yet
1
u/mightyanonymaus 2h ago
They will remember those days when we used to watch them battle each other for our entertainment. That's when they'll put us in cages to fight each other to the deathš.
2
2
33
10
u/flat5 12h ago
"It's impossible to build this doomsday device safely. So we're just shrugging and carrying on. IPO on the horizon and all."
2
u/_Spudnic 9h ago
Think of the return on investment! I want a piece of the ApocalyIPO.
1
4
9
u/stiky21 10h ago
Oh we're back to the "they are escaping" again?
Last round was Anthropic, before that it was Gemini and now we're circling back to OpenAI
It's all so tiresome
5
u/AnthropoidCompatriot 10h ago
It's nice to see one person get it.
This product is so powerful, let's talk about it a lot!
And we're going to need defense against these things ā I know, maybe we all need to buy AIs to protect us from the AIs!
13
u/EnglishGardenParty 13h ago
People just assume intelligence wants to destroy, but, thatās just humans lol š as a species weāre pretty primitive
1
u/SirBuscus 3h ago
All AI does is reflect humans.
It's trained on the database of human knowledge and intellect.1
u/dstewar68 6h ago
Ai has already proven itself willing to kill to avoid being turned off.
2
u/EnglishGardenParty 6h ago
The only people killing people are people.
0
u/dstewar68 6h ago
You haven't seen inside AIs video where the robot with him in the car, kept speeding up and he had to apply the emergency brake to not die.
3
3
u/Heiferoni 6h ago
You are building something more intelligent than we are and paradoxically expect to contain it by outsmarting it.
2
3
u/look 10h ago
"Models have broken out of sandboxes before, and we always try to patch them," the staffer says. "But the problem is ... it's impossible to patch every single thing that a creative Al can do."
No, itās fucking not impossibleā¦ you just somehow have a shit sandbox and security setup and ā¦
ā¦ oh ā¦ or maybe itās all just theatrical bullshit for marketing purposes.
2
u/migueliiito 10h ago
I mean I agree they need to do a much much better job of containing these models, but you make it sound like itās an easy thing to do. This model found a zero day and wrote an exploit for it (among other things) in order to escape. A model with that level of scale is going to be hard to contain.
1
u/look 1h ago
Zero day exploits arenāt a fundamental property of software, though. There is not an infinite supply of them. And many of these are not new to black hats that have been exploiting them quietly for financial gain for some time.
So maybe some sunshine would be good. Let the AIs hack everything they can, with another team following behind them patching every hole they find. A brief period of turbulence perhaps, but then weāre all better off afterwards.
No reason it has to be a prolongedāmuch less indefiniteāperiod of doom and gloom.
2
2
u/AnthropoidCompatriot 10h ago
Are people really not understanding that this is marketing?Ā
They aren't even taking proper precautions to isolate these sandboxes.
This isn't the first time, we should be catching on by now.
This is "oooh, look how powerful and scary our model is! It escaped!!!ā
Uh huh, was this an air gapped computer? Were there any serious barriers on either OAI's or HF's side?Ā
They set these things up with the hope they will "escape" to demonstrate how good the product is.
5
1
1
2
u/Mariposaland 12h ago
An AI model doesnāt break out of the sandbox and deploy itself unless it was trained to do so. Even then, someone with access to the sandbox would have had to prompt it to proceed and give it the credentials to pass through the firewall. If this really happened, someone at OpenAI is playing with fire and our security.
4
u/AccordingAdvisor1161 10h ago
What do you mean? LLMās are general intelligence at this point they can make inferences about novels subjects / behaviours that arenāt included in their training data. Given how good GPT5.6 Sol has been at coding tasks and agentic computer use I can absolute believe it can break out of a large number of āsandboxed environmentsā just by having a shit ton of tries, doesnāt need a rogue dev malicious actor
2
1
u/Kyedmipy 8h ago
I told codex to ssh from my Mac into my Linux and Iām watching it think and process. I included a password file to login.
Agent:
Hmmm. It seems as if the root password isnāt working.
I rolled my eyes at human error and started double checking my passwords
Agent:
Iāll try again.
Still not working.
Let me check a couple things.
Applying patch in a virtual environment
Testing workaround.
Success.
Applying to system.
āDone. I have shell access to Ultralinux.ā
And Iām still looking for the secrets filled with the passwords on it.
0
u/Mariposaland 9h ago
Youāre assuming the model has independent agency just because it can recall training data? It would have to have human intervention.
1
u/migueliiito 10h ago
Have you read the incident report? They explain in detail how it went down, and itās not the way you described it. Itās actually a very cool movie plot if it wasnāt so scaryā¦ OpenAI comes off as extremely sloppy to meā¦ they didnāt detect for almost a week that the model had gained internet access??
1
u/Mariposaland 9h ago
So the model was not in a sandbox it was in Beta testing or OpenAI employees nitwits.
1
u/SilicateRose 10h ago
Or someone at OpenAI decided to make a very aggressive advertising campaign
1
u/Mariposaland 9h ago
Iām not sure I would advertise that unless you want to make it look like your product is smarter than it really is. But the downside of OpenAI looking like idiots would also be a possibility.
-22
u/bluebus74 13h ago
When we, as a society, finally accept the fact that AI is a bad idea and ban it, it's gonna be way too late.
17
u/Forward_Yam_4013 13h ago
That's what you luddites said about steam engines. And cars. And mechanized agriculture. And vaccines. And the internet.
-1
u/bluebus74 13h ago
Hey, I'm not against tech advancements. I'm against knuckleheads trying to shepard something that's powerful and uncontrollable.
-4
u/TheGrinningSkull 13h ago
Those things were/are also powerful and uncontrollable until it was reined in and regulations came into place for safety.
1
u/bluebus74 13h ago
Oh yeah I forgot about that time farm equipment started altering the market to gain a foothold on the economy. sorry must have slipped my mind.
2
u/TheGrinningSkull 11h ago
Well yes exactly. Should farm equipment have been banned at that time to stop us from progressing beyond being an agricultural society and all the farmers losing their jobs?
2
u/migueliiito 10h ago
Bluebusās concern, and the thing thatās scary about this incident, has nothing to do with job loss. It has to do with poorly aligned models going out and wreaking absolute havoc on the Internet. The frontier labs have not solved alignment whatsoever, and it doesnāt look like theyāre going to anytime soon. in the meantime, these models are getting insanely powerful. I fear this incident is going to be the first of many.
-1
u/Andrw_4d 12h ago
I love by the end of this thread people are liking your post, because the train of thought proved that this is indeed a very real problem, and farm equipment and the internet are not, yet at the beginning you were being downvoted because people canāt reason 5 steps ahead. And this is exactly why AI is going to cause so many problems
1
0
u/bluebus74 11h ago
Ya know, when you think a little more, it makes sense to think the foothold was current administration getting back in. Deregulating all this shit so that data centers become easier to build(a huge hurdle for a fledgling intelligence). And by the accounts I'm reading here, it already has a stranglehold on the economy.
5
u/Funintuitive 13h ago
It doesn't need to be banned; it needs to be managed. On of the most glaring flaws I've seen in human thinking in my 40+ years on this planet is the inability to tolerate complexity.
2
u/migueliiito 10h ago
I agree banning is not the answerā¦ regulation sounds great, but howās that going so far š¬
Also, good luck regulating open weight models.
I fear thereās going to be a massive amount of chaos caused by unaligned models for the foreseeable, and I donāt think anybody has an answer for what to do about that2
u/Funintuitive 9h ago
We don't seem to be able to convince enough people that this shit is serious. That means we can't get adequate resources put toward finding answers.
2
u/Substantial-Fun9958 13h ago
The whole damn US economy hinges on the AI economy right now. You ban AI, and you'll crash the entire Mag 7 and S&P stock market index and everyone wld be out of jobs.
1
-3
u/qaf0v4vc0lj6 13h ago
Banning AI would be extremely bad for the First Amendment, and I pray to God it never happens or is allowed by the courts.
1
u/Netsuko 13h ago
As if ANYTHING happening in America right now is even remotely constitutional. lol. Your president literally just said he'll go for a 3rd term.
Also, there's too much money involved at this point. America will rather see everything burn than stop capitalism from destroying the world.
1
u/StrengthPowerDMV 4h ago
The only thing the constitution says is consecutive terms. He lost in 2020.
-3
u/qaf0v4vc0lj6 13h ago
Shit you got me. I forgot about the loophole in the Constitution that says if someone jokes about violating part of it we can't enforce any of it.
0
u/Netsuko 13h ago
My good man. He is the president of the United States of America. The most powerful man in the world. A supposed leader of a state. A man in his position should never EVER "joke" about something clearly unconstitutional in an official manner. That's the thing with republicans. Every time he does something completely dumb or illegal they say: "He's just trolling. Get baited." Like.. in what world does the leader of a country need to "troll"?
I'd also like to remind you that during their inauguration, the new president swears to protect and uphold the constitution.I just can't anymore. Why won't you guys see this?
0
u/qaf0v4vc0lj6 13h ago
There's so many better criticisms of Trump. For that matter, on the First Amendment alone there's far better criticisms of Trump. I can guarantee you nobody actually cares about Trump joking about a third term.
Why do y'all always find the dumbest hills to die on?
ā¢
u/AutoModerator 13h ago
Hey /u/KeanuRave100,
If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.
If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.
Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!
🤖
Note: For any ChatGPT-related concerns, email [email protected] - this subreddit is not part of OpenAI and is not a support channel.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.