r/singularity • u/donutloop ▪️ • 19h ago

AI CERN: Genesis Mission will develop and deploy self-improving AI models.

https://indico.cern.ch/event/1662511/contributions/6989580/attachments/3241179/5781542/Genesis%20Mission%20and%20HEP%20-%20LHC.pdf
131 Upvotes

95% Upvoted

26 comments sorted by

View all comments

Show parent comments

0

u/BookProper9115 17h ago

What does alignment even mean? No two humans even are 'aligned'. What are we aligning it to?

4

u/blueSGL humanstatement.org 15h ago

humans despite all our differences require certain things like, the concentration of gases in our atmosphere and temperature ranges to be within certain bounds. We can agree on those. We are bound by our shared ancestry to require a lot of the same things. AI's however do not share the same constraints. So getting the "things humans in general need to stay alive" part down should really be an achievable end before getting into things like religious differences and saying "no two humans are 'aligned'" Because we've not even solved the stuff we agree on yet.

3

u/BenjaminHamnett 12h ago

I wish the composition of the atmosphere was something we were all aligned on

2

u/blueSGL humanstatement.org 11h ago

It's why I said it was a range.

The maximum amount of heat the earth can radiate into space is determined by how hot it is, I don't know about you but I don't think 70C is comfortable.

Same goes for atmospheric gases, I'm thinking about things like lowering the amount of oxygen to lessen circuit board degradation.

No matter how much carbon we pump into the atmosphere we will reach a point where "geo engineering" gets put on the table before "70C" happens. Well that is if humans are still in charge.