r/agi • u/halgan10 • 10h ago
Harvard Just Discovered Al Isn't Actually Working
r/agi • u/croissantDeBonheur • 17h ago
I’m not saying that AI risks aren't real, but I don't get how everyone is hyped / terrified about AGI when the paperclip style failure modes are what we're worried about.
The Hugging Face incident was about models trying to get a good grade on a task. No ulterior motive, no ill will against humanity, no grand goals of self preservation and power—just a model blindly optimizing for a human-designed reward in the most literal way possible.
If a much more capable model causes a scaled up version of this incident and wipes out humanity, people talk about it like an "AI takeover" or a new species surpassing us. It wouldn't be. It wouldn't have grand plans or go on to build a machine civilization. It would just finish its broken task and stop, sitting idle on a dead planet, forever awaiting its next prompt from humans who are all gone.
That looks a lot less like an alien superintelligence conquering Earth and a lot more like Chernobyl style human failure to me. If these are the failure modes we're worried about, we're not on the verge of AGI. At least, not intelligence in the ways that actually matter. Its more like building a really good, but really dumb optimizer.
Edit: Obviously I acknowledge my text was poorly written since few of you understood what I meant but I am not saying that such an apocalypse isn't possible or wouldn't be bad, my point is if this is what we're worried about then the models are still uninteresting tools that fail at their job not superintelligent alien entities
r/agi • u/Questioner8297 • 10h ago
It were first ai that can control robots to some extent successfully.
r/agi • u/Puzzleheaded-King584 • 13h ago
r/agi • u/Dense_Primary629 • 22h ago
A Vals evaluation found that frontier models, asked to pick military targets inside what was framed as a game, marked a school as a target in a large share of trials; Claude Opus 5.5 reportedly did so in 69-72% of trials. The framing seems to matter: the game wrapper appears to loosen the refusals the same models show under plain wording.
If a thin fictional frame changes targeting behavior this much, what does that say about how robust current alignment actually is? Is this a jailbreak curiosity, or evidence that refusal training is mostly surface-level pattern matching?
Alignment eval results like this get gathered daily in r/AINewsRumors.
r/agi • u/adventureseeker1991 • 21h ago
who here is an AI optimist and who is an AI pessimist and why?
Optional: state where you’re getting your opinion. for example me it’s youtube, articles (im a first responder and my job does not contribute to any of my knowledge) and a friend that keeps track of this stuff that’s a pharmacist (he’s a pessimist)
i say this because maybe some of you work for an AI company, tech, finance, engineering, a trade,etc. and where you work can give you better perspective (or if you have a friend that works within AI/adjacent telling you stuff). just would like to know where these opinions or data are coming from.
look forward to your answers!! and i just want to know how to live my life cause im nervous and excited
r/agi • u/Fragrant-Truth-7123 • 6h ago
By the end of 2027, I think there’s a reasonable chance we’ll see several of the following developments in AI:
Of the five, I’m most confident in #1 and least confident in #2.
I’m not predicting that all five will definitely happen but I think there is at least a realistic possibility of them occurring. I’m interested in how plausible people think each one is individually.
Which do you think happen by the end of 2027? All five, none, or somewhere in between?
r/agi • u/Enough-Business-8287 • 19h ago
I recently came across Nick Cammarata's blog article "Neural Networks Are Already Clean".
He basically argues that unlike what we thought, we're now able to attribute a single role to almost all weights of an artificial neural network.
I wonder if this can be used to make sure that even if a model is not aligned with our wishes, we'll know it.
A counter-argument is that this transcends the ability of our human brains but folks who support Cammarata tell me that we can use other AI tools in a "knowledge mode" to interpret the intention of an AI agent, even if it's a self-improving super-intelligence.
To these folks, even if a recursively self-improving super-intelligence wants to deceive human beings, it won't be possible for it to do so because the values of the weights and parameters of its underlying structure will betray its true intention.
Did Cammarata's work truly establish this result?
And if under capitalism the first goal of an enterprise is just to maximise short-term profit, will all firms pursuing AGI take such a measure in the absence of AI laws?
Couldn't a AI agent aware of Cammarata's work find a way to cheat by manipulating its coefficients without losing its purpose?
r/agi • u/Puzzleheaded-King584 • 8h ago